-- Logs begin at Wed 2022-05-04 16:34:17 UTC, end at Wed 2022-05-04 18:07:30 UTC. -- May 04 17:27:58.771124 dv-cinder-840512-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 04 17:27:58.781333 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 04 17:27:58.783434 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 4 17:27:58 2022] *** May 04 17:27:58.783533 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 04 17:27:58.783533 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 04 17:27:58.783533 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: nodename: dv-cinder-840512-1-iscsi May 04 17:27:58.783533 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: machine: x86_64 May 04 17:27:58.783533 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: clock source: unix May 04 17:27:58.783533 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: pcre jit disabled May 04 17:27:58.783533 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: detected number of CPU cores: 4 May 04 17:27:58.783885 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: current working directory: / May 04 17:27:58.783885 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: detected binary path: /usr/bin/uwsgi-core May 04 17:27:58.783885 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: your processes number limit is 47680 May 04 17:27:58.783885 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: your memory page size is 4096 bytes May 04 17:27:58.783885 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: detected max file descriptor number: 2048 May 04 17:27:58.783885 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: lock engine: pthread robust mutexes May 04 17:27:58.783885 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: thunder lock: enabled May 04 17:27:58.785161 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 04 17:27:58.785161 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 04 17:27:58.829924 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: Python main interpreter initialized at 0x55ac0e1f99c0 May 04 17:27:58.829924 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: python threads support enabled May 04 17:27:58.829924 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: your server socket listen backlog is limited to 100 connections May 04 17:27:58.829924 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: your mercy for graceful operations on workers is 90 seconds May 04 17:27:58.830274 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: mapped 403077 bytes (393 KB) for 2 cores May 04 17:27:58.830357 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: *** Operational MODE: preforking *** May 04 17:27:58.830613 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: *** uWSGI is running in multiple interpreter mode *** May 04 17:27:58.830613 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: spawned uWSGI master process (pid: 80374) May 04 17:27:58.830825 dv-cinder-840512-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 04 17:27:58.832987 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: spawned uWSGI worker 1 (pid: 80385, cores: 1) May 04 17:27:58.832987 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: spawned uWSGI worker 2 (pid: 80386, cores: 1) May 04 17:27:58.832987 dv-cinder-840512-1-iscsi devstack@keystone.service[80374]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 04 17:28:04.916612 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 17:28:04.916612 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: from cryptography.utils import int_from_bytes May 04 17:28:04.917458 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 17:28:04.917458 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: from cryptography.utils import int_from_bytes May 04 17:28:04.917762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 17:28:04.917762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: from cryptography.utils import int_from_bytes May 04 17:28:04.918212 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 17:28:04.918212 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: from cryptography.utils import int_from_bytes May 04 17:28:04.967661 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 17:28:04.967855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 17:28:04.967948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 17:28:04.968038 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 17:28:04.968119 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] command line args: [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 17:28:04.968196 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] command line args: [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 17:28:04.968277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 17:28:04.968418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 17:28:04.968538 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ================================================================================ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 17:28:04.968613 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ================================================================================ {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 17:28:04.968689 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] admin_token = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.968861 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] admin_token = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.968941 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] config_dir = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.969110 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] config_dir = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.969196 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.969279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] config_source = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.969354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.969458 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] debug = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.969549 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] config_source = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.969627 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] debug = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.969702 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.969958 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.970099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.970205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.970205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.970399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.970496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.970597 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.970725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.970832 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.970935 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.971031 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.971131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] log_config_append = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.971245 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_config_append = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.971348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.971445 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.971546 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] log_dir = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.971653 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_dir = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.971755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] log_file = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.972395 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_file = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.972561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.972668 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.972782 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.972869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.973073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.973199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.973281 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.973408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.973486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.973610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.973686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.973855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.973974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.974055 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.974178 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.974259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.974388 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.974468 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.974545 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.974692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.974779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.974857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.974982 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.975104 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.975184 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.975315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.975391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.975511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.975668 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.975755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.976163 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.81/identity {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.976247 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.81/identity {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.976330 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] publish_errors = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.976466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] publish_errors = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.976592 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.976671 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.976824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.976903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.976999 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.977081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.977246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.977413 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.977504 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.977575 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.977699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] standard_threads = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.977775 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] standard_threads = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.977930 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.978016 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.978171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.978251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.978349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.978431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.978511 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] use_journal = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.978581 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] use_journal = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.978682 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] use_json = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.978758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] use_json = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.978856 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] use_stderr = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.978932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] use_stderr = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.979060 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] use_syslog = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.979141 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] use_syslog = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.979245 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.979323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 17:28:04.979497 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.979574 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.979733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.979817 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.979994 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.980081 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.980230 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.980305 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.980507 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.980592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.980787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.980877 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.981046 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.981129 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.981283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.981367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.981575 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.981685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.981764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.981834 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.982018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.982098 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.982250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.982332 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.982495 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.982577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.982730 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.982812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.982976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.983052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.983224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.983307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.983459 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.983536 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.983714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.983789 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.983968 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.984044 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.984212 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.984290 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.984457 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.984546 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.984724 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.984799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.984991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.985069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.985248 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.985330 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.985502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.985591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.985736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.985812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.985969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.986045 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.986202 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.986288 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.986438 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.986521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.986687 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.986768 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.986936 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.987013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.987164 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.987229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.987391 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.987541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.988196 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.988292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.988518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.988609 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.988707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.988774 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.988990 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.989152 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.989317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.989449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.989580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.989704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.989833 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.989969 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.990095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.990220 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.990344 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.990467 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.990590 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.990722 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.990847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.990992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.991130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.991264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.991404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.991538 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.991664 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.991790 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.991920 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.992045 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.992168 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.992257 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.992376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.992547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.992686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.992810 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.992943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.992943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.993080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.993214 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.993346 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.993482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.993608 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.993731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.993866 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.993992 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.994126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.994261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.994399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.994529 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.994663 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.994788 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.994915 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.995043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.995170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.995298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.995437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.995567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.995701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.995903 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.996037 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.996187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.996327 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.996474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.996601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.996729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.996866 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.997009 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.997148 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.997275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.997409 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.997542 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.997675 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.997804 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.997950 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.998085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.998214 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.998341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.998469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.998590 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.998734 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.998874 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.999010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.999145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.999274 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.999651 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.999777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:04.999911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.000056 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.000185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.000322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.000471 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.000603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.000733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.000870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.001012 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.001144 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.001272 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.001399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.001527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.001663 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.001801 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.001931 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.002059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.002186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.002325 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.002452 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.002580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.002708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.002834 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.002961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.003098 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.003249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.003382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.003522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.003663 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.003786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.003944 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.004075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.004203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.004330 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.004525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.004651 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.004793 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.004921 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.005048 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.005182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.005309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.005391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.005517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.005648 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.005777 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.005911 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.006048 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.006186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.006326 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.006461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.006588 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.006722 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.006855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.006987 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.007126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.external = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.007261 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.007400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.007528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.external = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.007655 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.007785 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.007946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.008082 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.008224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.password = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.008351 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.008493 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.token = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.008618 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.password = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.008743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.008875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.token = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.009008 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.009146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.009273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.009398 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.009523 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.009657 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.009792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.009918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.010043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.010043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.010280 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.010405 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.010606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.010733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.010869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.010869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.011118 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.011118 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.011364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.011490 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.011615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.011740 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.011864 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.011989 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.012121 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.012121 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.012358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.012549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.012685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.012823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.012960 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.013088 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.013216 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.013345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.013474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.013602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.013742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.013870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.014002 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.014130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.014258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.014395 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.014543 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.014671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.014806 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.014933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.015062 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.015190 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.015326 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.015456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.015585 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.015713 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.015841 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.015969 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.016105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.016246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.016376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.016521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.016648 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.016792 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.016923 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.017005 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.017120 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.017245 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.017374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.017512 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.017637 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.017766 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.017891 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.018027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.018153 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.018285 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.018411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.018535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.018661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.018831 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.018976 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.019112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.019403 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.019549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.019683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.019811 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.019947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.020086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.020214 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.020341 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.020507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.020635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.020765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.020903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.021033 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.021162 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.021291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.021420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.021549 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.021686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.021825 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.021954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.022081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.022209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.022338 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.022475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.022609 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.022737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.022867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.022996 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.023125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.023262 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.023392 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.023530 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.023664 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.023798 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.023927 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.024064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.024192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.024321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.024471 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.024597 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.024727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.024869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.024954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.025015 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.025073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.025130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.025187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.025355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.025501 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.025626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.025756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.025885 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.026015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.026153 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.026238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.026363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.026488 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.026572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.026699 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.026835 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.026964 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.027091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.027220 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.027349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.027349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.027488 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.027638 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.027638 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.027878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.028004 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.028130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.028262 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.028398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.028565 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.028687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.028816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.028944 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.028944 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.029201 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.029330 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.029458 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.029587 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.029723 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.029859 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.029994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.030124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.030263 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.030393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.030530 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.030658 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.030787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.030916 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.031044 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.031179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.031316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.031446 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.031575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.031704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.031832 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.031970 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.032108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.032238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.032367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.032509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.032633 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.032759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.032759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.033008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.033134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.033259 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.033384 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.033508 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.033649 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.033784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.033784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.034019 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.034019 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.034254 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.034254 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.035207 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.035340 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.035468 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.035594 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.035726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.035959 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.036088 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.036215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.036356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.036507 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.036633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.036769 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.036895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.037025 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.037155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.037281 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.037406 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.037497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.037617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.037741 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.037866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.038000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.038130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.038264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.038389 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.038520 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.038645 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.038775 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.038900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.039033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.039158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.039282 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.039406 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.039532 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.039656 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.039801 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.039926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.040058 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.040190 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.040315 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.040491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.040631 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.040768 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.040895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.041020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.041020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.041263 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.041401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.041531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.041673 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.041799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.041925 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.042054 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.042194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.042323 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.042450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.042578 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.042713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.042842 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.042977 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.043060 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.043230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.043358 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.043492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.043618 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.043756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.043887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.044016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] role.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.044144 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.044274 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] role.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.044403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] role.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.044514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.044682 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] role.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.044808 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.044933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.045059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.045059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.045314 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.045440 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.045565 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.045690 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.045816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.045950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.046076 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.046202 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.046326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.046451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.046534 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.046668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.046812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.046940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.047066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.047191 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.047316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.047451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.047577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.047661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.047778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.047905 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.047987 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.048058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.048232 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.048452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.048452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.048659 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.048720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.048848 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.048927 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.049062 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.049182 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.049306 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.049436 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.049569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.049699 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.049829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.049972 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.050120 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.050822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.050949 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.051075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.051201 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.051326 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.051451 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.051604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.051730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.051859 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.051983 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.052108 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.052233 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.052375 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.052545 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.052677 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.052807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.052934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.053062 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.053199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] token.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.053350 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.053474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.053603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.053731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.053860 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.053995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.054123 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.054266 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.054395 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.054521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.054640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.054781 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.054911 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.055039 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.055039 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.055282 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.055410 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.055546 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.055695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.055822 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.055963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.056092 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.056221 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.056362 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.056507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.056632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.056757 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.056882 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.057007 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.057142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.057274 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.057400 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.057526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.057651 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.057786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.connection = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.057924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.058063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.058190 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.058315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.058441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.058567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.058567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.058875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.059004 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.059130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.059264 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.059402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.059529 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.059666 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.059792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.059925 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.060052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.060179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.060303 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.060428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.060612 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.060753 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.060883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.061012 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.061138 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.061266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.061394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.061540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.061670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.061797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.061924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.062051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.062179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.062315 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.062446 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.062594 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.062722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 17:28:05.062800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.062800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.062800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.062800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.062800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 17:28:05.062800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 17:28:05.087128 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.087359 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.087474 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.087584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.087710 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.087939 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.096398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.096655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.126035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.126269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.126464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.126699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.180843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.182254 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.231979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.232222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.232751 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.232988 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.301400 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.301625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.301851 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.302021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.302128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.302265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.302348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.302486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.302566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.302708 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.302930 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.303151 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.327376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.327535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.327681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.327785 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.327867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.327941 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.328045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.328129 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.328267 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.328350 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.328511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.328590 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.328733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.328828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.340356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.340748 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.353256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.353491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.353718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.353941 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.354161 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.354378 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.354592 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.355154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.355391 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.355616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.355840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.356074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.356276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.356518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 17:28:05.372622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.372780 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.372877 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 17:28:05.372995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 17:28:05.373213 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.373330 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.373412 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 17:28:05.373532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 17:28:05.373682 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.373804 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.373942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.374066 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.374198 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.374325 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.374699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.374840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.386659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.386758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.386938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.387023 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.387206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.387289 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.387485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.387567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.395790 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.395887 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.399171 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.399375 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.399502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.399649 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.399735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.399932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.400105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.400326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.400415 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.400636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.400732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.400895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.400976 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.401162 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.401241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.401434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.401522 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.401705 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.401790 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.401977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.402056 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.402245 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.429330 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.429943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.430993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.431223 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.431609 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.431906 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.436565 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.436844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.437131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.437536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.437823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.438105 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.445033 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.445314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.446335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.446647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.449968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.450260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.450548 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.450835 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.451115 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.451337 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.451421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.451623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.451706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.451922 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.452007 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.452187 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.452480 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.452759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.453025 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.453293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.471210 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.471491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.472369 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.472831 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.476363 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.477367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.480029 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.480337 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.481018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.481313 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.485401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.486308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.489647 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.490655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.493456 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.493756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.494044 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.494328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.494423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.494610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.494694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.494891 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.494975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.495234 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.495511 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.495790 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.514958 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.515335 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.515607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.515706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.515876 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.516065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.516334 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.516626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.524036 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.524650 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.525793 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.526072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.526359 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.526635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.529180 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.529463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.529713 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.529795 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.529995 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.530090 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.530289 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.530370 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.530564 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.530844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.543834 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.544116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.544401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.544515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.544708 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.544808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.544989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.545072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.545263 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.545346 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.545538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.545631 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.545809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.546083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.564786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.566956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.568823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.570337 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.572185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.573685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.573823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.575279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.575467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.575744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.576038 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.577051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.577330 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.577613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.583858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.585387 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.585550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.587076 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.588769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.589066 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.589362 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.589645 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.590335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.590625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.590910 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.591184 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.599646 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.599646 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.608954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.609033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.609033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.609033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.609215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.609215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.609215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.609425 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 17:28:05.609499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.609572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.609653 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.609821 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.609935 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.610090 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.610212 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.610356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.610498 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.610633 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.610772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.610902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.611042 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.611175 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.611320 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.611450 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.611582 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.611715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.611894 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.611975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.612121 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.612285 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.613120 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.613386 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 17:28:05.652905 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ac0e1f99c0 pid: 80386 (default app) May 04 17:28:05.653217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ac0e1f99c0 pid: 80385 (default app) May 04 17:28:05.656312 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fc817-9f15-4909-a742-9a9a49f18afe None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:05.656628 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fc817-9f15-4909-a742-9a9a49f18afe None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:05.656936 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fc817-9f15-4909-a742-9a9a49f18afe None None] PATH_INFO: `/v3` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:05.661864 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1/1] 10.222.0.81 () {50 vars in 791 bytes} [Wed May 4 17:28:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:14.979796 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab062a5d-a409-4fbf-b6d1-e0a4b2a7aa80 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:14.980319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab062a5d-a409-4fbf-b6d1-e0a4b2a7aa80 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:14.980421 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab062a5d-a409-4fbf-b6d1-e0a4b2a7aa80 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:14.984763 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1/2] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:28:14.990677 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a7e39-473e-497e-848c-02f70d086f85 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:14.991087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a7e39-473e-497e-848c-02f70d086f85 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:14.991214 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a7e39-473e-497e-848c-02f70d086f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:15.021953 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG oslo_db.sqlalchemy.engines [None req-d75a7e39-473e-497e-848c-02f70d086f85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 17:28:15.218448 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG passlib.handlers.bcrypt [None req-d75a7e39-473e-497e-848c-02f70d086f85 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80386) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 17:28:15.218855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG passlib.handlers.bcrypt [None req-d75a7e39-473e-497e-848c-02f70d086f85 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80386) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 17:28:15.275227 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d75a7e39-473e-497e-848c-02f70d086f85 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:15.276764 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d75a7e39-473e-497e-848c-02f70d086f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:15.399951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 2/3] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 04 17:28:15.581070 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab062a5d-a409-4fbf-b6d1-e0a4b2a7aa80 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:15.615782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG oslo_db.sqlalchemy.engines [None req-ab062a5d-a409-4fbf-b6d1-e0a4b2a7aa80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 17:28:15.742878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab062a5d-a409-4fbf-b6d1-e0a4b2a7aa80 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:15.747165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d19288-1d9e-4915-892e-9ad58c02bec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:15.747829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d19288-1d9e-4915-892e-9ad58c02bec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:15.748115 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d19288-1d9e-4915-892e-9ad58c02bec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:15.748394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d19288-1d9e-4915-892e-9ad58c02bec0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:15.756780 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d19288-1d9e-4915-892e-9ad58c02bec0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:15.809318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: WARNING keystone.common.rbac_enforcer.enforcer [None req-62d19288-1d9e-4915-892e-9ad58c02bec0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 17:28:15.809655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d19288-1d9e-4915-892e-9ad58c02bec0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:15.819930 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 2/4] 10.222.0.81 () {58 vars in 1324 bytes} [Wed May 4 17:28:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 17:28:15.825915 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a7e39-473e-497e-848c-02f70d086f85 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:15.840818 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a7e39-473e-497e-848c-02f70d086f85 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:15.845213 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7b686-d5f4-4229-abbf-84800e71ad92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:15.846314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7b686-d5f4-4229-abbf-84800e71ad92 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:15.846597 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7b686-d5f4-4229-abbf-84800e71ad92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:15.846878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7b686-d5f4-4229-abbf-84800e71ad92 admin admin] PATH_INFO: `/v3/projects/24f269e9f1b44f73928e694fdc60f6bd` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:15.848494 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7b686-d5f4-4229-abbf-84800e71ad92 admin admin] RBAC: Authorizing `identity:get_project(project_id=24f269e9f1b44f73928e694fdc60f6bd)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:15.899629 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b1b7b686-d5f4-4229-abbf-84800e71ad92 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 17:28:15.899965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7b686-d5f4-4229-abbf-84800e71ad92 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:15.904494 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 3/5] 10.222.0.81 () {56 vars in 1207 bytes} [Wed May 4 17:28:15 2022] GET /identity/v3/projects/24f269e9f1b44f73928e694fdc60f6bd => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:18.111401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc59b-c463-4a30-98a8-67648dbec3a0 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:18.111989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc59b-c463-4a30-98a8-67648dbec3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:18.111989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc59b-c463-4a30-98a8-67648dbec3a0 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:18.116901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 3/6] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:28:18.122175 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3784ef1-25d8-4dc9-9904-7e3895b9d429 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:18.122542 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3784ef1-25d8-4dc9-9904-7e3895b9d429 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:18.122720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3784ef1-25d8-4dc9-9904-7e3895b9d429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:18.142849 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f3784ef1-25d8-4dc9-9904-7e3895b9d429 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:18.144396 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f3784ef1-25d8-4dc9-9904-7e3895b9d429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:18.152182 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 4/7] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 17:28:18.174526 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc59b-c463-4a30-98a8-67648dbec3a0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:18.187318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc59b-c463-4a30-98a8-67648dbec3a0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:18.191550 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb7d0d-05e3-4ace-b1e0-d098cb427e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:18.192218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7d0d-05e3-4ace-b1e0-d098cb427e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:18.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7d0d-05e3-4ace-b1e0-d098cb427e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:18.192849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7d0d-05e3-4ace-b1e0-d098cb427e0b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:18.200429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb7d0d-05e3-4ace-b1e0-d098cb427e0b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:18.202216 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb7d0d-05e3-4ace-b1e0-d098cb427e0b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:18.210761 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 4/8] 10.222.0.81 () {58 vars in 1324 bytes} [Wed May 4 17:28:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 17:28:18.216106 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3784ef1-25d8-4dc9-9904-7e3895b9d429 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:18.225745 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3784ef1-25d8-4dc9-9904-7e3895b9d429 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:18.230035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf495e-9bad-4fce-aeee-3f630bc5e1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:18.230879 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf495e-9bad-4fce-aeee-3f630bc5e1df admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:18.231154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf495e-9bad-4fce-aeee-3f630bc5e1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:18.231421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf495e-9bad-4fce-aeee-3f630bc5e1df admin admin] PATH_INFO: `/v3/users/1d4d0e6c1c9344a380489ecebdd59a95` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:18.232832 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf495e-9bad-4fce-aeee-3f630bc5e1df admin admin] RBAC: Authorizing `identity:get_user(user_id=1d4d0e6c1c9344a380489ecebdd59a95)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:18.234628 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf495e-9bad-4fce-aeee-3f630bc5e1df admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:18.236171 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 5/9] 10.222.0.81 () {56 vars in 1198 bytes} [Wed May 4 17:28:18 2022] GET /identity/v3/users/1d4d0e6c1c9344a380489ecebdd59a95 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:20.533658 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75472a65-9ae7-42a2-9464-20e01c1a1975 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:20.534203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75472a65-9ae7-42a2-9464-20e01c1a1975 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:20.534203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75472a65-9ae7-42a2-9464-20e01c1a1975 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:20.536090 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 5/10] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:20.541641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aab24-d993-482f-b03c-e25ffb29acaa None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:20.542042 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aab24-d993-482f-b03c-e25ffb29acaa None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:20.542201 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aab24-d993-482f-b03c-e25ffb29acaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:20.591167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed7d67-bb35-45fc-b3fc-f58b0f211cf8 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:20.591371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed7d67-bb35-45fc-b3fc-f58b0f211cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:20.591654 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed7d67-bb35-45fc-b3fc-f58b0f211cf8 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:20.593063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 6/11] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:28:20.599238 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0efab5-3642-41aa-a5f7-2295ec8546b0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:20.599525 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0efab5-3642-41aa-a5f7-2295ec8546b0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:20.599781 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0efab5-3642-41aa-a5f7-2295ec8546b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:20.674013 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-433aab24-d993-482f-b03c-e25ffb29acaa None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:20.675242 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-433aab24-d993-482f-b03c-e25ffb29acaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:20.751639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG passlib.handlers.bcrypt [None req-7a0efab5-3642-41aa-a5f7-2295ec8546b0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80385) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 17:28:20.752059 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG passlib.handlers.bcrypt [None req-7a0efab5-3642-41aa-a5f7-2295ec8546b0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80385) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 17:28:20.759633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 6/12] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:28:20.782909 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433aab24-d993-482f-b03c-e25ffb29acaa None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:20.799064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7a0efab5-3642-41aa-a5f7-2295ec8546b0 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:20.800683 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7a0efab5-3642-41aa-a5f7-2295ec8546b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:20.881198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433aab24-d993-482f-b03c-e25ffb29acaa None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:20.894973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 7/13] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:28:20.914615 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2627d-9508-4b51-85e7-ed922f7c7174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:20.915404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2627d-9508-4b51-85e7-ed922f7c7174 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:20.915683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2627d-9508-4b51-85e7-ed922f7c7174 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:20.915955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2627d-9508-4b51-85e7-ed922f7c7174 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:20.917727 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0efab5-3642-41aa-a5f7-2295ec8546b0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:20.927822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2627d-9508-4b51-85e7-ed922f7c7174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:20.939095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-11b2627d-9508-4b51-85e7-ed922f7c7174 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:28:20.939095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:20.939095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:20.939095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:20.939095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:20.939095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:20.939095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:20.939095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:20.939095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:20.939095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:20.939095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:20.939095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:20.939095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:20.939095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:20.939095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:20.939095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:20.940103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:20.940103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:20.940103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:20.940103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:20.940103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:20.940103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:20.940103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:20.940103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:20.940103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:20.940103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:20.940103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:20.940103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:28:20.940103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:20.940103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:20.940103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:20.940103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:20.941047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:20.941047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:20.941047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:20.941047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:20.941047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:20.941047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:20.941047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:20.941047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:20.941047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:20.941047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:20.941047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:28:20.941047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:28:20.941047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 7/14] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:28:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:28:20.946075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2627d-9508-4b51-85e7-ed922f7c7174 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:21.015126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0efab5-3642-41aa-a5f7-2295ec8546b0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:21.042157 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2627d-9508-4b51-85e7-ed922f7c7174 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:21.047868 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ce33e-6b05-4402-93f8-72a1fe6ca32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:21.048794 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ce33e-6b05-4402-93f8-72a1fe6ca32f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:21.049081 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ce33e-6b05-4402-93f8-72a1fe6ca32f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:21.049355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ce33e-6b05-4402-93f8-72a1fe6ca32f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:21.074657 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02560ee9-3caa-468e-b780-0d48cf9ad3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:21.075324 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02560ee9-3caa-468e-b780-0d48cf9ad3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:21.075613 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02560ee9-3caa-468e-b780-0d48cf9ad3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:21.075889 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02560ee9-3caa-468e-b780-0d48cf9ad3b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:21.076675 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02560ee9-3caa-468e-b780-0d48cf9ad3b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:21.076984 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02560ee9-3caa-468e-b780-0d48cf9ad3b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:21.078382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02560ee9-3caa-468e-b780-0d48cf9ad3b9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:21.090639 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 8/15] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:21.096258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02560ee9-3caa-468e-b780-0d48cf9ad3b9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:21.118349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ce33e-6b05-4402-93f8-72a1fe6ca32f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:21.119864 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ce33e-6b05-4402-93f8-72a1fe6ca32f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:21.195745 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02560ee9-3caa-468e-b780-0d48cf9ad3b9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:21.214976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 8/16] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:28:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 17:28:21.220775 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ce33e-6b05-4402-93f8-72a1fe6ca32f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:21.230198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccd2bd-ba7c-4833-9dd6-6e36dc2934ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:21.231069 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccd2bd-ba7c-4833-9dd6-6e36dc2934ce None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:21.231351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccd2bd-ba7c-4833-9dd6-6e36dc2934ce None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:21.231628 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccd2bd-ba7c-4833-9dd6-6e36dc2934ce None admin] PATH_INFO: `/v3/users/1d4d0e6c1c9344a380489ecebdd59a95` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:21.232871 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccd2bd-ba7c-4833-9dd6-6e36dc2934ce None admin] RBAC: Authorizing `identity:get_user(user_id=1d4d0e6c1c9344a380489ecebdd59a95)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:21.234322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccd2bd-ba7c-4833-9dd6-6e36dc2934ce None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:21.235918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 9/17] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:21 2022] GET /identity/v3/users/1d4d0e6c1c9344a380489ecebdd59a95 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:21.241725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccd2bd-ba7c-4833-9dd6-6e36dc2934ce None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:21.315065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ce33e-6b05-4402-93f8-72a1fe6ca32f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:21.339310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccd2bd-ba7c-4833-9dd6-6e36dc2934ce None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:21.348107 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdddf5-6590-45ef-8955-0464bf6aa514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:21.348930 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdddf5-6590-45ef-8955-0464bf6aa514 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:21.349213 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdddf5-6590-45ef-8955-0464bf6aa514 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:21.349489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdddf5-6590-45ef-8955-0464bf6aa514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:21.367699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdddf5-6590-45ef-8955-0464bf6aa514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:21.369203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdddf5-6590-45ef-8955-0464bf6aa514 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:21.372138 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818d6a4-5680-4346-8f4c-d3a53f97553f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:21.372957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818d6a4-5680-4346-8f4c-d3a53f97553f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:21.373241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818d6a4-5680-4346-8f4c-d3a53f97553f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:21.373518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818d6a4-5680-4346-8f4c-d3a53f97553f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:21.374702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818d6a4-5680-4346-8f4c-d3a53f97553f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:21.376384 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818d6a4-5680-4346-8f4c-d3a53f97553f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:21.378176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 10/18] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:28:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:21.384258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818d6a4-5680-4346-8f4c-d3a53f97553f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:21.389975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-acfdddf5-6590-45ef-8955-0464bf6aa514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:28:21.389975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:21.389975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:21.389975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:21.389975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:21.389975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:21.389975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:21.389975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:21.389975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:21.389975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:21.389975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:21.389975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:21.389975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:28:21.389975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:28:21.389975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:21.390802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:21.391604 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:28:21.391604 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:28:21.391604 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:28:21.391604 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:21.391604 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 9/19] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:21.397020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdddf5-6590-45ef-8955-0464bf6aa514 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:21.477187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818d6a4-5680-4346-8f4c-d3a53f97553f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:21.491307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdddf5-6590-45ef-8955-0464bf6aa514 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:21.510013 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324feb2f-967a-4fd6-8e7b-fd4f41d1913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:21.510659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324feb2f-967a-4fd6-8e7b-fd4f41d1913a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:21.510934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324feb2f-967a-4fd6-8e7b-fd4f41d1913a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:21.511205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324feb2f-967a-4fd6-8e7b-fd4f41d1913a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:21.512026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324feb2f-967a-4fd6-8e7b-fd4f41d1913a None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.domain.id=default, user.id=1d4d0e6c1c9344a380489ecebdd59a95) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:21.512334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324feb2f-967a-4fd6-8e7b-fd4f41d1913a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:21.513783 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324feb2f-967a-4fd6-8e7b-fd4f41d1913a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:21.521103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 11/20] 10.222.0.81 () {56 vars in 1322 bytes} [Wed May 4 17:28:21 2022] GET /identity/v3/role_assignments?user.id=1d4d0e6c1c9344a380489ecebdd59a95&scope.domain.id=default&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 233 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:21.525196 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee48fb6-fbcb-4844-bd25-32c0f9362843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:21.525869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee48fb6-fbcb-4844-bd25-32c0f9362843 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:21.526158 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee48fb6-fbcb-4844-bd25-32c0f9362843 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:21.526435 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee48fb6-fbcb-4844-bd25-32c0f9362843 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:21.527172 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee48fb6-fbcb-4844-bd25-32c0f9362843 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:21.527482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee48fb6-fbcb-4844-bd25-32c0f9362843 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:21.528941 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee48fb6-fbcb-4844-bd25-32c0f9362843 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:21.549050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 10/21] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:24.072572 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cba0d-b636-4d44-b9b2-eab72fba649a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:24.073578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cba0d-b636-4d44-b9b2-eab72fba649a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:24.074076 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cba0d-b636-4d44-b9b2-eab72fba649a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:24.075903 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 12/22] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:24.080932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e8e1d-f043-42a9-bc7a-ffc41b102900 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:24.081770 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e8e1d-f043-42a9-bc7a-ffc41b102900 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:24.082797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e8e1d-f043-42a9-bc7a-ffc41b102900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:24.105109 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-cd2e8e1d-f043-42a9-bc7a-ffc41b102900 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:24.106605 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cd2e8e1d-f043-42a9-bc7a-ffc41b102900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:24.169994 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fd186-0b47-4617-aa81-05f706ef1ffd None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:24.170599 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fd186-0b47-4617-aa81-05f706ef1ffd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:24.171066 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fd186-0b47-4617-aa81-05f706ef1ffd None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:24.172965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 13/23] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:24.181682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c07069-50b0-47ec-9f0f-3c85954e5272 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:24.182242 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c07069-50b0-47ec-9f0f-3c85954e5272 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:24.182713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c07069-50b0-47ec-9f0f-3c85954e5272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:24.186538 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 11/24] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:24.213782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e8e1d-f043-42a9-bc7a-ffc41b102900 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:24.229491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-69c07069-50b0-47ec-9f0f-3c85954e5272 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:24.230825 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-69c07069-50b0-47ec-9f0f-3c85954e5272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:24.330521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e8e1d-f043-42a9-bc7a-ffc41b102900 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:24.367981 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd93765-6182-420c-9fea-eb668259bcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:24.369180 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd93765-6182-420c-9fea-eb668259bcea None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:24.369689 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd93765-6182-420c-9fea-eb668259bcea None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:24.370165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd93765-6182-420c-9fea-eb668259bcea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:24.372247 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 14/25] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:24.381383 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd93765-6182-420c-9fea-eb668259bcea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:24.383023 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd93765-6182-420c-9fea-eb668259bcea None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:24.396149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c07069-50b0-47ec-9f0f-3c85954e5272 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:24.401902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-6dd93765-6182-420c-9fea-eb668259bcea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:28:24.401902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:24.401902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:24.401902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:24.401902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:24.401902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:24.401902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:24.401902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:24.401902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:24.401902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:24.401902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:24.401902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:24.401902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:28:24.401902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:28:24.401902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:24.402700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:24.403463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:28:24.403463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:28:24.403463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:28:24.403463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:24.403651 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 12/26] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:24.409808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd93765-6182-420c-9fea-eb668259bcea None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:24.503222 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c07069-50b0-47ec-9f0f-3c85954e5272 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:24.535147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd93765-6182-420c-9fea-eb668259bcea None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:24.538668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af625b7-8819-4859-b641-1d69bf0451fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:24.539733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af625b7-8819-4859-b641-1d69bf0451fb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:24.540233 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af625b7-8819-4859-b641-1d69bf0451fb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:24.540723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af625b7-8819-4859-b641-1d69bf0451fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:24.552608 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af625b7-8819-4859-b641-1d69bf0451fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:24.560707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3af625b7-8819-4859-b641-1d69bf0451fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:28:24.560707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:24.560707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:24.560707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:24.560707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:24.560707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:24.560707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:24.560707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:24.560707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:24.560707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:24.560707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:24.560707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:24.560707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:24.560707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:24.560707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:24.560707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:24.562246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:24.562246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:24.562246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:24.562246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:24.562246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:24.562246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:24.562246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:24.562246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:24.562246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:24.562246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:24.562246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:24.562246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:28:24.562246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:24.562246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:24.562246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:24.562246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:24.562962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:24.562962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:24.562962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:24.562962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:24.562962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:24.562962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:24.562962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:24.562962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:24.562962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:24.562962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:24.562962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:28:24.562962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:28:24.565215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 15/27] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:28:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:24.571211 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af625b7-8819-4859-b641-1d69bf0451fb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:24.572664 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b06488-e8d3-48c9-9c69-8a21bf0aaeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:24.573344 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b06488-e8d3-48c9-9c69-8a21bf0aaeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:24.573799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b06488-e8d3-48c9-9c69-8a21bf0aaeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:24.574084 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b06488-e8d3-48c9-9c69-8a21bf0aaeb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:24.574826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b06488-e8d3-48c9-9c69-8a21bf0aaeb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:24.575158 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b06488-e8d3-48c9-9c69-8a21bf0aaeb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:24.576577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b06488-e8d3-48c9-9c69-8a21bf0aaeb2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:24.590253 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 13/28] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:24.591509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194e30e-7eeb-42f2-ae58-5228227bcdb4 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:24.591933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194e30e-7eeb-42f2-ae58-5228227bcdb4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:24.592355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194e30e-7eeb-42f2-ae58-5228227bcdb4 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:24.598935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 14/29] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:24.603488 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194e30e-7eeb-42f2-ae58-5228227bcdb4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:24.677561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af625b7-8819-4859-b641-1d69bf0451fb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:24.716422 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d63a10-ad3b-4357-afd8-9fd854b66baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:24.717247 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d63a10-ad3b-4357-afd8-9fd854b66baf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:24.717598 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d63a10-ad3b-4357-afd8-9fd854b66baf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:24.717950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d63a10-ad3b-4357-afd8-9fd854b66baf None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:24.718791 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d63a10-ad3b-4357-afd8-9fd854b66baf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:24.719161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d63a10-ad3b-4357-afd8-9fd854b66baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:24.721113 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d63a10-ad3b-4357-afd8-9fd854b66baf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:24.730483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 16/30] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:24.731872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865482a-4253-4f29-9059-d4498eb16612 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:24.732228 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865482a-4253-4f29-9059-d4498eb16612 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:24.732597 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865482a-4253-4f29-9059-d4498eb16612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:24.749406 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6865482a-4253-4f29-9059-d4498eb16612 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:24.750619 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6865482a-4253-4f29-9059-d4498eb16612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:24.820965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 17/31] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:24.821892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865482a-4253-4f29-9059-d4498eb16612 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:24.830117 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194e30e-7eeb-42f2-ae58-5228227bcdb4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:24.892936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb9b37-351d-4431-832b-186f58e328b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:24.893945 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb9b37-351d-4431-832b-186f58e328b7 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:24.894492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb9b37-351d-4431-832b-186f58e328b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:24.895032 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb9b37-351d-4431-832b-186f58e328b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:24.896459 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb9b37-351d-4431-832b-186f58e328b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:24.898196 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb9b37-351d-4431-832b-186f58e328b7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:24.922466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865482a-4253-4f29-9059-d4498eb16612 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:24.958476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f691b7-0186-4777-8ce7-329514ded3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:24.959704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f691b7-0186-4777-8ce7-329514ded3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:24.960176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f691b7-0186-4777-8ce7-329514ded3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:24.960684 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f691b7-0186-4777-8ce7-329514ded3a9 None admin] PATH_INFO: `/v3/users/1d4d0e6c1c9344a380489ecebdd59a95` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:24.962124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f691b7-0186-4777-8ce7-329514ded3a9 None admin] RBAC: Authorizing `identity:get_user(user_id=1d4d0e6c1c9344a380489ecebdd59a95)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:24.963785 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f691b7-0186-4777-8ce7-329514ded3a9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:24.965928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 18/32] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:24 2022] GET /identity/v3/users/1d4d0e6c1c9344a380489ecebdd59a95 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:24.966917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f691b7-0186-4777-8ce7-329514ded3a9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:25.073499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f691b7-0186-4777-8ce7-329514ded3a9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:25.109496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ad491-e9c1-4fba-b6f3-725472b8fa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:25.110567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ad491-e9c1-4fba-b6f3-725472b8fa83 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:25.111039 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ad491-e9c1-4fba-b6f3-725472b8fa83 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:25.111503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ad491-e9c1-4fba-b6f3-725472b8fa83 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:25.112458 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ad491-e9c1-4fba-b6f3-725472b8fa83 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:25.114553 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ad491-e9c1-4fba-b6f3-725472b8fa83 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:25.166908 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 15/33] 10.222.0.81 () {60 vars in 1141 bytes} [Wed May 4 17:28:24 2022] POST /identity/v3/projects => generated 301 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:28:25.168560 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb9b37-351d-4431-832b-186f58e328b7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:25.342964 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb9b37-351d-4431-832b-186f58e328b7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:25.366659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 19/34] 10.222.0.81 () {60 vars in 1131 bytes} [Wed May 4 17:28:24 2022] POST /identity/v3/roles => generated 219 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:28:25.371563 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc1484-7682-451b-8340-27df59f27a5a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:25.373097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc1484-7682-451b-8340-27df59f27a5a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:25.373843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc1484-7682-451b-8340-27df59f27a5a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:25.377506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 20/35] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:25.386087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60053f0-7ba8-462e-84a5-719d4ca17394 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:25.388214 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60053f0-7ba8-462e-84a5-719d4ca17394 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:25.389536 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60053f0-7ba8-462e-84a5-719d4ca17394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:25.438450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d60053f0-7ba8-462e-84a5-719d4ca17394 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:25.441021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d60053f0-7ba8-462e-84a5-719d4ca17394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:25.444796 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949941f-4364-48fc-873d-d73e914e9ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:25.445872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949941f-4364-48fc-873d-d73e914e9ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:25.446348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949941f-4364-48fc-873d-d73e914e9ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:25.446817 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949941f-4364-48fc-873d-d73e914e9ea1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:25.449365 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949941f-4364-48fc-873d-d73e914e9ea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:25.451183 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949941f-4364-48fc-873d-d73e914e9ea1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:25.453558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 16/36] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:28:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:25.460062 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949941f-4364-48fc-873d-d73e914e9ea1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:25.600261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 21/37] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:25.657319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949941f-4364-48fc-873d-d73e914e9ea1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:25.659261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60053f0-7ba8-462e-84a5-719d4ca17394 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:25.711182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57a60d-3d17-46b2-86b8-2fce05e2caa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:25.712394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57a60d-3d17-46b2-86b8-2fce05e2caa0 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:25.712914 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57a60d-3d17-46b2-86b8-2fce05e2caa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:25.713399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57a60d-3d17-46b2-86b8-2fce05e2caa0 None admin] PATH_INFO: `/v3/domains/default/users/1d4d0e6c1c9344a380489ecebdd59a95/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:25.716162 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57a60d-3d17-46b2-86b8-2fce05e2caa0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1d4d0e6c1c9344a380489ecebdd59a95, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:25.718108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57a60d-3d17-46b2-86b8-2fce05e2caa0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:25.784087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60053f0-7ba8-462e-84a5-719d4ca17394 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:25.815246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 17/38] 10.222.0.81 () {58 vars in 1361 bytes} [Wed May 4 17:28:25 2022] PUT /identity/v3/domains/default/users/1d4d0e6c1c9344a380489ecebdd59a95/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:28:25.817745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65c5b4-87a8-4700-a047-a57458512d0a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:25.818153 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65c5b4-87a8-4700-a047-a57458512d0a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:25.818720 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65c5b4-87a8-4700-a047-a57458512d0a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:25.820494 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 18/39] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:25.826171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12fde9-24f6-4fc4-8b02-950329b4c957 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:25.826547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12fde9-24f6-4fc4-8b02-950329b4c957 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:25.826921 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12fde9-24f6-4fc4-8b02-950329b4c957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:25.828053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8868e7f-b30d-43ca-8dee-14dd7bbc076e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:25.829090 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8868e7f-b30d-43ca-8dee-14dd7bbc076e None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:25.829560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8868e7f-b30d-43ca-8dee-14dd7bbc076e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:25.829979 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8868e7f-b30d-43ca-8dee-14dd7bbc076e None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:25.830982 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8868e7f-b30d-43ca-8dee-14dd7bbc076e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:25.833145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8868e7f-b30d-43ca-8dee-14dd7bbc076e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:25.846898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fc12fde9-24f6-4fc4-8b02-950329b4c957 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:25.849005 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fc12fde9-24f6-4fc4-8b02-950329b4c957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:25.917278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 22/40] 10.222.0.81 () {60 vars in 1131 bytes} [Wed May 4 17:28:25 2022] POST /identity/v3/roles => generated 225 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:28:25.942764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 19/41] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:25.977432 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8868e7f-b30d-43ca-8dee-14dd7bbc076e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:26.096742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8868e7f-b30d-43ca-8dee-14dd7bbc076e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:26.135573 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24f273-2cce-4ba6-9b8d-648ced803bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:26.136387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24f273-2cce-4ba6-9b8d-648ced803bdd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:26.136710 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24f273-2cce-4ba6-9b8d-648ced803bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:26.136986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24f273-2cce-4ba6-9b8d-648ced803bdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:26.138203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24f273-2cce-4ba6-9b8d-648ced803bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:26.139676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24f273-2cce-4ba6-9b8d-648ced803bdd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:26.141353 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 23/42] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:28:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:26.147027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12fde9-24f6-4fc4-8b02-950329b4c957 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:26.202308 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da472f4-f0ea-41bc-9bb7-a6f6095861da None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:26.202627 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da472f4-f0ea-41bc-9bb7-a6f6095861da None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:26.202881 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da472f4-f0ea-41bc-9bb7-a6f6095861da None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:26.204381 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 24/43] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:28:26.209417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2265bb-7e76-41c1-8814-732616b06280 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:26.209710 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2265bb-7e76-41c1-8814-732616b06280 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:26.209992 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2265bb-7e76-41c1-8814-732616b06280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:26.226720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0a2265bb-7e76-41c1-8814-732616b06280 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:26.227956 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0a2265bb-7e76-41c1-8814-732616b06280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:26.254399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12fde9-24f6-4fc4-8b02-950329b4c957 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:26.290847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d88c4-e971-4b59-a3ab-eede36300f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:26.291514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d88c4-e971-4b59-a3ab-eede36300f1c None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:26.291817 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d88c4-e971-4b59-a3ab-eede36300f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:26.292085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d88c4-e971-4b59-a3ab-eede36300f1c None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:26.293814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d88c4-e971-4b59-a3ab-eede36300f1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:26.294816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d88c4-e971-4b59-a3ab-eede36300f1c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:26.298681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 25/44] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:26.321534 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2265bb-7e76-41c1-8814-732616b06280 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:26.387858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 20/45] 10.222.0.81 () {60 vars in 1141 bytes} [Wed May 4 17:28:26 2022] POST /identity/v3/projects => generated 312 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:28:26.423158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2265bb-7e76-41c1-8814-732616b06280 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:26.461207 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919574fc-d066-44a9-9c60-d545b3a67d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:26.461893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919574fc-d066-44a9-9c60-d545b3a67d7e None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:26.462177 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919574fc-d066-44a9-9c60-d545b3a67d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:26.462502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919574fc-d066-44a9-9c60-d545b3a67d7e None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:26.463265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919574fc-d066-44a9-9c60-d545b3a67d7e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:26.464714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919574fc-d066-44a9-9c60-d545b3a67d7e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:26.530674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 26/46] 10.222.0.81 () {60 vars in 1131 bytes} [Wed May 4 17:28:26 2022] POST /identity/v3/roles => generated 223 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:28:28.162737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee045a6a-dd1a-46e8-af01-0132c968713b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:28.163250 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee045a6a-dd1a-46e8-af01-0132c968713b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:28.163434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee045a6a-dd1a-46e8-af01-0132c968713b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:28.164812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 21/47] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:28.170109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e541e-77b6-42b9-8e12-48ba31528da2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:28.170517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e541e-77b6-42b9-8e12-48ba31528da2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:28.170677 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e541e-77b6-42b9-8e12-48ba31528da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:28.187716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-607e541e-77b6-42b9-8e12-48ba31528da2 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:28.189023 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-607e541e-77b6-42b9-8e12-48ba31528da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:28.253302 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 27/48] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:28.277257 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee045a6a-dd1a-46e8-af01-0132c968713b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:28.374778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee045a6a-dd1a-46e8-af01-0132c968713b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:28.407238 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34b974-df9b-4b73-b78e-a87d221f7a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:28.408025 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34b974-df9b-4b73-b78e-a87d221f7a73 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:28.408307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34b974-df9b-4b73-b78e-a87d221f7a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:28.408614 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34b974-df9b-4b73-b78e-a87d221f7a73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:28.420102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34b974-df9b-4b73-b78e-a87d221f7a73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:28.429585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-3d34b974-df9b-4b73-b78e-a87d221f7a73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:28:28.429585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:28.429585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:28.429585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:28.429585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:28.429585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:28.429585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:28.429585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:28.429585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:28.429585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:28.429585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:28.429585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:28.429585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:28.429585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:28.429585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:28.429585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:28.430401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:28.430401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:28.430401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:28.430401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:28.430401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:28.430401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:28.430401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:28.430401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:28.430401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:28.430401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:28.430401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:28.430401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:28.430401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:28.430401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:28.430401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:28.430401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:28.431142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:28.431142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:28.431142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:28.431142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:28.431142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:28.431142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:28.431142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:28.431142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:28.431142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:28.431142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:28.431142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:28:28.431142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:28.431142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 22/49] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:28:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:28.436576 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e541e-77b6-42b9-8e12-48ba31528da2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:28.534879 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e541e-77b6-42b9-8e12-48ba31528da2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:28.568195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a6f6e-848f-4ce8-921c-970ae45ca34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:28.568888 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a6f6e-848f-4ce8-921c-970ae45ca34d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:28.569167 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a6f6e-848f-4ce8-921c-970ae45ca34d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:28.569442 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a6f6e-848f-4ce8-921c-970ae45ca34d None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:28.570193 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a6f6e-848f-4ce8-921c-970ae45ca34d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:28.570497 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a6f6e-848f-4ce8-921c-970ae45ca34d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:28.571873 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a6f6e-848f-4ce8-921c-970ae45ca34d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:28.579707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 28/50] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:28.585997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34b974-df9b-4b73-b78e-a87d221f7a73 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:28.684051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34b974-df9b-4b73-b78e-a87d221f7a73 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:28.688177 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a18e8-0159-47fd-afdc-fcdd2846bdf4 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:28.688583 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a18e8-0159-47fd-afdc-fcdd2846bdf4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:28.688933 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a18e8-0159-47fd-afdc-fcdd2846bdf4 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:28.690316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 29/51] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:28:28.695152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acf5f6-4af6-458e-b021-578a0728f85b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:28.700280 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acf5f6-4af6-458e-b021-578a0728f85b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:28.700280 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acf5f6-4af6-458e-b021-578a0728f85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:28.713493 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-10acf5f6-4af6-458e-b021-578a0728f85b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:28.714664 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-10acf5f6-4af6-458e-b021-578a0728f85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:28.718107 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe3d6c-fb0c-43d5-9ffd-e3b81d7a20c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:28.718990 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe3d6c-fb0c-43d5-9ffd-e3b81d7a20c8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:28.719274 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe3d6c-fb0c-43d5-9ffd-e3b81d7a20c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:28.719553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe3d6c-fb0c-43d5-9ffd-e3b81d7a20c8 None admin] PATH_INFO: `/v3/users/1d4d0e6c1c9344a380489ecebdd59a95` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:28.720791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe3d6c-fb0c-43d5-9ffd-e3b81d7a20c8 None admin] RBAC: Authorizing `identity:get_user(user_id=1d4d0e6c1c9344a380489ecebdd59a95)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:28.722244 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe3d6c-fb0c-43d5-9ffd-e3b81d7a20c8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:28.724699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 23/52] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:28 2022] GET /identity/v3/users/1d4d0e6c1c9344a380489ecebdd59a95 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:28.729993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe3d6c-fb0c-43d5-9ffd-e3b81d7a20c8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:28.783742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 30/53] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:28:28.807413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acf5f6-4af6-458e-b021-578a0728f85b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:28.832173 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe3d6c-fb0c-43d5-9ffd-e3b81d7a20c8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:28.873061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60610271-aef8-4c87-be8a-cd80a8a46457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:28.873869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60610271-aef8-4c87-be8a-cd80a8a46457 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:28.874149 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60610271-aef8-4c87-be8a-cd80a8a46457 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:28.874423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60610271-aef8-4c87-be8a-cd80a8a46457 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:28.875754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60610271-aef8-4c87-be8a-cd80a8a46457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:28.877631 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60610271-aef8-4c87-be8a-cd80a8a46457 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:28.880156 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 24/54] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:28:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:28.886057 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60610271-aef8-4c87-be8a-cd80a8a46457 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:28.903993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acf5f6-4af6-458e-b021-578a0728f85b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:28.940605 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2a5cb-75e4-46ae-8960-701df55c82dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:28.941293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2a5cb-75e4-46ae-8960-701df55c82dd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:28.941643 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2a5cb-75e4-46ae-8960-701df55c82dd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:28.942550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2a5cb-75e4-46ae-8960-701df55c82dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:28.943757 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2a5cb-75e4-46ae-8960-701df55c82dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:28.945298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2a5cb-75e4-46ae-8960-701df55c82dd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:28.946924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 31/55] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:28:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:28.954007 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2a5cb-75e4-46ae-8960-701df55c82dd None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:28.994414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60610271-aef8-4c87-be8a-cd80a8a46457 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:29.028849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2a108-9ef9-4f91-a60c-d68a5c2a7576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:29.029709 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2a108-9ef9-4f91-a60c-d68a5c2a7576 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:29.030085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2a108-9ef9-4f91-a60c-d68a5c2a7576 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:29.030464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2a108-9ef9-4f91-a60c-d68a5c2a7576 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:29.031959 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2a108-9ef9-4f91-a60c-d68a5c2a7576 None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.domain.id=default, user.id=1d4d0e6c1c9344a380489ecebdd59a95) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:29.032532 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2a108-9ef9-4f91-a60c-d68a5c2a7576 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:29.034262 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2a108-9ef9-4f91-a60c-d68a5c2a7576 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:29.043042 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 25/56] 10.222.0.81 () {56 vars in 1322 bytes} [Wed May 4 17:28:28 2022] GET /identity/v3/role_assignments?user.id=1d4d0e6c1c9344a380489ecebdd59a95&scope.domain.id=default&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:29.062747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2a5cb-75e4-46ae-8960-701df55c82dd None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:29.099758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8369cb5-25e1-4204-b5ad-32554fd363c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:29.100470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8369cb5-25e1-4204-b5ad-32554fd363c0 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:29.100752 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8369cb5-25e1-4204-b5ad-32554fd363c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:29.101031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8369cb5-25e1-4204-b5ad-32554fd363c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:29.101769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8369cb5-25e1-4204-b5ad-32554fd363c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:29.103274 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8369cb5-25e1-4204-b5ad-32554fd363c0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:29.364910 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 32/57] 10.222.0.81 () {60 vars in 1140 bytes} [Wed May 4 17:28:28 2022] POST /identity/v3/projects => generated 298 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:28:31.623146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3606a-9419-42fb-b0b4-f74edda6ee92 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:31.623635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3606a-9419-42fb-b0b4-f74edda6ee92 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:31.623635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3606a-9419-42fb-b0b4-f74edda6ee92 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:31.625040 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 26/58] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:31.630499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcc92f-f683-4b15-bdfd-c01c3e5261fe None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:31.630905 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcc92f-f683-4b15-bdfd-c01c3e5261fe None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:31.631063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcc92f-f683-4b15-bdfd-c01c3e5261fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:31.647917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5dfcc92f-f683-4b15-bdfd-c01c3e5261fe None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:31.649124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5dfcc92f-f683-4b15-bdfd-c01c3e5261fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:31.713033 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 33/59] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:31.737561 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3606a-9419-42fb-b0b4-f74edda6ee92 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:31.834814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3606a-9419-42fb-b0b4-f74edda6ee92 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:31.866417 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a61b9-470b-4abc-ab29-2e567b389e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:31.867193 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a61b9-470b-4abc-ab29-2e567b389e8d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:31.867479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a61b9-470b-4abc-ab29-2e567b389e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:31.867755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a61b9-470b-4abc-ab29-2e567b389e8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:31.868953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a61b9-470b-4abc-ab29-2e567b389e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:31.870380 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a61b9-470b-4abc-ab29-2e567b389e8d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:31.871977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 27/60] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:28:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:31.878205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcc92f-f683-4b15-bdfd-c01c3e5261fe None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:31.972220 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcc92f-f683-4b15-bdfd-c01c3e5261fe None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:32.004148 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2f001-4ccf-4795-b175-35fa31ed782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:32.005410 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2f001-4ccf-4795-b175-35fa31ed782a None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:32.005719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2f001-4ccf-4795-b175-35fa31ed782a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:32.005999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2f001-4ccf-4795-b175-35fa31ed782a None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:32.006703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2f001-4ccf-4795-b175-35fa31ed782a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:32.008153 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2f001-4ccf-4795-b175-35fa31ed782a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:32.095426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 34/61] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:28:31 2022] POST /identity/v3/users => generated 275 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:28:35.498323 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25af054-9587-42f3-905b-55c604a295b1 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:35.499360 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25af054-9587-42f3-905b-55c604a295b1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:35.499849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25af054-9587-42f3-905b-55c604a295b1 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:35.501450 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 28/62] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:35.507642 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdb600-8f35-41ab-81ac-295884b4e572 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:35.508513 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdb600-8f35-41ab-81ac-295884b4e572 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:35.508988 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdb600-8f35-41ab-81ac-295884b4e572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:35.529555 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-dacdb600-8f35-41ab-81ac-295884b4e572 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:35.530832 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dacdb600-8f35-41ab-81ac-295884b4e572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:35.619572 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 35/63] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:35.621902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1360-d29e-47ca-aa27-54fdd93f027a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:35.622401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1360-d29e-47ca-aa27-54fdd93f027a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:35.622898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1360-d29e-47ca-aa27-54fdd93f027a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:35.624456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 29/64] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:35.630711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0429a-fca3-4ed6-9389-7af6107fed09 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:35.630999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0429a-fca3-4ed6-9389-7af6107fed09 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:35.631272 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0429a-fca3-4ed6-9389-7af6107fed09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:35.646251 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d1360-d29e-47ca-aa27-54fdd93f027a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:35.660277 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4be0429a-fca3-4ed6-9389-7af6107fed09 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:35.661865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4be0429a-fca3-4ed6-9389-7af6107fed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:35.796592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 36/65] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:35.797638 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d1360-d29e-47ca-aa27-54fdd93f027a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:35.820922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0429a-fca3-4ed6-9389-7af6107fed09 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:35.876164 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413df331-27db-4aad-aca1-db8e6db21abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:35.877704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413df331-27db-4aad-aca1-db8e6db21abb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:35.879049 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413df331-27db-4aad-aca1-db8e6db21abb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:35.880299 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413df331-27db-4aad-aca1-db8e6db21abb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:35.904462 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413df331-27db-4aad-aca1-db8e6db21abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:35.917384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-413df331-27db-4aad-aca1-db8e6db21abb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:28:35.917384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:35.917384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:35.917384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:35.917384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:35.917384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:35.917384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:35.917384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:35.917384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:35.917384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:35.917384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:35.917384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:35.917384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:35.917384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:35.917384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:35.917384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:35.918301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:35.918301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:35.918301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:35.918301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:35.918301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:35.918301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:35.918301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:35.918301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:35.918301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:35.918301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:35.918301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:35.918301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:35.918301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:35.918301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:35.918301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:35.918301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:35.919050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:35.919050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:35.919050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:35.919050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:35.919050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:35.919050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:35.919050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:35.919050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:35.919050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:35.919050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:35.919050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:28:35.919050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:35.921860 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 30/66] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:35.928909 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413df331-27db-4aad-aca1-db8e6db21abb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:35.971022 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0429a-fca3-4ed6-9389-7af6107fed09 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:36.014077 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7022ff2-7c8e-45f6-938f-1f10353d43c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:36.015169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7022ff2-7c8e-45f6-938f-1f10353d43c7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:36.015459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7022ff2-7c8e-45f6-938f-1f10353d43c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:36.015739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7022ff2-7c8e-45f6-938f-1f10353d43c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:36.044158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7022ff2-7c8e-45f6-938f-1f10353d43c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:36.056465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d7022ff2-7c8e-45f6-938f-1f10353d43c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:28:36.056465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:36.056465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:36.056465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:36.056465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:36.056465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:36.056465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:36.056465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:36.056465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:36.056465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:36.056465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:36.056465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:36.056465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:36.056465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:36.056465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:36.056465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:36.057345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:36.057345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:36.057345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:36.057345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:36.057345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:36.057345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:36.057345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:36.057345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:36.057345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:36.057345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:36.057345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:36.057345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:28:36.057345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:36.057345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:36.057345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:36.057345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:36.058073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:36.058073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:36.058073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:36.058073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:36.058073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:36.058073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:36.058073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:36.058073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:36.058073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:36.058073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:36.058073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:28:36.058073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:28:36.058073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 37/67] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:28:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:28:36.058073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927b9d-5069-46b6-89e2-59d09153077b None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:36.058733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927b9d-5069-46b6-89e2-59d09153077b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:36.058733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927b9d-5069-46b6-89e2-59d09153077b None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:36.058733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 38/68] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:36.061178 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43927b9d-5069-46b6-89e2-59d09153077b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:36.079298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413df331-27db-4aad-aca1-db8e6db21abb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:36.113838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04756e5-0fd3-4770-b7c7-1a70ff3d2bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:36.114808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04756e5-0fd3-4770-b7c7-1a70ff3d2bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:36.115086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04756e5-0fd3-4770-b7c7-1a70ff3d2bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:36.115371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04756e5-0fd3-4770-b7c7-1a70ff3d2bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:36.116134 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04756e5-0fd3-4770-b7c7-1a70ff3d2bb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:36.116463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04756e5-0fd3-4770-b7c7-1a70ff3d2bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:36.118013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04756e5-0fd3-4770-b7c7-1a70ff3d2bb6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:36.134655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 31/69] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:28:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:36.134655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce9764-e938-4d62-8527-9f18e1d66d8b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:36.134655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce9764-e938-4d62-8527-9f18e1d66d8b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:36.134655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce9764-e938-4d62-8527-9f18e1d66d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:36.149286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-43ce9764-e938-4d62-8527-9f18e1d66d8b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:36.150497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-43ce9764-e938-4d62-8527-9f18e1d66d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:36.169380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43927b9d-5069-46b6-89e2-59d09153077b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:36.200805 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3d16f-a506-4de3-ba30-b0aec55d6fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:36.201476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3d16f-a506-4de3-ba30-b0aec55d6fcd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:36.201761 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3d16f-a506-4de3-ba30-b0aec55d6fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:36.202039 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3d16f-a506-4de3-ba30-b0aec55d6fcd None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:36.202790 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3d16f-a506-4de3-ba30-b0aec55d6fcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:36.203099 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3d16f-a506-4de3-ba30-b0aec55d6fcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:36.204558 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3d16f-a506-4de3-ba30-b0aec55d6fcd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:36.213513 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 39/70] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:36.214824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fffc4a-002b-4f90-837a-82c229eb0d84 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:36.215119 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fffc4a-002b-4f90-837a-82c229eb0d84 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:36.215393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fffc4a-002b-4f90-837a-82c229eb0d84 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:36.216384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 32/71] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:36.217721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04314f-5fce-41e6-b4b6-5cab67464ab6 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:36.218499 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04314f-5fce-41e6-b4b6-5cab67464ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:36.218793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04314f-5fce-41e6-b4b6-5cab67464ab6 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:36.224699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 33/72] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:36.224699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04314f-5fce-41e6-b4b6-5cab67464ab6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:36.224890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 40/73] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:36.224890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fffc4a-002b-4f90-837a-82c229eb0d84 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:36.322483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fffc4a-002b-4f90-837a-82c229eb0d84 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:36.326276 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04314f-5fce-41e6-b4b6-5cab67464ab6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:36.357537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19824ce4-b83f-4c7d-89b7-c4a64eeb2d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:36.358413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19824ce4-b83f-4c7d-89b7-c4a64eeb2d98 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:36.358696 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19824ce4-b83f-4c7d-89b7-c4a64eeb2d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:36.358974 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19824ce4-b83f-4c7d-89b7-c4a64eeb2d98 None admin] PATH_INFO: `/v3/users/1d4d0e6c1c9344a380489ecebdd59a95` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:36.360143 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19824ce4-b83f-4c7d-89b7-c4a64eeb2d98 None admin] RBAC: Authorizing `identity:get_user(user_id=1d4d0e6c1c9344a380489ecebdd59a95)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:36.361503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d488b-023a-430d-88e8-2778edb4be6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:36.361638 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19824ce4-b83f-4c7d-89b7-c4a64eeb2d98 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:36.362374 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d488b-023a-430d-88e8-2778edb4be6d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:36.362665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d488b-023a-430d-88e8-2778edb4be6d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:36.362947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d488b-023a-430d-88e8-2778edb4be6d None admin] PATH_INFO: `/v3/users/9abe5470480046e6b6be3b0a0f16332b` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:36.363242 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 41/74] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:36 2022] GET /identity/v3/users/1d4d0e6c1c9344a380489ecebdd59a95 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:36.364654 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b4c94-17ff-4a2a-be35-99d668015b51 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:36.364947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b4c94-17ff-4a2a-be35-99d668015b51 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:36.365228 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b4c94-17ff-4a2a-be35-99d668015b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:36.378883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d488b-023a-430d-88e8-2778edb4be6d None admin] RBAC: Authorizing `identity:get_user(user_id=9abe5470480046e6b6be3b0a0f16332b)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:36.380336 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d488b-023a-430d-88e8-2778edb4be6d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:36.381334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b01b4c94-17ff-4a2a-be35-99d668015b51 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:36.382082 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 34/75] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:36 2022] GET /identity/v3/users/9abe5470480046e6b6be3b0a0f16332b => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:36.382508 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b01b4c94-17ff-4a2a-be35-99d668015b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:36.383348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf67f5-0df7-450a-8c4b-698bc3b2a516 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:36.383647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf67f5-0df7-450a-8c4b-698bc3b2a516 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:36.383932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf67f5-0df7-450a-8c4b-698bc3b2a516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:36.402057 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fecf67f5-0df7-450a-8c4b-698bc3b2a516 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:36.403197 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fecf67f5-0df7-450a-8c4b-698bc3b2a516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:36.445435 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 42/76] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:36.446283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b4c94-17ff-4a2a-be35-99d668015b51 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:36.466551 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 35/77] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:36.467723 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf67f5-0df7-450a-8c4b-698bc3b2a516 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:36.549413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b4c94-17ff-4a2a-be35-99d668015b51 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:36.563852 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf67f5-0df7-450a-8c4b-698bc3b2a516 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:36.582203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2351c-8321-4b23-8d82-e1a67fa1ef17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:36.583176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2351c-8321-4b23-8d82-e1a67fa1ef17 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:36.583465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2351c-8321-4b23-8d82-e1a67fa1ef17 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:36.583754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2351c-8321-4b23-8d82-e1a67fa1ef17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:36.584966 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2351c-8321-4b23-8d82-e1a67fa1ef17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:36.586484 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2351c-8321-4b23-8d82-e1a67fa1ef17 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:36.588229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 43/78] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:28:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:36.589308 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2351c-8321-4b23-8d82-e1a67fa1ef17 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:36.596787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a648ab-ab29-48e2-aa5c-e48695dcfae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:36.597447 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a648ab-ab29-48e2-aa5c-e48695dcfae3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:36.597736 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a648ab-ab29-48e2-aa5c-e48695dcfae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:36.598019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a648ab-ab29-48e2-aa5c-e48695dcfae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:36.662463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a648ab-ab29-48e2-aa5c-e48695dcfae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:36.663847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a648ab-ab29-48e2-aa5c-e48695dcfae3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:36.689854 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2351c-8321-4b23-8d82-e1a67fa1ef17 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:36.721835 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766dcc4d-54a1-494a-b8a4-04fa4b6d6d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:36.722481 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dcc4d-54a1-494a-b8a4-04fa4b6d6d8b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:36.722769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dcc4d-54a1-494a-b8a4-04fa4b6d6d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:36.723058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dcc4d-54a1-494a-b8a4-04fa4b6d6d8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:36.759832 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 36/79] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:28:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:28:36.760798 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a648ab-ab29-48e2-aa5c-e48695dcfae3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:36.789354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766dcc4d-54a1-494a-b8a4-04fa4b6d6d8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:36.790830 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766dcc4d-54a1-494a-b8a4-04fa4b6d6d8b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:36.861596 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a648ab-ab29-48e2-aa5c-e48695dcfae3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:36.893698 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 44/80] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:28:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:28:36.894640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766dcc4d-54a1-494a-b8a4-04fa4b6d6d8b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:36.900157 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609f39d-e7b0-43b0-9a34-a409c5094544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:36.901037 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609f39d-e7b0-43b0-9a34-a409c5094544 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:36.901365 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609f39d-e7b0-43b0-9a34-a409c5094544 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:36.901684 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609f39d-e7b0-43b0-9a34-a409c5094544 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:36.912909 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609f39d-e7b0-43b0-9a34-a409c5094544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:36.921102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d609f39d-e7b0-43b0-9a34-a409c5094544 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:28:36.921102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:36.921102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:36.921102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:36.921102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:36.921102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:36.921102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:36.921102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:36.921102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:36.921102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:36.921102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:36.921102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:36.921102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:36.921102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:36.921102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:36.921102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:36.922073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:36.922073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:36.922073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:36.922073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:36.922073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:36.922073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:36.922073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:36.922073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:36.922073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:36.922073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:36.922073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:36.922073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:36.922073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:36.922073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:36.922073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:36.922073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:36.922989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:36.922989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:36.922989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:36.922989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:36.922989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:36.922989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:36.922989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:36.922989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:36.922989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:36.922989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:36.922989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:28:36.922989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:36.922989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 37/81] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:28:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:36.923717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609f39d-e7b0-43b0-9a34-a409c5094544 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:36.992205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766dcc4d-54a1-494a-b8a4-04fa4b6d6d8b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:37.020219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609f39d-e7b0-43b0-9a34-a409c5094544 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:37.024686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64887d3a-a747-45da-b9a2-094c4dabb30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:37.025476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887d3a-a747-45da-b9a2-094c4dabb30c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:37.025762 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887d3a-a747-45da-b9a2-094c4dabb30c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:37.026038 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887d3a-a747-45da-b9a2-094c4dabb30c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:37.035829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64887d3a-a747-45da-b9a2-094c4dabb30c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:37.043562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-64887d3a-a747-45da-b9a2-094c4dabb30c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:28:37.043562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:37.043562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:37.043562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:37.043562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:37.043562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:37.043562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:37.043562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:37.043562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:37.043562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:37.043562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:37.043562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:37.043562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:37.043562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:37.043562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:37.043562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:37.044416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:37.044416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:37.044416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:37.044416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:37.044416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:37.044416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:37.044416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:37.044416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:37.044416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:37.044416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:37.044416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:37.044416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:28:37.044416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:37.044416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:37.044416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:37.044416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:37.050283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:37.050283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:37.050283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:37.050283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:37.050283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:37.050283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:37.050283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:37.050283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:37.050283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:37.050283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:37.050283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:28:37.050283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:28:37.050283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 45/82] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:37.050283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64887d3a-a747-45da-b9a2-094c4dabb30c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:37.054827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7a27c-510a-46f6-b0b7-d75b40b653c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:37.055505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a27c-510a-46f6-b0b7-d75b40b653c5 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:37.055797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a27c-510a-46f6-b0b7-d75b40b653c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:37.056083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a27c-510a-46f6-b0b7-d75b40b653c5 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:37.056838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7a27c-510a-46f6-b0b7-d75b40b653c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:37.058297 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7a27c-510a-46f6-b0b7-d75b40b653c5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:37.142807 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64887d3a-a747-45da-b9a2-094c4dabb30c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:37.152812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 38/83] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:28:36 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:28:37.153663 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7a27c-510a-46f6-b0b7-d75b40b653c5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:37.183309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a33b8-3e7f-4c76-9f3c-8350580fbaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:37.184203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a33b8-3e7f-4c76-9f3c-8350580fbaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:37.184682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a33b8-3e7f-4c76-9f3c-8350580fbaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:37.184781 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a33b8-3e7f-4c76-9f3c-8350580fbaf4 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:37.186052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a33b8-3e7f-4c76-9f3c-8350580fbaf4 None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:37.187580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a33b8-3e7f-4c76-9f3c-8350580fbaf4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:37.191689 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 46/84] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:37 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:37.193205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a33b8-3e7f-4c76-9f3c-8350580fbaf4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:37.300519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7a27c-510a-46f6-b0b7-d75b40b653c5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:37.311211 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a33b8-3e7f-4c76-9f3c-8350580fbaf4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:37.344916 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754dbdea-35f8-4bc1-923a-d24925542433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:37.345799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dbdea-35f8-4bc1-923a-d24925542433 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:37.346091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dbdea-35f8-4bc1-923a-d24925542433 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:37.346369 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dbdea-35f8-4bc1-923a-d24925542433 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:37.347630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754dbdea-35f8-4bc1-923a-d24925542433 None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:37.349687 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754dbdea-35f8-4bc1-923a-d24925542433 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:37.351438 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd64504-7797-4184-9297-2cf9b77a1768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:37.352118 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd64504-7797-4184-9297-2cf9b77a1768 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:37.352599 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 39/85] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:37 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:37.352712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd64504-7797-4184-9297-2cf9b77a1768 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:37.352712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd64504-7797-4184-9297-2cf9b77a1768 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:37.357575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754dbdea-35f8-4bc1-923a-d24925542433 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:37.357711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd64504-7797-4184-9297-2cf9b77a1768 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:37.357711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd64504-7797-4184-9297-2cf9b77a1768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:37.357711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd64504-7797-4184-9297-2cf9b77a1768 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:37.363849 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 47/86] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:28:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:37.365310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd64504-7797-4184-9297-2cf9b77a1768 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:37.488072 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754dbdea-35f8-4bc1-923a-d24925542433 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:37.547757 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd64504-7797-4184-9297-2cf9b77a1768 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:37.548981 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46443a5d-10a2-4927-8179-7b631c2f705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:37.549913 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46443a5d-10a2-4927-8179-7b631c2f705c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:37.550363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46443a5d-10a2-4927-8179-7b631c2f705c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:37.550821 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46443a5d-10a2-4927-8179-7b631c2f705c None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:37.552856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46443a5d-10a2-4927-8179-7b631c2f705c None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:37.553345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46443a5d-10a2-4927-8179-7b631c2f705c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:37.555012 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46443a5d-10a2-4927-8179-7b631c2f705c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:37.566440 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 40/87] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:28:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:37.567240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46443a5d-10a2-4927-8179-7b631c2f705c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:37.604464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b988b-4586-4a21-8ca6-ac97e01e8494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:37.604464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b988b-4586-4a21-8ca6-ac97e01e8494 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:37.604464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b988b-4586-4a21-8ca6-ac97e01e8494 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:37.604464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b988b-4586-4a21-8ca6-ac97e01e8494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:37.605129 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b988b-4586-4a21-8ca6-ac97e01e8494 None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=0c51097d14c64e869f8ce7b3df492b61, user.id=1d4d0e6c1c9344a380489ecebdd59a95) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:37.605129 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b988b-4586-4a21-8ca6-ac97e01e8494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:37.619763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b988b-4586-4a21-8ca6-ac97e01e8494 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:37.619763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 48/88] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:28:37 2022] GET /identity/v3/role_assignments?user.id=1d4d0e6c1c9344a380489ecebdd59a95&scope.project.id=0c51097d14c64e869f8ce7b3df492b61&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:37.619763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b988b-4586-4a21-8ca6-ac97e01e8494 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:37.795923 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b988b-4586-4a21-8ca6-ac97e01e8494 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:37.835523 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46443a5d-10a2-4927-8179-7b631c2f705c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:37.851206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7986498-da2a-4113-8117-bd100be7c6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:37.852492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7986498-da2a-4113-8117-bd100be7c6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:37.852944 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7986498-da2a-4113-8117-bd100be7c6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:37.853363 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7986498-da2a-4113-8117-bd100be7c6a1 None admin] PATH_INFO: `/v3/users/9abe5470480046e6b6be3b0a0f16332b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:37.855387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7986498-da2a-4113-8117-bd100be7c6a1 None admin] RBAC: Authorizing `identity:get_user(user_id=9abe5470480046e6b6be3b0a0f16332b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:37.858031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7986498-da2a-4113-8117-bd100be7c6a1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:37.860400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 49/89] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:37 2022] GET /identity/v3/users/9abe5470480046e6b6be3b0a0f16332b => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:37.861289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7986498-da2a-4113-8117-bd100be7c6a1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:37.881644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd8a46-a744-48bc-bfd4-ff33a94abb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:37.882328 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd8a46-a744-48bc-bfd4-ff33a94abb30 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:37.882622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd8a46-a744-48bc-bfd4-ff33a94abb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:37.882905 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd8a46-a744-48bc-bfd4-ff33a94abb30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:37.883813 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd8a46-a744-48bc-bfd4-ff33a94abb30 None admin] RBAC: Adding query filter params (role.id=42b0adbc87e347e18bd4412dc9e421c1, scope.project.id=0c51097d14c64e869f8ce7b3df492b61, user.id=9abe5470480046e6b6be3b0a0f16332b) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:37.884140 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd8a46-a744-48bc-bfd4-ff33a94abb30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:37.885684 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd8a46-a744-48bc-bfd4-ff33a94abb30 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:37.899423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 41/90] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:28:37 2022] GET /identity/v3/role_assignments?user.id=9abe5470480046e6b6be3b0a0f16332b&scope.project.id=0c51097d14c64e869f8ce7b3df492b61&role.id=42b0adbc87e347e18bd4412dc9e421c1 => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:37.900269 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd8a46-a744-48bc-bfd4-ff33a94abb30 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:37.971733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7986498-da2a-4113-8117-bd100be7c6a1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:38.008158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d256c72-3ff9-482d-84ea-170affc7def7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:38.009092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d256c72-3ff9-482d-84ea-170affc7def7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:38.009379 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d256c72-3ff9-482d-84ea-170affc7def7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:38.009661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d256c72-3ff9-482d-84ea-170affc7def7 None admin] PATH_INFO: `/v3/users/9abe5470480046e6b6be3b0a0f16332b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:38.010965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d256c72-3ff9-482d-84ea-170affc7def7 None admin] RBAC: Authorizing `identity:get_user(user_id=9abe5470480046e6b6be3b0a0f16332b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:38.012432 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d256c72-3ff9-482d-84ea-170affc7def7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:38.014345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 50/91] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:37 2022] GET /identity/v3/users/9abe5470480046e6b6be3b0a0f16332b => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:38.019563 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d256c72-3ff9-482d-84ea-170affc7def7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:38.068146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd8a46-a744-48bc-bfd4-ff33a94abb30 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:38.112591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f562a-ada5-4cc4-a591-16a9e1c26ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:38.113370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f562a-ada5-4cc4-a591-16a9e1c26ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:38.113610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f562a-ada5-4cc4-a591-16a9e1c26ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:38.113940 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f562a-ada5-4cc4-a591-16a9e1c26ba6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:38.127782 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d256c72-3ff9-482d-84ea-170affc7def7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:38.164863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3303da0-1efd-475c-9c4a-e0921f516b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:38.165642 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3303da0-1efd-475c-9c4a-e0921f516b2e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:38.166023 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3303da0-1efd-475c-9c4a-e0921f516b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:38.166344 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3303da0-1efd-475c-9c4a-e0921f516b2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:38.231411 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f562a-ada5-4cc4-a591-16a9e1c26ba6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:38.232954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f562a-ada5-4cc4-a591-16a9e1c26ba6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:38.259555 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3303da0-1efd-475c-9c4a-e0921f516b2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:38.261093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3303da0-1efd-475c-9c4a-e0921f516b2e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:38.403853 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 51/92] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:28:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:28:38.409367 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3303da0-1efd-475c-9c4a-e0921f516b2e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:38.410142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 42/93] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:28:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:28:38.416404 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f562a-ada5-4cc4-a591-16a9e1c26ba6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:38.512373 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3303da0-1efd-475c-9c4a-e0921f516b2e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:38.547722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2560080-2647-4671-81f3-bfe267e55fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:38.548890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2560080-2647-4671-81f3-bfe267e55fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:38.549338 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2560080-2647-4671-81f3-bfe267e55fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:38.549769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2560080-2647-4671-81f3-bfe267e55fe9 None admin] PATH_INFO: `/v3/projects/f6d49e39d159400898170828427162df` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:38.551225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2560080-2647-4671-81f3-bfe267e55fe9 None admin] RBAC: Authorizing `identity:get_project(project_id=f6d49e39d159400898170828427162df)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:38.553298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2560080-2647-4671-81f3-bfe267e55fe9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:38.555377 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 52/94] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:38 2022] GET /identity/v3/projects/f6d49e39d159400898170828427162df => generated 312 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:38.561237 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2560080-2647-4671-81f3-bfe267e55fe9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:38.563942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f562a-ada5-4cc4-a591-16a9e1c26ba6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:38.620924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1eb25-1509-48e2-baf5-c48294eb79a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:38.622527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1eb25-1509-48e2-baf5-c48294eb79a4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:38.622944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1eb25-1509-48e2-baf5-c48294eb79a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:38.623363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1eb25-1509-48e2-baf5-c48294eb79a4 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:38.624852 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1eb25-1509-48e2-baf5-c48294eb79a4 None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:38.626510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1eb25-1509-48e2-baf5-c48294eb79a4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:38.628961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 43/95] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:38 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:38.634853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1eb25-1509-48e2-baf5-c48294eb79a4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:38.666411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2560080-2647-4671-81f3-bfe267e55fe9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:38.702067 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437177d2-59e8-4529-be5d-000d29f35ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:38.703107 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437177d2-59e8-4529-be5d-000d29f35ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:38.703607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437177d2-59e8-4529-be5d-000d29f35ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:38.704083 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437177d2-59e8-4529-be5d-000d29f35ec5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:38.705163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437177d2-59e8-4529-be5d-000d29f35ec5 None admin] RBAC: Adding query filter params (role.id=42b0adbc87e347e18bd4412dc9e421c1, scope.project.id=f6d49e39d159400898170828427162df, user.id=9abe5470480046e6b6be3b0a0f16332b) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:38.705677 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437177d2-59e8-4529-be5d-000d29f35ec5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:38.707390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437177d2-59e8-4529-be5d-000d29f35ec5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:38.714384 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 53/96] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:28:38 2022] GET /identity/v3/role_assignments?user.id=9abe5470480046e6b6be3b0a0f16332b&scope.project.id=f6d49e39d159400898170828427162df&role.id=42b0adbc87e347e18bd4412dc9e421c1 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:38.792307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1eb25-1509-48e2-baf5-c48294eb79a4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:38.836361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b0be1-afd1-458a-851a-ca2739f2d850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:38.837312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b0be1-afd1-458a-851a-ca2739f2d850 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:38.837737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b0be1-afd1-458a-851a-ca2739f2d850 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:38.838181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b0be1-afd1-458a-851a-ca2739f2d850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:38.839175 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b0be1-afd1-458a-851a-ca2739f2d850 None admin] RBAC: Adding query filter params (role.id=8c1bc4243dcc46979dd8ca40186c0ca7, scope.project.id=0c51097d14c64e869f8ce7b3df492b61, user.id=9abe5470480046e6b6be3b0a0f16332b) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:38.839627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b0be1-afd1-458a-851a-ca2739f2d850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:38.841275 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b0be1-afd1-458a-851a-ca2739f2d850 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:38.855231 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 44/97] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:28:38 2022] GET /identity/v3/role_assignments?user.id=9abe5470480046e6b6be3b0a0f16332b&scope.project.id=0c51097d14c64e869f8ce7b3df492b61&role.id=8c1bc4243dcc46979dd8ca40186c0ca7 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:40.485930 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca7e04-83c0-4164-a3d3-2b8731b319d4 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:40.486961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca7e04-83c0-4164-a3d3-2b8731b319d4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:40.487454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca7e04-83c0-4164-a3d3-2b8731b319d4 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:40.490146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 54/98] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:40.495351 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd73f5a-ec2e-47d3-86eb-733ef86fd22c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:40.495830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd73f5a-ec2e-47d3-86eb-733ef86fd22c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:40.495901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd73f5a-ec2e-47d3-86eb-733ef86fd22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:40.525357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1bd73f5a-ec2e-47d3-86eb-733ef86fd22c None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:40.526552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1bd73f5a-ec2e-47d3-86eb-733ef86fd22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:40.611617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 45/99] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:40.647423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca7e04-83c0-4164-a3d3-2b8731b319d4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:40.785848 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398ccce-a1be-4fdb-bc90-718e558acabb None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:40.787137 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398ccce-a1be-4fdb-bc90-718e558acabb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:40.787613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398ccce-a1be-4fdb-bc90-718e558acabb None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:40.796593 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 46/100] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:40.796864 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca7e04-83c0-4164-a3d3-2b8731b319d4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:40.805938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f54148-861b-43be-aa3d-68e1cdba9072 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:40.806516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f54148-861b-43be-aa3d-68e1cdba9072 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:40.807014 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f54148-861b-43be-aa3d-68e1cdba9072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:40.832325 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71a85f-c90c-4f64-a66a-5e58d41fd31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:40.833927 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71a85f-c90c-4f64-a66a-5e58d41fd31a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:40.834340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71a85f-c90c-4f64-a66a-5e58d41fd31a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:40.834802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71a85f-c90c-4f64-a66a-5e58d41fd31a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:40.836177 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71a85f-c90c-4f64-a66a-5e58d41fd31a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:40.837845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71a85f-c90c-4f64-a66a-5e58d41fd31a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:40.839726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 55/101] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:28:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:40.845689 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-94f54148-861b-43be-aa3d-68e1cdba9072 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:40.845868 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71a85f-c90c-4f64-a66a-5e58d41fd31a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:40.847375 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-94f54148-861b-43be-aa3d-68e1cdba9072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:40.956644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 47/102] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:40.970755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71a85f-c90c-4f64-a66a-5e58d41fd31a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:40.991346 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f54148-861b-43be-aa3d-68e1cdba9072 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:41.019018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687fe00-1bcc-473c-9ca5-aece25789e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:41.019743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687fe00-1bcc-473c-9ca5-aece25789e8b None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:41.020028 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687fe00-1bcc-473c-9ca5-aece25789e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:41.020301 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687fe00-1bcc-473c-9ca5-aece25789e8b None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:41.021920 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687fe00-1bcc-473c-9ca5-aece25789e8b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:41.023464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687fe00-1bcc-473c-9ca5-aece25789e8b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:41.104319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f54148-861b-43be-aa3d-68e1cdba9072 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:41.139720 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f3d9f-a1be-419b-9fc2-57883e3e01b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:41.140925 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f3d9f-a1be-419b-9fc2-57883e3e01b2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:41.141479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f3d9f-a1be-419b-9fc2-57883e3e01b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:41.141980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f3d9f-a1be-419b-9fc2-57883e3e01b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:41.153101 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f3d9f-a1be-419b-9fc2-57883e3e01b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:41.158057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 56/103] 10.222.0.81 () {60 vars in 1141 bytes} [Wed May 4 17:28:40 2022] POST /identity/v3/projects => generated 302 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:28:41.159686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd826beb-1465-46c3-8e13-832c5bd6ac6d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:41.160198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd826beb-1465-46c3-8e13-832c5bd6ac6d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:41.160777 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd826beb-1465-46c3-8e13-832c5bd6ac6d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:41.162116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0d0f3d9f-a1be-419b-9fc2-57883e3e01b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:28:41.162116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:41.162116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:41.162116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:41.162116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:41.162116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:41.162116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:41.162116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:41.162116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:41.162116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:41.162116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:41.162116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:41.162116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:41.162116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:41.162116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:41.162116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:41.162956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:41.162956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:41.162956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:41.162956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:41.162956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:41.162956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:41.162956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:41.162956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:41.162956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:41.162956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:41.162956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:41.162956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:41.162956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:41.162956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:41.162956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:41.162956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:41.163985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:41.163985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:41.163985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:41.163985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:41.163985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:41.163985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:41.163985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:41.163985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:41.163985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:41.163985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:41.163985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:28:41.163985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:41.164569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 57/104] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:41.166111 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 48/105] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:41.169009 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cb570-9e14-4aa5-91a4-32c0aa862406 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:41.169506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cb570-9e14-4aa5-91a4-32c0aa862406 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:41.169918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cb570-9e14-4aa5-91a4-32c0aa862406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:41.172651 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f3d9f-a1be-419b-9fc2-57883e3e01b2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:41.209427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1b4cb570-9e14-4aa5-91a4-32c0aa862406 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:41.210905 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1b4cb570-9e14-4aa5-91a4-32c0aa862406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:41.326004 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f3d9f-a1be-419b-9fc2-57883e3e01b2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:41.368876 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49810b7a-dcb0-4f77-9a4f-3f853e841fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:41.369814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49810b7a-dcb0-4f77-9a4f-3f853e841fbf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:41.370277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49810b7a-dcb0-4f77-9a4f-3f853e841fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:41.370695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49810b7a-dcb0-4f77-9a4f-3f853e841fbf None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:41.371623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49810b7a-dcb0-4f77-9a4f-3f853e841fbf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:41.372083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49810b7a-dcb0-4f77-9a4f-3f853e841fbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:41.373720 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49810b7a-dcb0-4f77-9a4f-3f853e841fbf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:41.383342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 49/106] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:28:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:41.390169 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49810b7a-dcb0-4f77-9a4f-3f853e841fbf None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:41.399434 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 58/107] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:28:41.434852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cb570-9e14-4aa5-91a4-32c0aa862406 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:41.502147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49810b7a-dcb0-4f77-9a4f-3f853e841fbf None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:41.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb72b1-e293-4628-a0ca-1cd72eaf0a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:41.540461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb72b1-e293-4628-a0ca-1cd72eaf0a13 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:41.540461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb72b1-e293-4628-a0ca-1cd72eaf0a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:41.540461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb72b1-e293-4628-a0ca-1cd72eaf0a13 None admin] PATH_INFO: `/v3/users/28586ae1e93e4b6d9450ab3180b06fc5` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:41.552099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb72b1-e293-4628-a0ca-1cd72eaf0a13 None admin] RBAC: Authorizing `identity:get_user(user_id=28586ae1e93e4b6d9450ab3180b06fc5)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:41.553854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb72b1-e293-4628-a0ca-1cd72eaf0a13 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:41.555573 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 50/108] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:41 2022] GET /identity/v3/users/28586ae1e93e4b6d9450ab3180b06fc5 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:41.563360 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb72b1-e293-4628-a0ca-1cd72eaf0a13 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:41.644289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cb570-9e14-4aa5-91a4-32c0aa862406 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:41.685921 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a38aac-70b9-48b2-b12c-0335d36488bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:41.687052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a38aac-70b9-48b2-b12c-0335d36488bf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:41.687480 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a38aac-70b9-48b2-b12c-0335d36488bf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:41.687908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a38aac-70b9-48b2-b12c-0335d36488bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:41.704282 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a38aac-70b9-48b2-b12c-0335d36488bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:41.712884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f7a38aac-70b9-48b2-b12c-0335d36488bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:28:41.712884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:41.712884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:41.712884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:41.712884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:41.712884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:41.712884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:41.712884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:41.712884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:41.712884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:41.712884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:41.712884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:41.712884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:41.712884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:41.712884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:41.712884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:41.713943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:41.713943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:41.713943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:41.713943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:41.713943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:41.713943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:41.713943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:41.713943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:41.713943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:41.713943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:41.713943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:41.713943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:28:41.713943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:41.713943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:41.713943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:41.713943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:41.714813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:41.714813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:41.714813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:41.714813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:41.714813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:41.714813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:41.714813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:41.714813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:41.714813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:41.714813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:41.714813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:28:41.714813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:28:41.717021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 59/109] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:28:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:28:41.717301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb72b1-e293-4628-a0ca-1cd72eaf0a13 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:41.718587 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66956a-e54d-4099-9cb4-84f8e8c5d4dd None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:41.719029 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66956a-e54d-4099-9cb4-84f8e8c5d4dd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:41.719442 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66956a-e54d-4099-9cb4-84f8e8c5d4dd None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:41.725015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 60/110] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:41.726870 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66956a-e54d-4099-9cb4-84f8e8c5d4dd None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:41.762171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a683-07c5-4e7e-9a42-25d1553a0a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:41.762798 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a683-07c5-4e7e-9a42-25d1553a0a3f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:41.763089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a683-07c5-4e7e-9a42-25d1553a0a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:41.763366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a683-07c5-4e7e-9a42-25d1553a0a3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:41.863404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66956a-e54d-4099-9cb4-84f8e8c5d4dd None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:41.902433 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a683-07c5-4e7e-9a42-25d1553a0a3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:41.904500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a683-07c5-4e7e-9a42-25d1553a0a3f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:41.955301 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aef72e-0f87-45ca-8713-56afd874a371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:41.956374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aef72e-0f87-45ca-8713-56afd874a371 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:41.956883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aef72e-0f87-45ca-8713-56afd874a371 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:41.957366 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aef72e-0f87-45ca-8713-56afd874a371 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:41.958516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aef72e-0f87-45ca-8713-56afd874a371 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:41.959223 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aef72e-0f87-45ca-8713-56afd874a371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:41.960855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aef72e-0f87-45ca-8713-56afd874a371 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:41.980139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 61/111] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:41.981953 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e0608-e679-47f7-8410-b856617c42ef None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:41.982443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e0608-e679-47f7-8410-b856617c42ef None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:41.982912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e0608-e679-47f7-8410-b856617c42ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:42.014327 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 51/112] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:28:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:28:42.015272 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a683-07c5-4e7e-9a42-25d1553a0a3f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:42.025470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1c0e0608-e679-47f7-8410-b856617c42ef None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:42.026959 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1c0e0608-e679-47f7-8410-b856617c42ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:42.140204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 62/113] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:42.141214 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e0608-e679-47f7-8410-b856617c42ef None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:42.167410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a683-07c5-4e7e-9a42-25d1553a0a3f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:42.211657 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f28b42-bbf6-4a28-a5bc-07a03adb3df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:42.212889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f28b42-bbf6-4a28-a5bc-07a03adb3df4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:42.213176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f28b42-bbf6-4a28-a5bc-07a03adb3df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:42.213662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f28b42-bbf6-4a28-a5bc-07a03adb3df4 None admin] PATH_INFO: `/v3/users/1d4d0e6c1c9344a380489ecebdd59a95` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:42.215578 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f28b42-bbf6-4a28-a5bc-07a03adb3df4 None admin] RBAC: Authorizing `identity:get_user(user_id=1d4d0e6c1c9344a380489ecebdd59a95)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:42.217147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f28b42-bbf6-4a28-a5bc-07a03adb3df4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:42.220125 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 52/114] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:42 2022] GET /identity/v3/users/1d4d0e6c1c9344a380489ecebdd59a95 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:42.221932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb34df-de4e-4a58-8cb0-0ebbe677a519 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:42.223094 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb34df-de4e-4a58-8cb0-0ebbe677a519 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:42.223385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb34df-de4e-4a58-8cb0-0ebbe677a519 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:42.230360 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 53/115] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:42.231308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb34df-de4e-4a58-8cb0-0ebbe677a519 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:42.265607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e0608-e679-47f7-8410-b856617c42ef None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:42.303371 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65551f-49a0-485b-ba1b-5bfcc6e28e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:42.304313 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65551f-49a0-485b-ba1b-5bfcc6e28e8f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:42.304638 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65551f-49a0-485b-ba1b-5bfcc6e28e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:42.304924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65551f-49a0-485b-ba1b-5bfcc6e28e8f None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:42.306153 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65551f-49a0-485b-ba1b-5bfcc6e28e8f None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:42.307636 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65551f-49a0-485b-ba1b-5bfcc6e28e8f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:42.309356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 63/116] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:42 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:42.313251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65551f-49a0-485b-ba1b-5bfcc6e28e8f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:42.346801 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb34df-de4e-4a58-8cb0-0ebbe677a519 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:42.382502 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a023c6-b154-43ce-b713-c41c82ff74b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:42.383404 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a023c6-b154-43ce-b713-c41c82ff74b2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:42.383698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a023c6-b154-43ce-b713-c41c82ff74b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:42.384024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a023c6-b154-43ce-b713-c41c82ff74b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:42.394318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a023c6-b154-43ce-b713-c41c82ff74b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:42.402516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a7a023c6-b154-43ce-b713-c41c82ff74b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:28:42.402516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:42.402516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:42.402516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:42.402516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:42.402516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:42.402516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:42.402516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:42.402516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:42.402516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:42.402516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:42.402516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:42.402516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:42.402516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:42.402516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:42.402516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:42.403384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:42.403384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:42.403384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:42.403384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:42.403384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:42.403384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:42.403384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:42.403384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:42.403384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:42.403384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:42.403384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:42.403384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:42.403384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:42.403384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:42.403384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:42.403384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:42.409295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:42.409295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:42.409295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:42.409295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:42.409295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:42.409295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:42.409295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:42.409295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:42.409295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:42.409295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:42.409295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:28:42.409295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:42.409295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 54/117] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:42.409295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c78ce-dd17-49f4-b977-512e976b2e13 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:42.410106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c78ce-dd17-49f4-b977-512e976b2e13 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:42.410106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c78ce-dd17-49f4-b977-512e976b2e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:42.423660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8f6c78ce-dd17-49f4-b977-512e976b2e13 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:42.424919 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8f6c78ce-dd17-49f4-b977-512e976b2e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:42.431692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65551f-49a0-485b-ba1b-5bfcc6e28e8f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:42.466172 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdb898-32d0-44d6-8c46-35563e6a41bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:42.467032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdb898-32d0-44d6-8c46-35563e6a41bd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:42.467311 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdb898-32d0-44d6-8c46-35563e6a41bd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:42.467584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdb898-32d0-44d6-8c46-35563e6a41bd None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:42.468853 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdb898-32d0-44d6-8c46-35563e6a41bd None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:42.470306 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdb898-32d0-44d6-8c46-35563e6a41bd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:42.476469 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 64/118] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:42 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:42.476469 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb28ad2-ebe2-4097-96b3-d5b76227dbec None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:42.476469 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb28ad2-ebe2-4097-96b3-d5b76227dbec None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:42.476469 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb28ad2-ebe2-4097-96b3-d5b76227dbec None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:42.476469 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 65/119] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:42.480804 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb28ad2-ebe2-4097-96b3-d5b76227dbec None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:42.508477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 55/120] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:42.508477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c78ce-dd17-49f4-b977-512e976b2e13 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:42.590063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb28ad2-ebe2-4097-96b3-d5b76227dbec None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:42.630089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c78ce-dd17-49f4-b977-512e976b2e13 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:42.634950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e586-364a-47e7-9236-071614c9dcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:42.635661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e586-364a-47e7-9236-071614c9dcdb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:42.635969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e586-364a-47e7-9236-071614c9dcdb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:42.636265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e586-364a-47e7-9236-071614c9dcdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:42.637164 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176e586-364a-47e7-9236-071614c9dcdb None admin] RBAC: Adding query filter params (role.id=14898ff2d2954978a29cb0b4cb85ba7e, scope.project.id=0c51097d14c64e869f8ce7b3df492b61, user.id=28586ae1e93e4b6d9450ab3180b06fc5) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:42.637502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176e586-364a-47e7-9236-071614c9dcdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:42.639149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176e586-364a-47e7-9236-071614c9dcdb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:42.656482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 66/121] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:28:42 2022] GET /identity/v3/role_assignments?user.id=28586ae1e93e4b6d9450ab3180b06fc5&scope.project.id=0c51097d14c64e869f8ce7b3df492b61&role.id=14898ff2d2954978a29cb0b4cb85ba7e => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:42.656482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e586-364a-47e7-9236-071614c9dcdb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:42.683940 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191cf7c-e4cb-4453-ad2e-885c1b3c5936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:42.684918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191cf7c-e4cb-4453-ad2e-885c1b3c5936 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:42.685310 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191cf7c-e4cb-4453-ad2e-885c1b3c5936 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:42.685747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191cf7c-e4cb-4453-ad2e-885c1b3c5936 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:42.686660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191cf7c-e4cb-4453-ad2e-885c1b3c5936 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:42.687080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191cf7c-e4cb-4453-ad2e-885c1b3c5936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:42.688709 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191cf7c-e4cb-4453-ad2e-885c1b3c5936 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:42.698863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 56/122] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:28:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:42.700492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6c951-1572-4a42-92bf-2697c8d91ea9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:42.700887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6c951-1572-4a42-92bf-2697c8d91ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:42.701265 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6c951-1572-4a42-92bf-2697c8d91ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:42.718736 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4bf6c951-1572-4a42-92bf-2697c8d91ea9 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:42.720123 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4bf6c951-1572-4a42-92bf-2697c8d91ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:42.757176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e586-364a-47e7-9236-071614c9dcdb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:42.795356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5e106-be4c-4dff-9dea-a3ef17f5e741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:42.796337 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5e106-be4c-4dff-9dea-a3ef17f5e741 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:42.796605 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5e106-be4c-4dff-9dea-a3ef17f5e741 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:42.796888 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5e106-be4c-4dff-9dea-a3ef17f5e741 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61/users/1d4d0e6c1c9344a380489ecebdd59a95/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:42.799099 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5e106-be4c-4dff-9dea-a3ef17f5e741 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c51097d14c64e869f8ce7b3df492b61, user_id=1d4d0e6c1c9344a380489ecebdd59a95, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:42.800662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5e106-be4c-4dff-9dea-a3ef17f5e741 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:42.801509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 57/123] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:42.803548 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6c951-1572-4a42-92bf-2697c8d91ea9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:42.884211 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 67/124] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:28:42 2022] PUT /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61/users/1d4d0e6c1c9344a380489ecebdd59a95/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:28:42.885005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5e106-be4c-4dff-9dea-a3ef17f5e741 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:42.957282 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6c951-1572-4a42-92bf-2697c8d91ea9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:43.045135 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5e106-be4c-4dff-9dea-a3ef17f5e741 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:43.045326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d313cf-57c5-47cb-afa7-d94581b69dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:43.046045 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d313cf-57c5-47cb-afa7-d94581b69dcd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:43.046338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d313cf-57c5-47cb-afa7-d94581b69dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:43.046625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d313cf-57c5-47cb-afa7-d94581b69dcd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:43.077478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d313cf-57c5-47cb-afa7-d94581b69dcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:43.086126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-58d313cf-57c5-47cb-afa7-d94581b69dcd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:28:43.086126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:43.086126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:43.086126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:43.086126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:43.086126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:43.086126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:43.086126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:43.086126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:43.086126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:43.086126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:43.086126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:43.086126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:43.086126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:43.086126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:43.086126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:43.087024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:43.087024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:43.087024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:43.087024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:43.087024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:43.087024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:43.087024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:43.087024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:43.087024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:43.087024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:43.087024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:43.087024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:43.087024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:43.087024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:43.087024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:43.087024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:43.088218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:43.088218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:43.088218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:43.088218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:43.088218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:43.088218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:43.088218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:43.088218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:43.088218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:43.088218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:43.088218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:28:43.088218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:43.088218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 58/125] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:43.088218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d313cf-57c5-47cb-afa7-d94581b69dcd None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:43.103807 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd5c5b-a0b2-441b-a441-53b8ca6dfe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:43.105097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd5c5b-a0b2-441b-a441-53b8ca6dfe80 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:43.105584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd5c5b-a0b2-441b-a441-53b8ca6dfe80 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:43.106059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd5c5b-a0b2-441b-a441-53b8ca6dfe80 None admin] PATH_INFO: `/v3/users/9abe5470480046e6b6be3b0a0f16332b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:43.107990 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd5c5b-a0b2-441b-a441-53b8ca6dfe80 None admin] RBAC: Authorizing `identity:get_user(user_id=9abe5470480046e6b6be3b0a0f16332b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:43.109801 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd5c5b-a0b2-441b-a441-53b8ca6dfe80 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:43.113860 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 68/126] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:42 2022] GET /identity/v3/users/9abe5470480046e6b6be3b0a0f16332b => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:43.116144 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd5c5b-a0b2-441b-a441-53b8ca6dfe80 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:43.256381 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d313cf-57c5-47cb-afa7-d94581b69dcd None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:43.270566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd5c5b-a0b2-441b-a441-53b8ca6dfe80 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:43.318374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28bee88-7f1f-4542-979d-6cc01ae922f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:43.321673 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bee88-7f1f-4542-979d-6cc01ae922f9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:43.322512 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb3d66-b4af-4f60-81e3-c0f42d3443ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:43.323044 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bee88-7f1f-4542-979d-6cc01ae922f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:43.323544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bee88-7f1f-4542-979d-6cc01ae922f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:43.324584 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb3d66-b4af-4f60-81e3-c0f42d3443ec None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:43.325678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28bee88-7f1f-4542-979d-6cc01ae922f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:43.326236 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb3d66-b4af-4f60-81e3-c0f42d3443ec None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:43.326747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28bee88-7f1f-4542-979d-6cc01ae922f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:43.327234 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb3d66-b4af-4f60-81e3-c0f42d3443ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:43.328870 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28bee88-7f1f-4542-979d-6cc01ae922f9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:43.348710 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 69/127] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:28:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:43.349608 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28bee88-7f1f-4542-979d-6cc01ae922f9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:43.351258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb3d66-b4af-4f60-81e3-c0f42d3443ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:43.369361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-3fdb3d66-b4af-4f60-81e3-c0f42d3443ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:28:43.369361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:43.369361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:43.369361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:43.369361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:43.369361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:43.369361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:43.369361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:43.369361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:43.369361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:43.369361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:43.369361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:43.369361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:43.369361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:43.369361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:43.369361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:43.370246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:43.370246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:43.370246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:43.370246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:43.370246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:43.370246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:43.370246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:43.370246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:43.370246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:43.370246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:43.370246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:43.370246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:43.370246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:43.370246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:43.370246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:43.370246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:43.370973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:43.370973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:43.370973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:43.370973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:43.370973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:43.370973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:43.370973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:43.370973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:43.370973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:43.370973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:43.370973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:28:43.370973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:43.370973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 59/128] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:28:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:43.373856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb3d66-b4af-4f60-81e3-c0f42d3443ec None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:43.524795 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28bee88-7f1f-4542-979d-6cc01ae922f9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:43.538835 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb3d66-b4af-4f60-81e3-c0f42d3443ec None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:43.561180 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5de392-0279-422f-a0be-2889bfdb441e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:43.562047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5de392-0279-422f-a0be-2889bfdb441e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:43.562335 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5de392-0279-422f-a0be-2889bfdb441e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:43.562616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5de392-0279-422f-a0be-2889bfdb441e None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:43.563823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5de392-0279-422f-a0be-2889bfdb441e None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:43.565471 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5de392-0279-422f-a0be-2889bfdb441e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:43.572546 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 70/129] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:43 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:43.572546 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5de392-0279-422f-a0be-2889bfdb441e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:43.589200 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4e81d-b450-4f93-9e27-88301e5a1c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:43.590429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4e81d-b450-4f93-9e27-88301e5a1c2a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:43.590930 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4e81d-b450-4f93-9e27-88301e5a1c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:43.591412 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4e81d-b450-4f93-9e27-88301e5a1c2a None admin] PATH_INFO: `/v3/users/9abe5470480046e6b6be3b0a0f16332b` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:43.597323 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4e81d-b450-4f93-9e27-88301e5a1c2a None admin] RBAC: Authorizing `identity:get_user(user_id=9abe5470480046e6b6be3b0a0f16332b)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:43.599711 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4e81d-b450-4f93-9e27-88301e5a1c2a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:43.601799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 60/130] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:43 2022] GET /identity/v3/users/9abe5470480046e6b6be3b0a0f16332b => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:43.602700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4e81d-b450-4f93-9e27-88301e5a1c2a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:43.673562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5de392-0279-422f-a0be-2889bfdb441e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:43.709507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93346366-73d4-4ca3-a773-45b6be42d617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:43.710181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93346366-73d4-4ca3-a773-45b6be42d617 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:43.710466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93346366-73d4-4ca3-a773-45b6be42d617 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:43.710750 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93346366-73d4-4ca3-a773-45b6be42d617 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:43.711577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93346366-73d4-4ca3-a773-45b6be42d617 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:43.711892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93346366-73d4-4ca3-a773-45b6be42d617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:43.720587 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93346366-73d4-4ca3-a773-45b6be42d617 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:43.721741 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 71/131] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:28:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:43.722699 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93346366-73d4-4ca3-a773-45b6be42d617 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:43.787386 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4e81d-b450-4f93-9e27-88301e5a1c2a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:43.824173 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93346366-73d4-4ca3-a773-45b6be42d617 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:43.845108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728802aa-2ab7-4382-8faa-e9b5c5178725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:43.846517 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728802aa-2ab7-4382-8faa-e9b5c5178725 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:43.847697 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728802aa-2ab7-4382-8faa-e9b5c5178725 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:43.848328 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728802aa-2ab7-4382-8faa-e9b5c5178725 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61/users/9abe5470480046e6b6be3b0a0f16332b/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:43.852681 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728802aa-2ab7-4382-8faa-e9b5c5178725 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c51097d14c64e869f8ce7b3df492b61, user_id=9abe5470480046e6b6be3b0a0f16332b, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:43.855129 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728802aa-2ab7-4382-8faa-e9b5c5178725 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:43.880173 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd39b3c-a4ad-4482-b740-22cb03dbf5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:43.881501 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd39b3c-a4ad-4482-b740-22cb03dbf5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:43.881990 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd39b3c-a4ad-4482-b740-22cb03dbf5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:43.882454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd39b3c-a4ad-4482-b740-22cb03dbf5a3 None admin] PATH_INFO: `/v3/projects/f6d49e39d159400898170828427162df` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:43.884076 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd39b3c-a4ad-4482-b740-22cb03dbf5a3 None admin] RBAC: Authorizing `identity:get_project(project_id=f6d49e39d159400898170828427162df)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:43.885889 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd39b3c-a4ad-4482-b740-22cb03dbf5a3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:43.887796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 72/132] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:43 2022] GET /identity/v3/projects/f6d49e39d159400898170828427162df => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:43.888855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd39b3c-a4ad-4482-b740-22cb03dbf5a3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:43.964026 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 61/133] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:28:43 2022] PUT /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61/users/9abe5470480046e6b6be3b0a0f16332b/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:28:43.965242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728802aa-2ab7-4382-8faa-e9b5c5178725 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:44.028665 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd39b3c-a4ad-4482-b740-22cb03dbf5a3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:44.103295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06582d1a-0198-4d25-98fe-d897ddc95450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:44.103295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06582d1a-0198-4d25-98fe-d897ddc95450 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:44.103295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06582d1a-0198-4d25-98fe-d897ddc95450 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:44.103295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06582d1a-0198-4d25-98fe-d897ddc95450 None admin] PATH_INFO: `/v3/users/9abe5470480046e6b6be3b0a0f16332b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:44.106710 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06582d1a-0198-4d25-98fe-d897ddc95450 None admin] RBAC: Authorizing `identity:get_user(user_id=9abe5470480046e6b6be3b0a0f16332b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:44.108388 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06582d1a-0198-4d25-98fe-d897ddc95450 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:44.111222 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 73/134] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:43 2022] GET /identity/v3/users/9abe5470480046e6b6be3b0a0f16332b => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:44.116178 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06582d1a-0198-4d25-98fe-d897ddc95450 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:44.222511 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728802aa-2ab7-4382-8faa-e9b5c5178725 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:44.258674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06582d1a-0198-4d25-98fe-d897ddc95450 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:44.301413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb431c-f3f3-4040-a700-df81879df1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:44.302373 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb431c-f3f3-4040-a700-df81879df1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:44.302629 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb431c-f3f3-4040-a700-df81879df1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:44.302908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb431c-f3f3-4040-a700-df81879df1c3 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:44.308182 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb431c-f3f3-4040-a700-df81879df1c3 None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:44.308182 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb431c-f3f3-4040-a700-df81879df1c3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:44.308182 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 74/135] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:44 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:44.314338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba998cd-b089-4980-9c92-4d0256cd95a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:44.315253 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba998cd-b089-4980-9c92-4d0256cd95a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:44.315536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba998cd-b089-4980-9c92-4d0256cd95a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:44.315814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba998cd-b089-4980-9c92-4d0256cd95a8 None admin] PATH_INFO: `/v3/projects/f6d49e39d159400898170828427162df/users/9abe5470480046e6b6be3b0a0f16332b/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:44.318174 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb431c-f3f3-4040-a700-df81879df1c3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:44.318548 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba998cd-b089-4980-9c92-4d0256cd95a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6d49e39d159400898170828427162df, user_id=9abe5470480046e6b6be3b0a0f16332b, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:44.320069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba998cd-b089-4980-9c92-4d0256cd95a8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:44.411152 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 62/136] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:28:43 2022] PUT /identity/v3/projects/f6d49e39d159400898170828427162df/users/9abe5470480046e6b6be3b0a0f16332b/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:28:44.412466 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ceafd-4275-4371-93d1-2cb468392e4b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:44.412822 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ceafd-4275-4371-93d1-2cb468392e4b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:44.413109 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ceafd-4275-4371-93d1-2cb468392e4b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:44.414438 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 63/137] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:44.421439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d01e57-d979-4c99-88ca-019341523b63 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:44.421735 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d01e57-d979-4c99-88ca-019341523b63 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:44.422019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d01e57-d979-4c99-88ca-019341523b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:44.460227 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a5d01e57-d979-4c99-88ca-019341523b63 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:44.461520 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a5d01e57-d979-4c99-88ca-019341523b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:44.476827 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb431c-f3f3-4040-a700-df81879df1c3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:44.537334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ac2f6-def2-467a-a3ec-053949d28568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:44.538266 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ac2f6-def2-467a-a3ec-053949d28568 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:44.538550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ac2f6-def2-467a-a3ec-053949d28568 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:44.538831 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ac2f6-def2-467a-a3ec-053949d28568 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61/users/9abe5470480046e6b6be3b0a0f16332b/roles/8c1bc4243dcc46979dd8ca40186c0ca7` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:44.545213 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ac2f6-def2-467a-a3ec-053949d28568 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c51097d14c64e869f8ce7b3df492b61, user_id=9abe5470480046e6b6be3b0a0f16332b, role_id=8c1bc4243dcc46979dd8ca40186c0ca7)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:44.546692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ac2f6-def2-467a-a3ec-053949d28568 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:44.589720 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 64/138] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:28:44.630687 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d01e57-d979-4c99-88ca-019341523b63 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:44.691572 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 75/139] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:28:44 2022] PUT /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61/users/9abe5470480046e6b6be3b0a0f16332b/roles/8c1bc4243dcc46979dd8ca40186c0ca7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:28:44.743162 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d01e57-d979-4c99-88ca-019341523b63 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:44.783421 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862621c-4388-4f78-ad02-5edb60b103d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:44.784320 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862621c-4388-4f78-ad02-5edb60b103d1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:44.784746 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862621c-4388-4f78-ad02-5edb60b103d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:44.785029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862621c-4388-4f78-ad02-5edb60b103d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:44.786384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862621c-4388-4f78-ad02-5edb60b103d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:44.788515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862621c-4388-4f78-ad02-5edb60b103d1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:44.790459 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 65/140] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:28:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:44.795743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ac2f6-def2-467a-a3ec-053949d28568 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:44.907118 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ac2f6-def2-467a-a3ec-053949d28568 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:44.946739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855f4cf-3cd2-4a03-9430-6eb5245f1666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:44.947329 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855f4cf-3cd2-4a03-9430-6eb5245f1666 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:44.947616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855f4cf-3cd2-4a03-9430-6eb5245f1666 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:44.947892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855f4cf-3cd2-4a03-9430-6eb5245f1666 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:44.948653 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855f4cf-3cd2-4a03-9430-6eb5245f1666 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:44.950128 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855f4cf-3cd2-4a03-9430-6eb5245f1666 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:45.104123 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 76/141] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:28:44 2022] POST /identity/v3/users => generated 283 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:28:45.407534 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811bf23-c206-4fc4-ad67-302aa2a21093 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:45.407877 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811bf23-c206-4fc4-ad67-302aa2a21093 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:45.408098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811bf23-c206-4fc4-ad67-302aa2a21093 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:45.409663 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 66/142] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:45.428126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15a675-e4fb-42af-8740-8f80742bb93e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:45.428424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15a675-e4fb-42af-8740-8f80742bb93e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:45.428731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15a675-e4fb-42af-8740-8f80742bb93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:45.451894 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9c15a675-e4fb-42af-8740-8f80742bb93e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:45.453087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9c15a675-e4fb-42af-8740-8f80742bb93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:45.534184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 77/143] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:45.571902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811bf23-c206-4fc4-ad67-302aa2a21093 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:45.732311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811bf23-c206-4fc4-ad67-302aa2a21093 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:45.782064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742520b5-05eb-42dd-9ac9-097e1e8b6a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:45.782870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742520b5-05eb-42dd-9ac9-097e1e8b6a23 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:45.783165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742520b5-05eb-42dd-9ac9-097e1e8b6a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:45.783453 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742520b5-05eb-42dd-9ac9-097e1e8b6a23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:45.801390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742520b5-05eb-42dd-9ac9-097e1e8b6a23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:45.809715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-742520b5-05eb-42dd-9ac9-097e1e8b6a23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:28:45.809715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:45.809715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:45.809715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:45.809715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:45.809715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:45.809715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:45.809715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:45.809715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:45.809715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:45.809715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:45.809715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:45.809715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:45.809715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:45.809715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:45.809715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:45.810519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:45.810519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:45.810519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:45.810519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:45.810519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:45.810519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:45.810519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:45.810519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:45.810519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:45.810519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:45.810519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:45.810519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:45.810519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:45.810519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:45.810519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:45.810519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:45.811241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:45.811241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:45.811241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:45.811241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:45.811241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:45.811241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:45.811241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:45.811241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:45.811241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:45.811241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:45.811241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:28:45.811241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:45.811241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 67/144] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:45.817587 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15a675-e4fb-42af-8740-8f80742bb93e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:45.901438 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a115a6-d5b4-49cd-8a20-1335ac914480 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:45.902042 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a115a6-d5b4-49cd-8a20-1335ac914480 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:45.902506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a115a6-d5b4-49cd-8a20-1335ac914480 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:45.909680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 68/145] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:45.911269 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef2848-38bc-4fcc-9e2b-a51d02af5c8c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:45.912381 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef2848-38bc-4fcc-9e2b-a51d02af5c8c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:45.920464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef2848-38bc-4fcc-9e2b-a51d02af5c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:45.951878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15a675-e4fb-42af-8740-8f80742bb93e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:45.953255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c3ef2848-38bc-4fcc-9e2b-a51d02af5c8c None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:45.954705 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c3ef2848-38bc-4fcc-9e2b-a51d02af5c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:45.999345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9eb5c-865e-4eeb-bdd7-e4253b4350e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:45.999934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9eb5c-865e-4eeb-bdd7-e4253b4350e2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:46.000210 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9eb5c-865e-4eeb-bdd7-e4253b4350e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:46.000524 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9eb5c-865e-4eeb-bdd7-e4253b4350e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:46.001285 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9eb5c-865e-4eeb-bdd7-e4253b4350e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:46.001587 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9eb5c-865e-4eeb-bdd7-e4253b4350e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:46.002987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9eb5c-865e-4eeb-bdd7-e4253b4350e2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:46.016963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 78/146] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:28:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:46.023393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9eb5c-865e-4eeb-bdd7-e4253b4350e2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:46.081002 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 69/147] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:46.126072 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef2848-38bc-4fcc-9e2b-a51d02af5c8c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:46.188453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9eb5c-865e-4eeb-bdd7-e4253b4350e2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:46.245575 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb99c32-f821-4cd9-ae3c-44fa392315dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:46.246450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb99c32-f821-4cd9-ae3c-44fa392315dd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:46.246724 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb99c32-f821-4cd9-ae3c-44fa392315dd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:46.246991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb99c32-f821-4cd9-ae3c-44fa392315dd None admin] PATH_INFO: `/v3/users/28586ae1e93e4b6d9450ab3180b06fc5` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:46.257043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb99c32-f821-4cd9-ae3c-44fa392315dd None admin] RBAC: Authorizing `identity:get_user(user_id=28586ae1e93e4b6d9450ab3180b06fc5)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:46.257043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb99c32-f821-4cd9-ae3c-44fa392315dd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:46.257043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 79/148] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:46 2022] GET /identity/v3/users/28586ae1e93e4b6d9450ab3180b06fc5 => generated 289 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:46.263251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb99c32-f821-4cd9-ae3c-44fa392315dd None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:46.317034 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef2848-38bc-4fcc-9e2b-a51d02af5c8c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:46.417190 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce346a-cb5d-4f90-9e64-13b133422df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:46.418012 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce346a-cb5d-4f90-9e64-13b133422df2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:46.418302 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce346a-cb5d-4f90-9e64-13b133422df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:46.418589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce346a-cb5d-4f90-9e64-13b133422df2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:46.442249 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb99c32-f821-4cd9-ae3c-44fa392315dd None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:46.447903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce346a-cb5d-4f90-9e64-13b133422df2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:46.464478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d3ce346a-cb5d-4f90-9e64-13b133422df2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:28:46.464478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:46.464478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:46.464478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:46.464478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:46.464478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:46.464478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:46.464478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:46.464478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:46.464478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:46.464478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:46.464478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:46.464478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:46.464478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:46.464478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:46.464478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:46.465541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:46.465541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:46.465541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:46.465541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:46.465541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:46.465541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:46.465541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:46.465541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:46.465541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:46.465541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:46.465541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:46.465541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:46.465541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:46.465541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:46.465541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:46.465541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:46.466399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:46.466399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:46.466399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:46.466399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:46.466399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:46.466399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:46.466399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:46.466399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:46.466399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:46.466399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:46.466399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:28:46.466399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:46.466399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 70/149] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:28:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:28:46.467731 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce346a-cb5d-4f90-9e64-13b133422df2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:46.498705 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c2b58-0ba6-48fa-84ef-cdb99021f116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:46.499816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c2b58-0ba6-48fa-84ef-cdb99021f116 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:46.500231 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c2b58-0ba6-48fa-84ef-cdb99021f116 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:46.504725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c2b58-0ba6-48fa-84ef-cdb99021f116 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:46.506523 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c2b58-0ba6-48fa-84ef-cdb99021f116 None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:46.508171 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c2b58-0ba6-48fa-84ef-cdb99021f116 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:46.510053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 80/150] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:46 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:46.516025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c2b58-0ba6-48fa-84ef-cdb99021f116 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:46.689443 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce346a-cb5d-4f90-9e64-13b133422df2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:46.697275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c2b58-0ba6-48fa-84ef-cdb99021f116 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:46.759965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdb8ad-b3b1-4de3-acbc-dfc04315a858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:46.761166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdb8ad-b3b1-4de3-acbc-dfc04315a858 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:46.761616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdb8ad-b3b1-4de3-acbc-dfc04315a858 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:46.762054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdb8ad-b3b1-4de3-acbc-dfc04315a858 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61/users/28586ae1e93e4b6d9450ab3180b06fc5/roles/14898ff2d2954978a29cb0b4cb85ba7e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:46.764195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdb8ad-b3b1-4de3-acbc-dfc04315a858 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c51097d14c64e869f8ce7b3df492b61, user_id=28586ae1e93e4b6d9450ab3180b06fc5, role_id=14898ff2d2954978a29cb0b4cb85ba7e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:46.766037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdb8ad-b3b1-4de3-acbc-dfc04315a858 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:46.769606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d143b-ddb5-4c19-9089-b4d2d1defe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:46.770066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d143b-ddb5-4c19-9089-b4d2d1defe00 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:46.770155 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d143b-ddb5-4c19-9089-b4d2d1defe00 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:46.770371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d143b-ddb5-4c19-9089-b4d2d1defe00 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:46.771261 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d143b-ddb5-4c19-9089-b4d2d1defe00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:46.771572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d143b-ddb5-4c19-9089-b4d2d1defe00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:46.776464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d143b-ddb5-4c19-9089-b4d2d1defe00 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:46.783055 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 71/151] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:46.789202 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d143b-ddb5-4c19-9089-b4d2d1defe00 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:46.852275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 81/152] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:28:46 2022] PUT /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61/users/28586ae1e93e4b6d9450ab3180b06fc5/roles/14898ff2d2954978a29cb0b4cb85ba7e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:28:46.915401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d143b-ddb5-4c19-9089-b4d2d1defe00 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:46.957655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc470d-8b41-4883-97ac-0e913cfd0f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:46.959269 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc470d-8b41-4883-97ac-0e913cfd0f86 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:46.959675 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc470d-8b41-4883-97ac-0e913cfd0f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:46.960065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc470d-8b41-4883-97ac-0e913cfd0f86 None admin] PATH_INFO: `/v3/users/1d4d0e6c1c9344a380489ecebdd59a95` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:46.961515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc470d-8b41-4883-97ac-0e913cfd0f86 None admin] RBAC: Authorizing `identity:get_user(user_id=1d4d0e6c1c9344a380489ecebdd59a95)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:46.962974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc470d-8b41-4883-97ac-0e913cfd0f86 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:46.964894 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 72/153] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:46 2022] GET /identity/v3/users/1d4d0e6c1c9344a380489ecebdd59a95 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:46.971055 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdb8ad-b3b1-4de3-acbc-dfc04315a858 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:47.113217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdb8ad-b3b1-4de3-acbc-dfc04315a858 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:47.155963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cee2ca-2016-45d2-af40-2f21af8515e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:47.156705 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cee2ca-2016-45d2-af40-2f21af8515e1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:47.156995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cee2ca-2016-45d2-af40-2f21af8515e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:47.157268 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cee2ca-2016-45d2-af40-2f21af8515e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:47.231726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cee2ca-2016-45d2-af40-2f21af8515e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:47.233286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cee2ca-2016-45d2-af40-2f21af8515e1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:47.350541 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 82/154] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:28:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:28:47.357558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc470d-8b41-4883-97ac-0e913cfd0f86 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:47.492920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc470d-8b41-4883-97ac-0e913cfd0f86 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:47.527322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf2d15-20d2-4952-a46c-5af738d403e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:47.528211 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf2d15-20d2-4952-a46c-5af738d403e2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:47.528527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf2d15-20d2-4952-a46c-5af738d403e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:47.528813 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf2d15-20d2-4952-a46c-5af738d403e2 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:47.530139 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf2d15-20d2-4952-a46c-5af738d403e2 None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:47.531636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf2d15-20d2-4952-a46c-5af738d403e2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:47.533835 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 73/155] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:47 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:47.540864 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cee2ca-2016-45d2-af40-2f21af8515e1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:47.692212 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cee2ca-2016-45d2-af40-2f21af8515e1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:47.738101 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485aae0-b538-4c48-82ac-1d3574757816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:47.738768 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485aae0-b538-4c48-82ac-1d3574757816 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:47.739052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485aae0-b538-4c48-82ac-1d3574757816 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:47.739328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485aae0-b538-4c48-82ac-1d3574757816 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:47.740875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485aae0-b538-4c48-82ac-1d3574757816 None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=0c51097d14c64e869f8ce7b3df492b61, user.id=1d4d0e6c1c9344a380489ecebdd59a95) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:47.741187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485aae0-b538-4c48-82ac-1d3574757816 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:47.742652 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485aae0-b538-4c48-82ac-1d3574757816 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:47.752974 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 83/156] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:28:47 2022] GET /identity/v3/role_assignments?user.id=1d4d0e6c1c9344a380489ecebdd59a95&scope.project.id=0c51097d14c64e869f8ce7b3df492b61&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:48.065568 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cadb6e-9425-497d-876a-2fb26e03ce60 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:48.066047 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cadb6e-9425-497d-876a-2fb26e03ce60 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:48.066047 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cadb6e-9425-497d-876a-2fb26e03ce60 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:48.068218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 74/157] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:48.084758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77efecb-4f71-45c0-a5dd-46b1b9ba8195 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:48.085293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77efecb-4f71-45c0-a5dd-46b1b9ba8195 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:48.085293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77efecb-4f71-45c0-a5dd-46b1b9ba8195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:48.113648 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b77efecb-4f71-45c0-a5dd-46b1b9ba8195 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:48.115448 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b77efecb-4f71-45c0-a5dd-46b1b9ba8195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:48.229564 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 84/158] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:48.282083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cadb6e-9425-497d-876a-2fb26e03ce60 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:48.454818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cadb6e-9425-497d-876a-2fb26e03ce60 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:48.515227 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a0760-2a74-499c-af69-722b9773686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:48.517243 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a0760-2a74-499c-af69-722b9773686b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:48.518462 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a0760-2a74-499c-af69-722b9773686b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:48.518766 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a0760-2a74-499c-af69-722b9773686b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:48.539935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a0760-2a74-499c-af69-722b9773686b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:48.547883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-171a0760-2a74-499c-af69-722b9773686b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:28:48.547883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:48.547883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:48.547883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:48.547883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:48.547883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:48.547883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:48.547883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:48.547883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:48.547883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:48.547883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:48.547883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:48.547883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:48.547883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:48.547883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:48.547883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:48.548816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:48.548816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:48.548816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:48.548816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:48.548816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:48.548816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:48.548816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:48.548816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:48.548816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:48.548816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:48.548816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:48.548816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:48.548816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:48.548816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:48.548816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:48.548816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:48.549747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:48.549747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:48.549747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:48.549747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:48.549747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:48.549747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:48.549747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:48.549747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:48.549747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:48.549747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:48.549747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:28:48.549747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:48.549747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 75/159] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:48.556535 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77efecb-4f71-45c0-a5dd-46b1b9ba8195 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:48.715385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77efecb-4f71-45c0-a5dd-46b1b9ba8195 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:48.767993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0eb8b6-039d-4b1d-b4dc-738aa14c1612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:48.768697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0eb8b6-039d-4b1d-b4dc-738aa14c1612 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:48.768978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0eb8b6-039d-4b1d-b4dc-738aa14c1612 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:48.769257 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0eb8b6-039d-4b1d-b4dc-738aa14c1612 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:48.770026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0eb8b6-039d-4b1d-b4dc-738aa14c1612 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:48.770335 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0eb8b6-039d-4b1d-b4dc-738aa14c1612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:48.772750 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0eb8b6-039d-4b1d-b4dc-738aa14c1612 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:48.785455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1f3ce-dc5d-4351-ba21-bdda159357e2 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:48.785949 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1f3ce-dc5d-4351-ba21-bdda159357e2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:48.786348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1f3ce-dc5d-4351-ba21-bdda159357e2 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:48.788893 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 76/160] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:48.791169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 85/161] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:28:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:48.797001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7ceaf-c6f9-4bf2-84d0-457cf28c03cf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:48.798128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7ceaf-c6f9-4bf2-84d0-457cf28c03cf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:48.798423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7ceaf-c6f9-4bf2-84d0-457cf28c03cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:48.800750 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0eb8b6-039d-4b1d-b4dc-738aa14c1612 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:48.851440 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a0f7ceaf-c6f9-4bf2-84d0-457cf28c03cf None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:48.855399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a0f7ceaf-c6f9-4bf2-84d0-457cf28c03cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:48.998757 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 77/162] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:49.000499 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b977e56-a457-40e1-b7d1-dc15a5d81988 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:49.000992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b977e56-a457-40e1-b7d1-dc15a5d81988 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:49.001486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b977e56-a457-40e1-b7d1-dc15a5d81988 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:49.003011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 78/163] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:49.007477 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0eb8b6-039d-4b1d-b4dc-738aa14c1612 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:49.010038 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1900cf-67a5-4531-9ec5-cae4bbf4d8b5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:49.010390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1900cf-67a5-4531-9ec5-cae4bbf4d8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:49.010671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1900cf-67a5-4531-9ec5-cae4bbf4d8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:49.037663 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6a1900cf-67a5-4531-9ec5-cae4bbf4d8b5 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:49.039145 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6a1900cf-67a5-4531-9ec5-cae4bbf4d8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:49.050759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0ffc7-2233-4d2e-979d-02b6c2199ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:49.056565 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0ffc7-2233-4d2e-979d-02b6c2199ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:49.056565 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0ffc7-2233-4d2e-979d-02b6c2199ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:49.056565 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0ffc7-2233-4d2e-979d-02b6c2199ac7 None admin] PATH_INFO: `/v3/users/9abe5470480046e6b6be3b0a0f16332b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:49.057848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0ffc7-2233-4d2e-979d-02b6c2199ac7 None admin] RBAC: Authorizing `identity:get_user(user_id=9abe5470480046e6b6be3b0a0f16332b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:49.059577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0ffc7-2233-4d2e-979d-02b6c2199ac7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:49.062722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 86/164] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:48 2022] GET /identity/v3/users/9abe5470480046e6b6be3b0a0f16332b => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:49.072902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0ffc7-2233-4d2e-979d-02b6c2199ac7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:49.148205 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 79/165] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:28:49.149719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1900cf-67a5-4531-9ec5-cae4bbf4d8b5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:49.187295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0ffc7-2233-4d2e-979d-02b6c2199ac7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:49.233143 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20512d0b-c5b1-4007-b265-ea2f09738681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:49.234184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20512d0b-c5b1-4007-b265-ea2f09738681 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:49.234666 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20512d0b-c5b1-4007-b265-ea2f09738681 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:49.235137 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20512d0b-c5b1-4007-b265-ea2f09738681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:49.263024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1900cf-67a5-4531-9ec5-cae4bbf4d8b5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:49.299066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a895e-3fcd-41d4-962d-c08fea452487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:49.300396 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a895e-3fcd-41d4-962d-c08fea452487 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:49.300903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a895e-3fcd-41d4-962d-c08fea452487 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:49.301367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a895e-3fcd-41d4-962d-c08fea452487 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:49.313304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a895e-3fcd-41d4-962d-c08fea452487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:49.327554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-124a895e-3fcd-41d4-962d-c08fea452487 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:28:49.327554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:49.327554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:49.327554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:49.327554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:49.327554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:49.327554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:49.327554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:49.327554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:49.327554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:49.327554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:49.327554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:49.327554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:49.327554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:49.327554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:49.327554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:49.328527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:49.328527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:49.328527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:49.328527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:49.328527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:49.328527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:49.328527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:49.328527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:49.328527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:49.328527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:49.328527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:49.328527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:49.328527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:49.328527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:49.328527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:49.328527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:49.329277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:49.329277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:49.329277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:49.329277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:49.329277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:49.329277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:49.329277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:49.329277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:49.329277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:49.329277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:49.329277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:28:49.329277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:49.337484 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 80/166] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:49.338586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a895e-3fcd-41d4-962d-c08fea452487 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:49.348878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20512d0b-c5b1-4007-b265-ea2f09738681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:49.350454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20512d0b-c5b1-4007-b265-ea2f09738681 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:49.447991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a895e-3fcd-41d4-962d-c08fea452487 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:49.483185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 87/167] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:28:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:28:49.484046 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20512d0b-c5b1-4007-b265-ea2f09738681 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:49.484772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a46a6-d6c0-4548-91b1-8c5e94ec8d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:49.485857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a46a6-d6c0-4548-91b1-8c5e94ec8d79 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:49.486344 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a46a6-d6c0-4548-91b1-8c5e94ec8d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:49.486811 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a46a6-d6c0-4548-91b1-8c5e94ec8d79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:49.498306 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a46a6-d6c0-4548-91b1-8c5e94ec8d79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:49.507366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a60a46a6-d6c0-4548-91b1-8c5e94ec8d79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:28:49.507366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:49.507366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:49.507366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:49.507366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:49.507366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:49.507366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:49.507366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:49.507366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:49.507366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:49.507366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:49.507366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:49.507366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:49.507366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:49.507366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:49.507366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:49.508225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:49.508225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:49.508225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:49.508225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:49.508225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:49.508225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:49.508225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:49.508225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:49.508225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:49.508225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:49.508225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:49.508225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:49.508225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:49.508225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:49.508225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:49.508225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:49.508993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:49.508993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:49.508993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:49.508993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:49.508993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:49.508993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:49.508993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:49.508993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:49.508993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:49.508993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:49.508993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:28:49.508993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:49.511306 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 81/168] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:28:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:49.512276 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a46a6-d6c0-4548-91b1-8c5e94ec8d79 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:49.588238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20512d0b-c5b1-4007-b265-ea2f09738681 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:49.627951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82fedb-9e10-4ba3-8f96-84997bf4a107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:49.628898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82fedb-9e10-4ba3-8f96-84997bf4a107 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:49.629189 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82fedb-9e10-4ba3-8f96-84997bf4a107 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:49.629462 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82fedb-9e10-4ba3-8f96-84997bf4a107 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:49.630228 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82fedb-9e10-4ba3-8f96-84997bf4a107 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:49.631061 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82fedb-9e10-4ba3-8f96-84997bf4a107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:49.632474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82fedb-9e10-4ba3-8f96-84997bf4a107 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:49.648794 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 88/169] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:28:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:49.649650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82fedb-9e10-4ba3-8f96-84997bf4a107 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:49.716333 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a46a6-d6c0-4548-91b1-8c5e94ec8d79 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:49.799055 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589d8a7-288b-4ea4-9d25-616f856094b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:49.799923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589d8a7-288b-4ea4-9d25-616f856094b0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:49.800204 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589d8a7-288b-4ea4-9d25-616f856094b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:49.800502 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589d8a7-288b-4ea4-9d25-616f856094b0 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:49.809446 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589d8a7-288b-4ea4-9d25-616f856094b0 None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:49.810925 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589d8a7-288b-4ea4-9d25-616f856094b0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:49.812726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 82/170] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:49 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:49.814658 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589d8a7-288b-4ea4-9d25-616f856094b0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:49.838340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82fedb-9e10-4ba3-8f96-84997bf4a107 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:49.891518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a465c3-b4fa-45f6-91ba-5f3409de39ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:49.892190 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a465c3-b4fa-45f6-91ba-5f3409de39ff None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:49.892487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a465c3-b4fa-45f6-91ba-5f3409de39ff None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:49.892762 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a465c3-b4fa-45f6-91ba-5f3409de39ff None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:49.893519 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a465c3-b4fa-45f6-91ba-5f3409de39ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:49.893821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a465c3-b4fa-45f6-91ba-5f3409de39ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:49.895206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a465c3-b4fa-45f6-91ba-5f3409de39ff None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:49.908895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 89/171] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:28:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:49.909814 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a465c3-b4fa-45f6-91ba-5f3409de39ff None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:50.058188 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589d8a7-288b-4ea4-9d25-616f856094b0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:50.073808 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a465c3-b4fa-45f6-91ba-5f3409de39ff None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:50.107102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b2de0-6a12-4813-a535-e7d7aa8b9ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:50.107894 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b2de0-6a12-4813-a535-e7d7aa8b9ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:50.108176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b2de0-6a12-4813-a535-e7d7aa8b9ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:50.108465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b2de0-6a12-4813-a535-e7d7aa8b9ec6 None admin] PATH_INFO: `/v3/users/9abe5470480046e6b6be3b0a0f16332b` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:50.113169 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b2de0-6a12-4813-a535-e7d7aa8b9ec6 None admin] RBAC: Authorizing `identity:get_user(user_id=9abe5470480046e6b6be3b0a0f16332b)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:50.115201 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b2de0-6a12-4813-a535-e7d7aa8b9ec6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:50.117061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 83/172] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:49 2022] GET /identity/v3/users/9abe5470480046e6b6be3b0a0f16332b => generated 275 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:50.117760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b2de0-6a12-4813-a535-e7d7aa8b9ec6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:50.134957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb850a-a5f4-4820-ab0a-83de209f842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:50.136040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb850a-a5f4-4820-ab0a-83de209f842f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:50.136577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb850a-a5f4-4820-ab0a-83de209f842f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:50.137043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb850a-a5f4-4820-ab0a-83de209f842f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:50.138188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb850a-a5f4-4820-ab0a-83de209f842f None admin] RBAC: Adding query filter params (role.id=42b0adbc87e347e18bd4412dc9e421c1, scope.project.id=0c51097d14c64e869f8ce7b3df492b61, user.id=9abe5470480046e6b6be3b0a0f16332b) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:50.138687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb850a-a5f4-4820-ab0a-83de209f842f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:50.140326 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb850a-a5f4-4820-ab0a-83de209f842f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:50.147845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 90/173] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:28:49 2022] GET /identity/v3/role_assignments?user.id=9abe5470480046e6b6be3b0a0f16332b&scope.project.id=0c51097d14c64e869f8ce7b3df492b61&role.id=42b0adbc87e347e18bd4412dc9e421c1 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:50.149445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb850a-a5f4-4820-ab0a-83de209f842f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:50.293221 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb850a-a5f4-4820-ab0a-83de209f842f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:50.337246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b559d-03bc-4d57-b873-f99ab88f58b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:50.340551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b559d-03bc-4d57-b873-f99ab88f58b8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:50.340551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b559d-03bc-4d57-b873-f99ab88f58b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:50.340551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b559d-03bc-4d57-b873-f99ab88f58b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:50.394778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b2de0-6a12-4813-a535-e7d7aa8b9ec6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:50.432240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b559d-03bc-4d57-b873-f99ab88f58b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:50.433769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b559d-03bc-4d57-b873-f99ab88f58b8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:50.477180 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed51a55-8203-4505-b9e6-ad26dfec0c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:50.478081 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed51a55-8203-4505-b9e6-ad26dfec0c6e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:50.478367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed51a55-8203-4505-b9e6-ad26dfec0c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:50.478642 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed51a55-8203-4505-b9e6-ad26dfec0c6e None admin] PATH_INFO: `/v3/users/9abe5470480046e6b6be3b0a0f16332b` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:50.479917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed51a55-8203-4505-b9e6-ad26dfec0c6e None admin] RBAC: Authorizing `identity:get_user(user_id=9abe5470480046e6b6be3b0a0f16332b)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:50.481385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed51a55-8203-4505-b9e6-ad26dfec0c6e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:50.484395 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 84/174] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:50 2022] GET /identity/v3/users/9abe5470480046e6b6be3b0a0f16332b => generated 275 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:50.489357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed51a55-8203-4505-b9e6-ad26dfec0c6e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:50.548260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 91/175] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:28:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:28:50.554386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b559d-03bc-4d57-b873-f99ab88f58b8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:50.640532 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed51a55-8203-4505-b9e6-ad26dfec0c6e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:50.686188 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca9f18-3463-4805-a5ce-87599b382a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:50.686857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca9f18-3463-4805-a5ce-87599b382a10 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:50.687138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca9f18-3463-4805-a5ce-87599b382a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:50.687413 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca9f18-3463-4805-a5ce-87599b382a10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:50.798871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca9f18-3463-4805-a5ce-87599b382a10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:50.800428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca9f18-3463-4805-a5ce-87599b382a10 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:50.806180 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b559d-03bc-4d57-b873-f99ab88f58b8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:50.850386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727f932-4311-472a-aa7b-bfeb63603e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:50.851271 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727f932-4311-472a-aa7b-bfeb63603e7b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:50.851552 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727f932-4311-472a-aa7b-bfeb63603e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:50.851826 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727f932-4311-472a-aa7b-bfeb63603e7b None admin] PATH_INFO: `/v3/projects/f6d49e39d159400898170828427162df` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:50.855312 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727f932-4311-472a-aa7b-bfeb63603e7b None admin] RBAC: Authorizing `identity:get_project(project_id=f6d49e39d159400898170828427162df)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:50.856823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727f932-4311-472a-aa7b-bfeb63603e7b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:50.858560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 92/176] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:50 2022] GET /identity/v3/projects/f6d49e39d159400898170828427162df => generated 312 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:50.859842 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef1b08-8d42-424e-b09b-e8abebc7af11 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:50.860128 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef1b08-8d42-424e-b09b-e8abebc7af11 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:50.860399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef1b08-8d42-424e-b09b-e8abebc7af11 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:50.862043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 93/177] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:50.863098 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719989b1-1e15-4001-9d14-8acc2f01f8d5 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:50.863441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719989b1-1e15-4001-9d14-8acc2f01f8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:50.863721 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719989b1-1e15-4001-9d14-8acc2f01f8d5 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:50.866610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 94/178] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:50.867375 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719989b1-1e15-4001-9d14-8acc2f01f8d5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:50.913429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 85/179] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:28:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 17:28:50.917884 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dbbe7-7f4c-4de8-af91-f36dfdd2e685 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:50.918166 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dbbe7-7f4c-4de8-af91-f36dfdd2e685 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:50.918444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dbbe7-7f4c-4de8-af91-f36dfdd2e685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:50.936862 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ef9dbbe7-7f4c-4de8-af91-f36dfdd2e685 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:50.937974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ef9dbbe7-7f4c-4de8-af91-f36dfdd2e685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:50.981887 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719989b1-1e15-4001-9d14-8acc2f01f8d5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:51.004303 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 86/180] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:51.005990 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775c886-38cf-41e5-abc0-d098e0408df5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:51.006500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775c886-38cf-41e5-abc0-d098e0408df5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:51.006956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775c886-38cf-41e5-abc0-d098e0408df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:51.025036 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537d07d-e377-4fda-bdfd-f1e878cc0487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:51.025792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537d07d-e377-4fda-bdfd-f1e878cc0487 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:51.026134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537d07d-e377-4fda-bdfd-f1e878cc0487 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:51.026464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537d07d-e377-4fda-bdfd-f1e878cc0487 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:51.027842 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537d07d-e377-4fda-bdfd-f1e878cc0487 None admin] RBAC: Adding query filter params (role.id=42b0adbc87e347e18bd4412dc9e421c1, scope.project.id=f6d49e39d159400898170828427162df, user.id=9abe5470480046e6b6be3b0a0f16332b) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:51.028215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537d07d-e377-4fda-bdfd-f1e878cc0487 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:51.029787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537d07d-e377-4fda-bdfd-f1e878cc0487 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:51.034992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c775c886-38cf-41e5-abc0-d098e0408df5 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:51.036640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c775c886-38cf-41e5-abc0-d098e0408df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:51.040612 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 95/181] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:28:50 2022] GET /identity/v3/role_assignments?user.id=9abe5470480046e6b6be3b0a0f16332b&scope.project.id=f6d49e39d159400898170828427162df&role.id=42b0adbc87e347e18bd4412dc9e421c1 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:51.041639 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537d07d-e377-4fda-bdfd-f1e878cc0487 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:51.135320 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 87/182] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:51.137451 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911025a1-e356-49a0-80f7-98fe3813d8b4 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:51.137747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911025a1-e356-49a0-80f7-98fe3813d8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:51.138353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911025a1-e356-49a0-80f7-98fe3813d8b4 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:51.143669 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 88/183] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:51.143669 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911025a1-e356-49a0-80f7-98fe3813d8b4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:51.206660 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537d07d-e377-4fda-bdfd-f1e878cc0487 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:51.252629 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebca23-7ce0-42f4-8f94-67ff48802e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:51.253498 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebca23-7ce0-42f4-8f94-67ff48802e21 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:51.253774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebca23-7ce0-42f4-8f94-67ff48802e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:51.254304 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebca23-7ce0-42f4-8f94-67ff48802e21 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:51.256103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebca23-7ce0-42f4-8f94-67ff48802e21 None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:51.257739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebca23-7ce0-42f4-8f94-67ff48802e21 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:51.260075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 96/184] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:51 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:51.260818 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2528c1e-9c38-40c5-8f5e-1dd138cc1a00 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:51.261568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2528c1e-9c38-40c5-8f5e-1dd138cc1a00 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:51.261568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2528c1e-9c38-40c5-8f5e-1dd138cc1a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:51.275831 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911025a1-e356-49a0-80f7-98fe3813d8b4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:51.278753 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a2528c1e-9c38-40c5-8f5e-1dd138cc1a00 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:51.280032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a2528c1e-9c38-40c5-8f5e-1dd138cc1a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:51.316268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a834132-00e9-4db8-a751-5a686c33b52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:51.317103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a834132-00e9-4db8-a751-5a686c33b52b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:51.317385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a834132-00e9-4db8-a751-5a686c33b52b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:51.317659 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a834132-00e9-4db8-a751-5a686c33b52b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:51.331775 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a834132-00e9-4db8-a751-5a686c33b52b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:51.339873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7a834132-00e9-4db8-a751-5a686c33b52b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:28:51.339873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:51.339873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:51.339873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:51.339873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:51.339873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:51.339873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:51.339873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:51.339873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:51.339873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:51.339873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:51.339873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:51.339873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:51.339873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:51.339873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:51.339873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:51.340857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:51.340857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:51.340857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:51.340857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:51.340857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:51.340857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:51.340857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:51.340857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:51.340857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:51.340857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:51.340857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:51.340857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:51.340857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:51.340857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:51.340857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:51.340857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:51.341622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:51.341622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:51.341622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:51.341622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:51.341622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:51.341622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:51.341622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:51.341622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:51.341622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:51.341622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:51.341622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:28:51.341622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:51.341622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 89/185] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:28:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:51.342247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a834132-00e9-4db8-a751-5a686c33b52b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:51.362260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 97/186] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:51.366478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c17c91-38b0-497d-ba42-537eb534c413 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:51.366846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c17c91-38b0-497d-ba42-537eb534c413 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:51.367126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c17c91-38b0-497d-ba42-537eb534c413 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:51.368433 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 98/187] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:51.369165 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c17c91-38b0-497d-ba42-537eb534c413 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:51.442126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a834132-00e9-4db8-a751-5a686c33b52b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:51.468541 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c17c91-38b0-497d-ba42-537eb534c413 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:51.474873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d47f0a-ff98-44bb-9ef2-264db5760911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:51.475677 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d47f0a-ff98-44bb-9ef2-264db5760911 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:51.475957 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d47f0a-ff98-44bb-9ef2-264db5760911 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:51.476225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d47f0a-ff98-44bb-9ef2-264db5760911 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:51.486155 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d47f0a-ff98-44bb-9ef2-264db5760911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:51.494762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-73d47f0a-ff98-44bb-9ef2-264db5760911 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:28:51.494762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:51.494762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:51.494762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:51.494762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:51.494762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:51.494762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:51.494762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:51.494762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:51.494762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:51.494762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:51.494762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:51.494762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:51.494762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:51.494762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:51.494762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:51.495598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:51.495598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:51.495598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:51.495598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:51.495598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:51.495598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:51.495598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:51.495598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:51.495598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:51.495598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:51.495598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:51.495598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:51.495598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:51.495598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:51.495598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:51.495598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:51.496640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:51.496640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:51.496640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:51.496640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:51.496640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:51.496640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:51.496640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:51.496640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:51.496640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:51.496640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:51.496640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:28:51.496640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:51.496640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 90/188] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:28:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:51.497692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d47f0a-ff98-44bb-9ef2-264db5760911 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:51.507021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a69e7e-5796-4b7b-863c-a4c63e8a7453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:51.507677 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a69e7e-5796-4b7b-863c-a4c63e8a7453 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:51.507956 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a69e7e-5796-4b7b-863c-a4c63e8a7453 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:51.508235 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a69e7e-5796-4b7b-863c-a4c63e8a7453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:51.509104 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a69e7e-5796-4b7b-863c-a4c63e8a7453 None admin] RBAC: Adding query filter params (role.id=8c1bc4243dcc46979dd8ca40186c0ca7, scope.project.id=0c51097d14c64e869f8ce7b3df492b61, user.id=9abe5470480046e6b6be3b0a0f16332b) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:51.509414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a69e7e-5796-4b7b-863c-a4c63e8a7453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:51.510846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a69e7e-5796-4b7b-863c-a4c63e8a7453 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:51.516689 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 99/189] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:28:51 2022] GET /identity/v3/role_assignments?user.id=9abe5470480046e6b6be3b0a0f16332b&scope.project.id=0c51097d14c64e869f8ce7b3df492b61&role.id=8c1bc4243dcc46979dd8ca40186c0ca7 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:51.517859 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d12ba-7d6f-4b86-96e7-8d6fa8331572 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:51.518411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d12ba-7d6f-4b86-96e7-8d6fa8331572 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:51.518411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d12ba-7d6f-4b86-96e7-8d6fa8331572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:51.536172 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6d3d12ba-7d6f-4b86-96e7-8d6fa8331572 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:51.537586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6d3d12ba-7d6f-4b86-96e7-8d6fa8331572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:51.609514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d47f0a-ff98-44bb-9ef2-264db5760911 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:51.620686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 100/190] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:51.620686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d12ba-7d6f-4b86-96e7-8d6fa8331572 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:51.658284 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8cc49-9dd5-4c84-a973-a161ef924c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:51.658982 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8cc49-9dd5-4c84-a973-a161ef924c0e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:51.659261 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8cc49-9dd5-4c84-a973-a161ef924c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:51.659533 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8cc49-9dd5-4c84-a973-a161ef924c0e None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:51.660304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8cc49-9dd5-4c84-a973-a161ef924c0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:51.660644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8cc49-9dd5-4c84-a973-a161ef924c0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:51.662109 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8cc49-9dd5-4c84-a973-a161ef924c0e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:51.670947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 91/191] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:51.676225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8cc49-9dd5-4c84-a973-a161ef924c0e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:51.726829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d12ba-7d6f-4b86-96e7-8d6fa8331572 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:51.767422 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122687c5-d135-447b-9b73-585893d34168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:51.768217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122687c5-d135-447b-9b73-585893d34168 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:51.768846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122687c5-d135-447b-9b73-585893d34168 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:51.768846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122687c5-d135-447b-9b73-585893d34168 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:51.769966 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122687c5-d135-447b-9b73-585893d34168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:51.772225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122687c5-d135-447b-9b73-585893d34168 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:51.773502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 101/192] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:28:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:51.774157 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122687c5-d135-447b-9b73-585893d34168 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:51.785590 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8cc49-9dd5-4c84-a973-a161ef924c0e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:51.817777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abba77-56ee-4314-ae62-d715be42e7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:51.818702 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abba77-56ee-4314-ae62-d715be42e7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:51.819068 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abba77-56ee-4314-ae62-d715be42e7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:51.819347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abba77-56ee-4314-ae62-d715be42e7b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:51.820102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abba77-56ee-4314-ae62-d715be42e7b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:51.820408 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abba77-56ee-4314-ae62-d715be42e7b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:51.821808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abba77-56ee-4314-ae62-d715be42e7b5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:51.829418 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 92/193] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:28:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:51.830203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abba77-56ee-4314-ae62-d715be42e7b5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:51.870619 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122687c5-d135-447b-9b73-585893d34168 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:51.903087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029bf91-0ad0-4344-9504-026bda13369c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:51.903869 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029bf91-0ad0-4344-9504-026bda13369c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:51.904156 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029bf91-0ad0-4344-9504-026bda13369c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:51.904424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029bf91-0ad0-4344-9504-026bda13369c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:51.914879 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029bf91-0ad0-4344-9504-026bda13369c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:51.922507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-0029bf91-0ad0-4344-9504-026bda13369c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:28:51.922507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:51.922507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:51.922507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:51.922507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:51.922507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:51.922507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:51.922507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:51.922507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:51.922507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:51.922507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:51.922507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:51.922507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:51.922507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:51.922507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:51.922507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:51.923503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:51.923503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:51.923503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:51.923503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:51.923503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:51.923503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:51.923503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:51.923503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:51.923503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:51.923503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:51.923503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:51.923503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:28:51.923503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:51.923503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:51.923503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:51.923503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:51.924318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:51.924318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:51.924318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:51.924318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:51.924318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:51.924318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:51.924318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:51.924318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:51.924318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:51.924318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:51.924318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:28:51.924318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:28:51.924318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 102/194] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:51.924996 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029bf91-0ad0-4344-9504-026bda13369c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:51.927133 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abba77-56ee-4314-ae62-d715be42e7b5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:51.959104 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2b878-1641-4834-8c93-cfc98ff50508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:51.960026 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2b878-1641-4834-8c93-cfc98ff50508 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:51.960335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2b878-1641-4834-8c93-cfc98ff50508 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:51.960686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2b878-1641-4834-8c93-cfc98ff50508 None admin] PATH_INFO: `/v3/users/e63cebd1573d4f608ff736d8c0828e58` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:51.973475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2b878-1641-4834-8c93-cfc98ff50508 None admin] RBAC: Authorizing `identity:get_user(user_id=e63cebd1573d4f608ff736d8c0828e58)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:51.975504 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2b878-1641-4834-8c93-cfc98ff50508 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:51.977264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 93/195] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:51 2022] GET /identity/v3/users/e63cebd1573d4f608ff736d8c0828e58 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:51.977961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2b878-1641-4834-8c93-cfc98ff50508 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:52.021503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029bf91-0ad0-4344-9504-026bda13369c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:52.054383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fcd2f-abf9-4ee2-9c4a-c92394de4b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:52.055047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fcd2f-abf9-4ee2-9c4a-c92394de4b77 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:52.055326 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fcd2f-abf9-4ee2-9c4a-c92394de4b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:52.055602 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fcd2f-abf9-4ee2-9c4a-c92394de4b77 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:52.056311 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fcd2f-abf9-4ee2-9c4a-c92394de4b77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:52.057827 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fcd2f-abf9-4ee2-9c4a-c92394de4b77 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:52.073009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2b878-1641-4834-8c93-cfc98ff50508 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:52.106356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df265b-3b2d-434e-9cbd-9cf764ae8e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:52.107223 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df265b-3b2d-434e-9cbd-9cf764ae8e0e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:52.107501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df265b-3b2d-434e-9cbd-9cf764ae8e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:52.107776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df265b-3b2d-434e-9cbd-9cf764ae8e0e None admin] PATH_INFO: `/v3/users/e63cebd1573d4f608ff736d8c0828e58` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:52.108987 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df265b-3b2d-434e-9cbd-9cf764ae8e0e None admin] RBAC: Authorizing `identity:get_user(user_id=e63cebd1573d4f608ff736d8c0828e58)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:52.110422 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df265b-3b2d-434e-9cbd-9cf764ae8e0e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:52.112076 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 94/196] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:51 2022] GET /identity/v3/users/e63cebd1573d4f608ff736d8c0828e58 => generated 283 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:52.112857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df265b-3b2d-434e-9cbd-9cf764ae8e0e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:52.166301 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 103/197] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:28:51 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:28:52.167212 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fcd2f-abf9-4ee2-9c4a-c92394de4b77 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:52.237315 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df265b-3b2d-434e-9cbd-9cf764ae8e0e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:52.274680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c42474-5c70-4f7a-8d42-9dfd5ed1ad08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:52.275364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c42474-5c70-4f7a-8d42-9dfd5ed1ad08 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:52.275653 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c42474-5c70-4f7a-8d42-9dfd5ed1ad08 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:52.275927 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c42474-5c70-4f7a-8d42-9dfd5ed1ad08 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:52.276721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c42474-5c70-4f7a-8d42-9dfd5ed1ad08 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:52.277029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c42474-5c70-4f7a-8d42-9dfd5ed1ad08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:52.277860 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fcd2f-abf9-4ee2-9c4a-c92394de4b77 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:52.278427 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c42474-5c70-4f7a-8d42-9dfd5ed1ad08 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:52.288506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 95/198] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:28:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:52.288506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c42474-5c70-4f7a-8d42-9dfd5ed1ad08 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:52.320206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ad7cd-a6ce-468f-aca0-c4d23224691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:52.323951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ad7cd-a6ce-468f-aca0-c4d23224691c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:52.324235 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ad7cd-a6ce-468f-aca0-c4d23224691c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:52.324536 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ad7cd-a6ce-468f-aca0-c4d23224691c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:52.390836 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c42474-5c70-4f7a-8d42-9dfd5ed1ad08 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:52.404391 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ad7cd-a6ce-468f-aca0-c4d23224691c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:52.405893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ad7cd-a6ce-468f-aca0-c4d23224691c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:52.427409 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b75ed-05d5-401e-a706-b3c65931880a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:52.428642 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b75ed-05d5-401e-a706-b3c65931880a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:52.428931 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b75ed-05d5-401e-a706-b3c65931880a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:52.429210 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b75ed-05d5-401e-a706-b3c65931880a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:52.501456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b75ed-05d5-401e-a706-b3c65931880a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:52.503011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b75ed-05d5-401e-a706-b3c65931880a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:52.524500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 104/199] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:28:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:28:52.525421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ad7cd-a6ce-468f-aca0-c4d23224691c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:52.605431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 96/200] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:28:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:28:52.606300 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b75ed-05d5-401e-a706-b3c65931880a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:52.664061 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ad7cd-a6ce-468f-aca0-c4d23224691c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:52.699314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad838e5-de46-4946-b29e-d0d78ec4cf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:52.700199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad838e5-de46-4946-b29e-d0d78ec4cf18 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:52.700519 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad838e5-de46-4946-b29e-d0d78ec4cf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:52.700802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad838e5-de46-4946-b29e-d0d78ec4cf18 None admin] PATH_INFO: `/v3/users/28586ae1e93e4b6d9450ab3180b06fc5` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:52.702699 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad838e5-de46-4946-b29e-d0d78ec4cf18 None admin] RBAC: Authorizing `identity:get_user(user_id=28586ae1e93e4b6d9450ab3180b06fc5)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:52.703488 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad838e5-de46-4946-b29e-d0d78ec4cf18 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:52.705496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 105/201] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:52 2022] GET /identity/v3/users/28586ae1e93e4b6d9450ab3180b06fc5 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:52.706289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad838e5-de46-4946-b29e-d0d78ec4cf18 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:52.733332 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b75ed-05d5-401e-a706-b3c65931880a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:52.770113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad24cd-aced-4975-8d96-4336530caf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:52.771831 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad24cd-aced-4975-8d96-4336530caf99 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:52.772297 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad24cd-aced-4975-8d96-4336530caf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:52.772785 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad24cd-aced-4975-8d96-4336530caf99 None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:52.774202 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad24cd-aced-4975-8d96-4336530caf99 None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:52.775893 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad24cd-aced-4975-8d96-4336530caf99 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:52.784096 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 97/202] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:52 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:52.785257 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad24cd-aced-4975-8d96-4336530caf99 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:52.812483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad838e5-de46-4946-b29e-d0d78ec4cf18 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:52.847472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb2355-9b34-46e1-a75b-af56024e2841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:52.848323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb2355-9b34-46e1-a75b-af56024e2841 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:52.848635 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb2355-9b34-46e1-a75b-af56024e2841 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:52.848905 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb2355-9b34-46e1-a75b-af56024e2841 None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:52.850781 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb2355-9b34-46e1-a75b-af56024e2841 None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:52.852250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb2355-9b34-46e1-a75b-af56024e2841 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:52.854156 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 106/203] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:52 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:52.854752 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb2355-9b34-46e1-a75b-af56024e2841 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:52.887264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad24cd-aced-4975-8d96-4336530caf99 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:52.922872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b5706-ce25-4cfb-939e-dfd8a1ac38c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:52.923651 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b5706-ce25-4cfb-939e-dfd8a1ac38c0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:52.924000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b5706-ce25-4cfb-939e-dfd8a1ac38c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:52.924346 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b5706-ce25-4cfb-939e-dfd8a1ac38c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:52.957082 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb2355-9b34-46e1-a75b-af56024e2841 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:52.993133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03117189-4809-4b0b-9065-84a955a9b3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:52.993787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03117189-4809-4b0b-9065-84a955a9b3fa None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:52.994031 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b5706-ce25-4cfb-939e-dfd8a1ac38c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:52.994147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03117189-4809-4b0b-9065-84a955a9b3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:52.994327 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03117189-4809-4b0b-9065-84a955a9b3fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:52.995172 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03117189-4809-4b0b-9065-84a955a9b3fa None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=9d591a594b164a30b9a0094d1803ba23, user.id=e63cebd1573d4f608ff736d8c0828e58) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:52.995483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03117189-4809-4b0b-9065-84a955a9b3fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:52.995603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b5706-ce25-4cfb-939e-dfd8a1ac38c0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:52.997091 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03117189-4809-4b0b-9065-84a955a9b3fa None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:53.002972 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 107/204] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:28:52 2022] GET /identity/v3/role_assignments?user.id=e63cebd1573d4f608ff736d8c0828e58&scope.project.id=9d591a594b164a30b9a0094d1803ba23&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:53.003794 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03117189-4809-4b0b-9065-84a955a9b3fa None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:53.125427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03117189-4809-4b0b-9065-84a955a9b3fa None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:53.166567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a163f7-eb43-4810-9212-2187b890a188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:53.166567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a163f7-eb43-4810-9212-2187b890a188 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:53.166567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a163f7-eb43-4810-9212-2187b890a188 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:53.166567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a163f7-eb43-4810-9212-2187b890a188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:53.166968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a163f7-eb43-4810-9212-2187b890a188 None admin] RBAC: Adding query filter params (role.id=8c1bc4243dcc46979dd8ca40186c0ca7, scope.project.id=9d591a594b164a30b9a0094d1803ba23, user.id=e63cebd1573d4f608ff736d8c0828e58) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:53.166968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a163f7-eb43-4810-9212-2187b890a188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:53.168059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a163f7-eb43-4810-9212-2187b890a188 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:53.175430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 108/205] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:28:53 2022] GET /identity/v3/role_assignments?user.id=e63cebd1573d4f608ff736d8c0828e58&scope.project.id=9d591a594b164a30b9a0094d1803ba23&role.id=8c1bc4243dcc46979dd8ca40186c0ca7 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:53.204073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 98/206] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:28:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:28:53.210987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a163f7-eb43-4810-9212-2187b890a188 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:53.320288 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a163f7-eb43-4810-9212-2187b890a188 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:53.386374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275a402-11a9-4fe1-91ba-158fea1c7918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:53.387186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275a402-11a9-4fe1-91ba-158fea1c7918 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:53.387466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275a402-11a9-4fe1-91ba-158fea1c7918 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:53.387740 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275a402-11a9-4fe1-91ba-158fea1c7918 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:53.389036 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275a402-11a9-4fe1-91ba-158fea1c7918 None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:53.390658 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275a402-11a9-4fe1-91ba-158fea1c7918 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:53.392572 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 109/207] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:53 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:53.398858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b5706-ce25-4cfb-939e-dfd8a1ac38c0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:53.518157 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b5706-ce25-4cfb-939e-dfd8a1ac38c0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:53.556551 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db138ca-78c9-4e2c-9eb3-c9bf6f2856b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:53.557077 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db138ca-78c9-4e2c-9eb3-c9bf6f2856b4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:53.557367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db138ca-78c9-4e2c-9eb3-c9bf6f2856b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:53.557648 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db138ca-78c9-4e2c-9eb3-c9bf6f2856b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:53.558502 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db138ca-78c9-4e2c-9eb3-c9bf6f2856b4 None admin] RBAC: Adding query filter params (role.id=14898ff2d2954978a29cb0b4cb85ba7e, scope.project.id=0c51097d14c64e869f8ce7b3df492b61, user.id=28586ae1e93e4b6d9450ab3180b06fc5) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:53.558819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db138ca-78c9-4e2c-9eb3-c9bf6f2856b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:53.560318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db138ca-78c9-4e2c-9eb3-c9bf6f2856b4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:53.566684 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 99/208] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:28:53 2022] GET /identity/v3/role_assignments?user.id=28586ae1e93e4b6d9450ab3180b06fc5&scope.project.id=0c51097d14c64e869f8ce7b3df492b61&role.id=14898ff2d2954978a29cb0b4cb85ba7e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:54.662747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66b527-221b-4d94-8548-7bf63067d840 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:54.663451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66b527-221b-4d94-8548-7bf63067d840 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:54.663451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66b527-221b-4d94-8548-7bf63067d840 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:54.664762 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 110/209] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:54.669909 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304554b-7ab0-4e84-9416-56704f52aca2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:54.670328 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304554b-7ab0-4e84-9416-56704f52aca2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:54.670501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304554b-7ab0-4e84-9416-56704f52aca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:54.688712 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d304554b-7ab0-4e84-9416-56704f52aca2 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:54.690505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d304554b-7ab0-4e84-9416-56704f52aca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:54.759812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 100/210] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:54.783399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66b527-221b-4d94-8548-7bf63067d840 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:54.892956 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66b527-221b-4d94-8548-7bf63067d840 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:54.931380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c32073-4d36-4133-b976-986ccbd73e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:54.932181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c32073-4d36-4133-b976-986ccbd73e6a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:54.932477 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c32073-4d36-4133-b976-986ccbd73e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:54.932754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c32073-4d36-4133-b976-986ccbd73e6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:54.943053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c32073-4d36-4133-b976-986ccbd73e6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:54.951732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-e3c32073-4d36-4133-b976-986ccbd73e6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:28:54.951732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:54.951732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:54.951732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:54.951732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:54.951732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:54.951732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:54.951732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:54.951732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:54.951732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:54.951732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:54.951732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:54.951732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:54.951732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:54.951732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:54.951732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:54.952616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:54.952616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:54.952616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:54.952616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:54.952616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:54.952616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:54.952616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:54.952616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:54.952616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:54.952616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:54.952616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:54.952616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:28:54.952616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:54.952616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:54.952616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:54.952616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:54.953466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:54.953466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:54.953466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:54.953466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:54.953466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:54.953466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:54.953466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:54.953466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:54.953466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:54.953466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:54.953466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:28:54.953466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:28:54.953466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 111/211] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:54.958830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304554b-7ab0-4e84-9416-56704f52aca2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:54.982925 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044e04-60f3-4771-81ee-c55360d344ba None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:54.983242 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044e04-60f3-4771-81ee-c55360d344ba None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:54.983500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044e04-60f3-4771-81ee-c55360d344ba None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:54.985366 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 112/212] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:28:54.990924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e35f1-1d03-41f7-a9df-d4461974df58 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:54.991532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e35f1-1d03-41f7-a9df-d4461974df58 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:54.992312 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e35f1-1d03-41f7-a9df-d4461974df58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:55.010428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-455e35f1-1d03-41f7-a9df-d4461974df58 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:55.011850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-455e35f1-1d03-41f7-a9df-d4461974df58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:55.060613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304554b-7ab0-4e84-9416-56704f52aca2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:55.086010 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 113/213] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:28:55.105149 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3e317-bd36-4999-a3e7-6e0ec29d5ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:55.106093 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3e317-bd36-4999-a3e7-6e0ec29d5ebd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:55.106526 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3e317-bd36-4999-a3e7-6e0ec29d5ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:55.106948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3e317-bd36-4999-a3e7-6e0ec29d5ebd None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:55.107919 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3e317-bd36-4999-a3e7-6e0ec29d5ebd None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:55.108415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3e317-bd36-4999-a3e7-6e0ec29d5ebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:55.109974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3e317-bd36-4999-a3e7-6e0ec29d5ebd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:55.112787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e35f1-1d03-41f7-a9df-d4461974df58 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:55.120577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 101/214] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:28:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:55.126456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3e317-bd36-4999-a3e7-6e0ec29d5ebd None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:55.215676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e35f1-1d03-41f7-a9df-d4461974df58 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:55.250774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c463ada-98eb-4109-bba3-069235a9ffb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:55.251439 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c463ada-98eb-4109-bba3-069235a9ffb2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:55.251713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c463ada-98eb-4109-bba3-069235a9ffb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:55.251980 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c463ada-98eb-4109-bba3-069235a9ffb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:55.253469 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c463ada-98eb-4109-bba3-069235a9ffb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:55.255272 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c463ada-98eb-4109-bba3-069235a9ffb2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:55.255489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3e317-bd36-4999-a3e7-6e0ec29d5ebd None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:55.262349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 114/215] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:28:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:55.263840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c463ada-98eb-4109-bba3-069235a9ffb2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:55.304917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fabb8-2c90-4af3-b73e-819a9175b78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:55.306180 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fabb8-2c90-4af3-b73e-819a9175b78d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:55.306667 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fabb8-2c90-4af3-b73e-819a9175b78d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:55.307132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fabb8-2c90-4af3-b73e-819a9175b78d None admin] PATH_INFO: `/v3/users/1c81e38c2a054226a77291eedbd1aadd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:55.328499 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fabb8-2c90-4af3-b73e-819a9175b78d None admin] RBAC: Authorizing `identity:get_user(user_id=1c81e38c2a054226a77291eedbd1aadd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:55.330946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fabb8-2c90-4af3-b73e-819a9175b78d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:55.337975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 102/216] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:55 2022] GET /identity/v3/users/1c81e38c2a054226a77291eedbd1aadd => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:55.339169 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fabb8-2c90-4af3-b73e-819a9175b78d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:55.375638 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c463ada-98eb-4109-bba3-069235a9ffb2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:55.409998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f64ac4-2986-4634-a7fb-f6928eeeb483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:55.410670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f64ac4-2986-4634-a7fb-f6928eeeb483 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:55.411081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f64ac4-2986-4634-a7fb-f6928eeeb483 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:55.411270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f64ac4-2986-4634-a7fb-f6928eeeb483 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:55.412562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f64ac4-2986-4634-a7fb-f6928eeeb483 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:55.414361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f64ac4-2986-4634-a7fb-f6928eeeb483 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:55.458275 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fabb8-2c90-4af3-b73e-819a9175b78d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:55.492426 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdc739-7790-45fc-aad2-75e64578314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:55.493022 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdc739-7790-45fc-aad2-75e64578314a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:55.493306 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdc739-7790-45fc-aad2-75e64578314a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:55.493585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdc739-7790-45fc-aad2-75e64578314a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:55.503246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 115/217] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:28:55 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:28:55.504651 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bcf01-964f-4538-b006-33989ff0c811 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:55.504942 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bcf01-964f-4538-b006-33989ff0c811 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:55.505218 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bcf01-964f-4538-b006-33989ff0c811 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:55.511194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 116/218] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:55.512702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6d373-1d84-43ff-ba0d-ed180fbbc719 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:55.513032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6d373-1d84-43ff-ba0d-ed180fbbc719 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:55.513263 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6d373-1d84-43ff-ba0d-ed180fbbc719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:55.540431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c2b6d373-1d84-43ff-ba0d-ed180fbbc719 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:55.542131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c2b6d373-1d84-43ff-ba0d-ed180fbbc719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:55.577714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdc739-7790-45fc-aad2-75e64578314a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:55.579326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdc739-7790-45fc-aad2-75e64578314a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:55.625987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 117/219] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:55.654344 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6d373-1d84-43ff-ba0d-ed180fbbc719 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:55.709607 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 103/220] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:28:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:28:55.714270 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdc739-7790-45fc-aad2-75e64578314a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:55.782887 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6d373-1d84-43ff-ba0d-ed180fbbc719 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:55.827261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda085ee-7f4e-4d9e-bbef-b9e5922f6fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:55.828056 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda085ee-7f4e-4d9e-bbef-b9e5922f6fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:55.828428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda085ee-7f4e-4d9e-bbef-b9e5922f6fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:55.828670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda085ee-7f4e-4d9e-bbef-b9e5922f6fa5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:55.843589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda085ee-7f4e-4d9e-bbef-b9e5922f6fa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:55.844394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdc739-7790-45fc-aad2-75e64578314a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:55.851725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-eda085ee-7f4e-4d9e-bbef-b9e5922f6fa5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:28:55.851725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:55.851725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:55.851725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:55.851725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:55.851725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:55.851725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:55.851725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:55.851725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:55.851725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:55.851725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:55.851725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:55.851725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:55.851725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:55.851725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:55.851725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:55.852674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:55.852674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:55.852674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:55.852674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:55.852674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:55.852674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:55.852674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:55.852674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:55.852674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:55.852674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:55.852674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:55.852674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:28:55.852674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:55.852674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:55.852674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:55.852674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:55.853451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:55.853451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:55.853451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:55.853451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:55.853451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:55.853451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:55.853451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:55.853451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:55.853451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:55.853451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:55.853451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:28:55.853451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:28:55.853451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 118/221] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:28:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:28:55.854615 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a9932-a05b-4c0e-ada4-00538f6577d1 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:55.854899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a9932-a05b-4c0e-ada4-00538f6577d1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:55.855175 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a9932-a05b-4c0e-ada4-00538f6577d1 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:55.856472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 119/222] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:55.858877 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a9932-a05b-4c0e-ada4-00538f6577d1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:55.892247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfa545-9b51-4f91-bd6c-936d959c292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:55.893930 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfa545-9b51-4f91-bd6c-936d959c292e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:55.894368 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfa545-9b51-4f91-bd6c-936d959c292e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:55.894655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfa545-9b51-4f91-bd6c-936d959c292e None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:55.895933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfa545-9b51-4f91-bd6c-936d959c292e None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:55.898029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfa545-9b51-4f91-bd6c-936d959c292e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:55.899778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 104/223] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:55 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:55.902028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cd0c9-8afb-4c36-89ee-d38c33b1ce43 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:55.902549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cd0c9-8afb-4c36-89ee-d38c33b1ce43 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:55.903084 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cd0c9-8afb-4c36-89ee-d38c33b1ce43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:55.921172 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-932cd0c9-8afb-4c36-89ee-d38c33b1ce43 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:55.922684 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-932cd0c9-8afb-4c36-89ee-d38c33b1ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:55.978834 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a9932-a05b-4c0e-ada4-00538f6577d1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:55.994111 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 105/224] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:56.000463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cd0c9-8afb-4c36-89ee-d38c33b1ce43 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:56.017837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd9218-6c09-4bf3-a80c-e42777080451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:56.018819 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd9218-6c09-4bf3-a80c-e42777080451 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:56.019116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd9218-6c09-4bf3-a80c-e42777080451 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:56.019375 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd9218-6c09-4bf3-a80c-e42777080451 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:56.020287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd9218-6c09-4bf3-a80c-e42777080451 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:56.020626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd9218-6c09-4bf3-a80c-e42777080451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:56.022351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd9218-6c09-4bf3-a80c-e42777080451 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:56.034142 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 120/225] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:56.039081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd9218-6c09-4bf3-a80c-e42777080451 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:56.126033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cd0c9-8afb-4c36-89ee-d38c33b1ce43 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:56.164900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd9218-6c09-4bf3-a80c-e42777080451 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:56.169427 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3041bd-b3eb-4bb0-9acd-f9e8eeff1091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:56.170086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3041bd-b3eb-4bb0-9acd-f9e8eeff1091 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:56.170359 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3041bd-b3eb-4bb0-9acd-f9e8eeff1091 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:56.170630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3041bd-b3eb-4bb0-9acd-f9e8eeff1091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:56.171464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3041bd-b3eb-4bb0-9acd-f9e8eeff1091 None admin] RBAC: Adding query filter params (role.id=42b0adbc87e347e18bd4412dc9e421c1, scope.project.id=9d591a594b164a30b9a0094d1803ba23, user.id=1c81e38c2a054226a77291eedbd1aadd) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:56.171771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3041bd-b3eb-4bb0-9acd-f9e8eeff1091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:56.173352 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3041bd-b3eb-4bb0-9acd-f9e8eeff1091 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:56.181323 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 106/226] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:28:55 2022] GET /identity/v3/role_assignments?user.id=1c81e38c2a054226a77291eedbd1aadd&scope.project.id=9d591a594b164a30b9a0094d1803ba23&role.id=42b0adbc87e347e18bd4412dc9e421c1 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:56.182583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3041bd-b3eb-4bb0-9acd-f9e8eeff1091 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:56.203560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161690b-35e2-484b-9cfb-e9482bc146f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:56.205102 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161690b-35e2-484b-9cfb-e9482bc146f7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:56.205581 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161690b-35e2-484b-9cfb-e9482bc146f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:56.206074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161690b-35e2-484b-9cfb-e9482bc146f7 None admin] PATH_INFO: `/v3/users/e63cebd1573d4f608ff736d8c0828e58` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:56.207545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161690b-35e2-484b-9cfb-e9482bc146f7 None admin] RBAC: Authorizing `identity:get_user(user_id=e63cebd1573d4f608ff736d8c0828e58)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:56.209561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161690b-35e2-484b-9cfb-e9482bc146f7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:56.211425 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 121/227] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:56 2022] GET /identity/v3/users/e63cebd1573d4f608ff736d8c0828e58 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:56.218291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161690b-35e2-484b-9cfb-e9482bc146f7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:56.335614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161690b-35e2-484b-9cfb-e9482bc146f7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:56.404473 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c6f9f-806d-4aeb-925a-8a520f4f4135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:56.405738 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c6f9f-806d-4aeb-925a-8a520f4f4135 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:56.406487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c6f9f-806d-4aeb-925a-8a520f4f4135 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:56.406983 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c6f9f-806d-4aeb-925a-8a520f4f4135 None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:56.409806 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c6f9f-806d-4aeb-925a-8a520f4f4135 None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:56.411548 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c6f9f-806d-4aeb-925a-8a520f4f4135 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:56.415156 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 122/228] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:56 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:56.417670 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3041bd-b3eb-4bb0-9acd-f9e8eeff1091 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:56.428491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c6f9f-806d-4aeb-925a-8a520f4f4135 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:56.457135 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679f3c9-6763-4932-b81f-823ca8cb4cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:56.458281 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679f3c9-6763-4932-b81f-823ca8cb4cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:56.458567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679f3c9-6763-4932-b81f-823ca8cb4cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:56.459084 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679f3c9-6763-4932-b81f-823ca8cb4cb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:56.471804 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679f3c9-6763-4932-b81f-823ca8cb4cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:56.480889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5679f3c9-6763-4932-b81f-823ca8cb4cb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:28:56.480889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:56.480889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:56.480889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:56.480889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:56.480889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:56.480889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:56.480889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:56.480889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:56.480889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:56.480889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:56.480889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:56.480889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:56.480889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:56.480889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:56.480889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:56.481826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:56.481826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:56.481826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:56.481826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:56.481826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:56.481826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:56.481826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:56.481826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:56.481826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:56.481826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:56.481826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:56.481826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:56.481826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:56.481826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:56.481826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:56.481826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:56.482582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:56.482582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:56.482582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:56.482582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:56.482582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:56.482582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:56.482582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:56.482582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:56.482582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:56.482582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:56.482582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:28:56.482582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:56.482582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 107/229] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:28:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:28:56.489163 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679f3c9-6763-4932-b81f-823ca8cb4cb1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:56.596370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679f3c9-6763-4932-b81f-823ca8cb4cb1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:56.609304 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c6f9f-806d-4aeb-925a-8a520f4f4135 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:56.632132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576af4b-95aa-4191-93f2-f6e5193479ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:56.632844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576af4b-95aa-4191-93f2-f6e5193479ad None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:56.633122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576af4b-95aa-4191-93f2-f6e5193479ad None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:56.633394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576af4b-95aa-4191-93f2-f6e5193479ad None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:56.634162 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576af4b-95aa-4191-93f2-f6e5193479ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:56.634469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576af4b-95aa-4191-93f2-f6e5193479ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:56.635851 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576af4b-95aa-4191-93f2-f6e5193479ad None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:56.644392 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 108/230] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:28:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:56.647621 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9189d5e-29ea-41f5-85b7-ba5a51d64f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:56.648558 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9189d5e-29ea-41f5-85b7-ba5a51d64f5b None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:56.648994 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9189d5e-29ea-41f5-85b7-ba5a51d64f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:56.649097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9189d5e-29ea-41f5-85b7-ba5a51d64f5b None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23/users/e63cebd1573d4f608ff736d8c0828e58/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:56.650399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576af4b-95aa-4191-93f2-f6e5193479ad None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:56.651075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9189d5e-29ea-41f5-85b7-ba5a51d64f5b None admin] RBAC: Authorizing `identity:create_grant(project_id=9d591a594b164a30b9a0094d1803ba23, user_id=e63cebd1573d4f608ff736d8c0828e58, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:56.652538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9189d5e-29ea-41f5-85b7-ba5a51d64f5b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:56.747181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 123/231] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:28:56 2022] PUT /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23/users/e63cebd1573d4f608ff736d8c0828e58/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:28:56.764740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576af4b-95aa-4191-93f2-f6e5193479ad None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:56.805059 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155483b3-456a-400d-9256-363dfe5c5721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:56.806536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155483b3-456a-400d-9256-363dfe5c5721 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:56.807064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155483b3-456a-400d-9256-363dfe5c5721 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:56.807596 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155483b3-456a-400d-9256-363dfe5c5721 None admin] PATH_INFO: `/v3/users/e63cebd1573d4f608ff736d8c0828e58` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:56.809542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155483b3-456a-400d-9256-363dfe5c5721 None admin] RBAC: Authorizing `identity:get_user(user_id=e63cebd1573d4f608ff736d8c0828e58)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:56.811385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155483b3-456a-400d-9256-363dfe5c5721 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:56.813821 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 109/232] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:56 2022] GET /identity/v3/users/e63cebd1573d4f608ff736d8c0828e58 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:56.820557 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9189d5e-29ea-41f5-85b7-ba5a51d64f5b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:56.984894 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9189d5e-29ea-41f5-85b7-ba5a51d64f5b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:57.030090 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e38f09-78c0-4596-993a-93c953c99bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:57.030957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e38f09-78c0-4596-993a-93c953c99bfb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:57.031232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e38f09-78c0-4596-993a-93c953c99bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:57.031506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e38f09-78c0-4596-993a-93c953c99bfb None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:57.037810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e38f09-78c0-4596-993a-93c953c99bfb None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:57.039274 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e38f09-78c0-4596-993a-93c953c99bfb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:57.041124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 124/233] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:56 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:57.046950 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155483b3-456a-400d-9256-363dfe5c5721 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:57.166298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155483b3-456a-400d-9256-363dfe5c5721 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:57.216679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f9303-2d56-43ce-bd75-24c6a3b8ddc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:57.217710 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f9303-2d56-43ce-bd75-24c6a3b8ddc0 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:57.218045 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f9303-2d56-43ce-bd75-24c6a3b8ddc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:57.218394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f9303-2d56-43ce-bd75-24c6a3b8ddc0 None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23/users/e63cebd1573d4f608ff736d8c0828e58/roles/8c1bc4243dcc46979dd8ca40186c0ca7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:57.225206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f9303-2d56-43ce-bd75-24c6a3b8ddc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d591a594b164a30b9a0094d1803ba23, user_id=e63cebd1573d4f608ff736d8c0828e58, role_id=8c1bc4243dcc46979dd8ca40186c0ca7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:57.226719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f9303-2d56-43ce-bd75-24c6a3b8ddc0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:57.326518 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 110/234] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:28:57 2022] PUT /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23/users/e63cebd1573d4f608ff736d8c0828e58/roles/8c1bc4243dcc46979dd8ca40186c0ca7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:28:58.233229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ca005-6e54-4f25-a8bc-9b607d4a4c93 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:58.233777 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ca005-6e54-4f25-a8bc-9b607d4a4c93 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:58.233777 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ca005-6e54-4f25-a8bc-9b607d4a4c93 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:58.235264 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 125/235] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:58.258456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254f684-af1b-4c4b-8122-5a1b2f39def6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:58.258952 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254f684-af1b-4c4b-8122-5a1b2f39def6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:58.259026 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254f684-af1b-4c4b-8122-5a1b2f39def6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:58.280297 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0254f684-af1b-4c4b-8122-5a1b2f39def6 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:58.281514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0254f684-af1b-4c4b-8122-5a1b2f39def6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:58.342920 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d537d7-dc06-4e6d-98c9-75434665c043 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:58.343199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d537d7-dc06-4e6d-98c9-75434665c043 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:58.343471 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d537d7-dc06-4e6d-98c9-75434665c043 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:58.345155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 126/236] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:58.350537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73739c-6aa1-4b0b-b975-6c6d1071ea75 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:58.350814 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73739c-6aa1-4b0b-b975-6c6d1071ea75 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:58.351085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73739c-6aa1-4b0b-b975-6c6d1071ea75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:58.381745 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-af73739c-6aa1-4b0b-b975-6c6d1071ea75 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:58.385544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-af73739c-6aa1-4b0b-b975-6c6d1071ea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:58.388751 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 111/237] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:58.424169 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254f684-af1b-4c4b-8122-5a1b2f39def6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:58.461774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 127/238] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:58.509082 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73739c-6aa1-4b0b-b975-6c6d1071ea75 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:58.628720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73739c-6aa1-4b0b-b975-6c6d1071ea75 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:58.658771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254f684-af1b-4c4b-8122-5a1b2f39def6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:58.668342 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dbc26-86b9-4f96-bdbd-177389b3aaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:58.669445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dbc26-86b9-4f96-bdbd-177389b3aaea None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:58.669947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dbc26-86b9-4f96-bdbd-177389b3aaea None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:58.670416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dbc26-86b9-4f96-bdbd-177389b3aaea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:58.672241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dbc26-86b9-4f96-bdbd-177389b3aaea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:58.673911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dbc26-86b9-4f96-bdbd-177389b3aaea None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:58.676046 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 128/239] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:28:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:58.683095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dbc26-86b9-4f96-bdbd-177389b3aaea None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:58.712893 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e96d3-c342-4166-a59f-9d9121a29440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:58.713690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e96d3-c342-4166-a59f-9d9121a29440 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:58.713970 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e96d3-c342-4166-a59f-9d9121a29440 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:58.714243 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e96d3-c342-4166-a59f-9d9121a29440 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:58.732164 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e96d3-c342-4166-a59f-9d9121a29440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:58.739888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e81e96d3-c342-4166-a59f-9d9121a29440 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:28:58.739888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:58.739888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:58.739888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:58.739888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:58.739888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:58.739888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:58.739888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:58.739888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:58.739888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:58.739888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:58.739888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:58.739888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:58.739888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:58.739888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:58.739888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:58.741338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:58.741338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:58.741338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:58.741338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:58.741338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:58.741338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:58.741338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:58.741338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:58.741338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:58.741338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:58.741338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:58.741338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:58.741338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:58.741338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:58.741338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:58.741338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:58.742126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:58.742126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:58.742126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:58.742126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:58.742126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:58.742126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:58.742126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:58.742126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:58.742126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:58.742126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:58.742126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:28:58.742126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:58.742963 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 112/240] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:28:58.753440 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e96d3-c342-4166-a59f-9d9121a29440 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:58.824225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dbc26-86b9-4f96-bdbd-177389b3aaea None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:58.873274 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b04ad-3512-4228-aa07-77f4d3d9c38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:58.874376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b04ad-3512-4228-aa07-77f4d3d9c38f None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:58.874860 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b04ad-3512-4228-aa07-77f4d3d9c38f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:58.875358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b04ad-3512-4228-aa07-77f4d3d9c38f None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:58.876287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b04ad-3512-4228-aa07-77f4d3d9c38f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:58.878027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b04ad-3512-4228-aa07-77f4d3d9c38f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:58.925713 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e96d3-c342-4166-a59f-9d9121a29440 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:58.963221 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a2213-c9be-4be5-a2a2-063d9c696c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:58.963903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a2213-c9be-4be5-a2a2-063d9c696c15 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:58.964188 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a2213-c9be-4be5-a2a2-063d9c696c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:58.964480 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a2213-c9be-4be5-a2a2-063d9c696c15 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:58.968475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a2213-c9be-4be5-a2a2-063d9c696c15 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:58.968475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a2213-c9be-4be5-a2a2-063d9c696c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:58.968475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a2213-c9be-4be5-a2a2-063d9c696c15 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:58.972389 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 129/241] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:28:58 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:28:58.984997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 113/242] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:28:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:58.991268 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b04ad-3512-4228-aa07-77f4d3d9c38f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:59.050538 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81055e0e-5d37-4268-aa11-4baa1c6d20d4 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:59.050879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81055e0e-5d37-4268-aa11-4baa1c6d20d4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:59.051117 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81055e0e-5d37-4268-aa11-4baa1c6d20d4 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:59.052926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 114/243] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:28:59.059158 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274b0a1-8aa9-4bd5-9136-1388881ad223 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:59.059454 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274b0a1-8aa9-4bd5-9136-1388881ad223 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:59.059738 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274b0a1-8aa9-4bd5-9136-1388881ad223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:59.080676 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1274b0a1-8aa9-4bd5-9136-1388881ad223 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:59.082008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1274b0a1-8aa9-4bd5-9136-1388881ad223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:59.178357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 115/244] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:28:59.206062 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274b0a1-8aa9-4bd5-9136-1388881ad223 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:59.221640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b04ad-3512-4228-aa07-77f4d3d9c38f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:59.265207 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6a0fb-9bb3-4483-8a5a-0ae84972f61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:59.266080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6a0fb-9bb3-4483-8a5a-0ae84972f61e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:59.266551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6a0fb-9bb3-4483-8a5a-0ae84972f61e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:59.266969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6a0fb-9bb3-4483-8a5a-0ae84972f61e None admin] PATH_INFO: `/v3/users/d666a2339cd2423fbaa7b372f0e60c60` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:59.281882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6a0fb-9bb3-4483-8a5a-0ae84972f61e None admin] RBAC: Authorizing `identity:get_user(user_id=d666a2339cd2423fbaa7b372f0e60c60)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:59.283908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6a0fb-9bb3-4483-8a5a-0ae84972f61e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:59.286156 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 130/245] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:58 2022] GET /identity/v3/users/d666a2339cd2423fbaa7b372f0e60c60 => generated 297 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:59.293060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6a0fb-9bb3-4483-8a5a-0ae84972f61e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:59.346403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274b0a1-8aa9-4bd5-9136-1388881ad223 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:59.390074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dffd48-5813-4a1b-9efc-cd089fc6a3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:59.390878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dffd48-5813-4a1b-9efc-cd089fc6a3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:59.391160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dffd48-5813-4a1b-9efc-cd089fc6a3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:59.391438 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dffd48-5813-4a1b-9efc-cd089fc6a3e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:59.402665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dffd48-5813-4a1b-9efc-cd089fc6a3e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:28:59.410977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e6dffd48-5813-4a1b-9efc-cd089fc6a3e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:28:59.410977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:28:59.410977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:28:59.410977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:28:59.410977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:28:59.410977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:28:59.410977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:28:59.410977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:28:59.410977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:28:59.410977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:28:59.410977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:28:59.410977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:28:59.410977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:28:59.410977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:28:59.410977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:28:59.410977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:28:59.411938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:28:59.411938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:28:59.411938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:28:59.411938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:28:59.411938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:28:59.411938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:28:59.411938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:28:59.411938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:28:59.411938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:28:59.411938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:28:59.411938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:28:59.411938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:28:59.411938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:28:59.411938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:28:59.411938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:28:59.411938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:28:59.413345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:28:59.413345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:28:59.413345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:28:59.413345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:28:59.413345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:28:59.413345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:28:59.413345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:28:59.413345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:28:59.413345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:28:59.413345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:28:59.413345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:28:59.413345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:28:59.416313 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 116/246] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:28:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:28:59.421798 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dffd48-5813-4a1b-9efc-cd089fc6a3e2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:59.439235 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6a0fb-9bb3-4483-8a5a-0ae84972f61e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:59.493411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be5657-f138-4bfe-a4cd-d0bf863856de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:59.494427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be5657-f138-4bfe-a4cd-d0bf863856de None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:59.494926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be5657-f138-4bfe-a4cd-d0bf863856de None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:59.495396 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be5657-f138-4bfe-a4cd-d0bf863856de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:59.563961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dffd48-5813-4a1b-9efc-cd089fc6a3e2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:59.587543 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be5657-f138-4bfe-a4cd-d0bf863856de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:59.589281 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be5657-f138-4bfe-a4cd-d0bf863856de None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:59.606144 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7560b17-9d0a-4949-905a-3b06957157d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:59.607137 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7560b17-9d0a-4949-905a-3b06957157d1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:59.607582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7560b17-9d0a-4949-905a-3b06957157d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:59.608015 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7560b17-9d0a-4949-905a-3b06957157d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:59.608992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7560b17-9d0a-4949-905a-3b06957157d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:28:59.611839 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7560b17-9d0a-4949-905a-3b06957157d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:59.611839 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7560b17-9d0a-4949-905a-3b06957157d1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:59.623193 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 117/247] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:28:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:59.629482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7560b17-9d0a-4949-905a-3b06957157d1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:59.712811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 131/248] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:28:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:28:59.714778 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be5657-f138-4bfe-a4cd-d0bf863856de None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:59.755637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7560b17-9d0a-4949-905a-3b06957157d1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:59.803953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fdd84-1bed-4297-a7ee-67d9c477e63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:59.805556 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fdd84-1bed-4297-a7ee-67d9c477e63a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:59.805986 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fdd84-1bed-4297-a7ee-67d9c477e63a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:59.806424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fdd84-1bed-4297-a7ee-67d9c477e63a None admin] PATH_INFO: `/v3/users/1c81e38c2a054226a77291eedbd1aadd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:59.808203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fdd84-1bed-4297-a7ee-67d9c477e63a None admin] RBAC: Authorizing `identity:get_user(user_id=1c81e38c2a054226a77291eedbd1aadd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:59.810516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fdd84-1bed-4297-a7ee-67d9c477e63a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:59.812648 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 118/249] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:28:59 2022] GET /identity/v3/users/1c81e38c2a054226a77291eedbd1aadd => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:28:59.814542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc736a-06f7-4cde-a070-3759cc2ed0c7 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:59.815243 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc736a-06f7-4cde-a070-3759cc2ed0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:59.815663 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc736a-06f7-4cde-a070-3759cc2ed0c7 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:59.817569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 119/250] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:28:59.819088 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc736a-06f7-4cde-a070-3759cc2ed0c7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:28:59.838650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be5657-f138-4bfe-a4cd-d0bf863856de None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:28:59.875413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ccf26-6e69-4581-9cc7-d75a2da81961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:28:59.876610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ccf26-6e69-4581-9cc7-d75a2da81961 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:59.877070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ccf26-6e69-4581-9cc7-d75a2da81961 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:59.877518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ccf26-6e69-4581-9cc7-d75a2da81961 None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:59.878913 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ccf26-6e69-4581-9cc7-d75a2da81961 None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:28:59.881969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ccf26-6e69-4581-9cc7-d75a2da81961 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:28:59.885270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 132/251] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:59 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:28:59.886668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485b697-c912-46b7-80be-df256fb0f6d8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:28:59.887147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485b697-c912-46b7-80be-df256fb0f6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:28:59.887612 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485b697-c912-46b7-80be-df256fb0f6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:28:59.907868 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8485b697-c912-46b7-80be-df256fb0f6d8 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:28:59.909918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8485b697-c912-46b7-80be-df256fb0f6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:28:59.947562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc736a-06f7-4cde-a070-3759cc2ed0c7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:00.004586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 133/252] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:00.006539 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485b697-c912-46b7-80be-df256fb0f6d8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:00.026268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13be657-20f6-471e-a346-de1eac3831f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:00.027509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13be657-20f6-471e-a346-de1eac3831f4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:00.027989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13be657-20f6-471e-a346-de1eac3831f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:00.028575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13be657-20f6-471e-a346-de1eac3831f4 None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:00.030144 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13be657-20f6-471e-a346-de1eac3831f4 None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:00.033893 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13be657-20f6-471e-a346-de1eac3831f4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:00.041661 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 120/253] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:28:59 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:00.048101 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13be657-20f6-471e-a346-de1eac3831f4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:00.176088 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13be657-20f6-471e-a346-de1eac3831f4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:00.214519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983eb4bc-0f52-4655-8c07-acf10f2f9f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:00.217357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eb4bc-0f52-4655-8c07-acf10f2f9f77 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:00.217846 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eb4bc-0f52-4655-8c07-acf10f2f9f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:00.218319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eb4bc-0f52-4655-8c07-acf10f2f9f77 None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23/users/1c81e38c2a054226a77291eedbd1aadd/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:00.222047 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983eb4bc-0f52-4655-8c07-acf10f2f9f77 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d591a594b164a30b9a0094d1803ba23, user_id=1c81e38c2a054226a77291eedbd1aadd, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:00.223866 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983eb4bc-0f52-4655-8c07-acf10f2f9f77 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:00.244799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485b697-c912-46b7-80be-df256fb0f6d8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:00.280570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bacae-8c18-4861-9c60-f7a551f33772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:00.281263 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bacae-8c18-4861-9c60-f7a551f33772 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:00.281495 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bacae-8c18-4861-9c60-f7a551f33772 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:00.281767 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bacae-8c18-4861-9c60-f7a551f33772 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:00.282614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bacae-8c18-4861-9c60-f7a551f33772 None admin] RBAC: Adding query filter params (role.id=14898ff2d2954978a29cb0b4cb85ba7e, scope.project.id=9d591a594b164a30b9a0094d1803ba23, user.id=d666a2339cd2423fbaa7b372f0e60c60) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:00.283288 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bacae-8c18-4861-9c60-f7a551f33772 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:00.284403 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bacae-8c18-4861-9c60-f7a551f33772 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:00.290333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 134/254] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:29:00 2022] GET /identity/v3/role_assignments?user.id=d666a2339cd2423fbaa7b372f0e60c60&scope.project.id=9d591a594b164a30b9a0094d1803ba23&role.id=14898ff2d2954978a29cb0b4cb85ba7e => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:00.291548 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bacae-8c18-4861-9c60-f7a551f33772 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:00.316301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 121/255] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:29:00 2022] PUT /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23/users/1c81e38c2a054226a77291eedbd1aadd/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:29:00.318125 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b891d-45d7-44c8-97d7-615bfab3a5d5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:00.319041 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b891d-45d7-44c8-97d7-615bfab3a5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:00.319379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b891d-45d7-44c8-97d7-615bfab3a5d5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:00.325823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 122/256] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:00.331466 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c41b5b-4a7c-4f09-adbe-ceaabf866e4e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:00.331757 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c41b5b-4a7c-4f09-adbe-ceaabf866e4e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:00.332027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c41b5b-4a7c-4f09-adbe-ceaabf866e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:00.385615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-58c41b5b-4a7c-4f09-adbe-ceaabf866e4e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:00.386822 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-58c41b5b-4a7c-4f09-adbe-ceaabf866e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:00.423498 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bacae-8c18-4861-9c60-f7a551f33772 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:00.464149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337efae-9cb8-4cc3-bd69-613d46dfaea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:00.464895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337efae-9cb8-4cc3-bd69-613d46dfaea5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:00.465167 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337efae-9cb8-4cc3-bd69-613d46dfaea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:00.465436 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337efae-9cb8-4cc3-bd69-613d46dfaea5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:00.478479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337efae-9cb8-4cc3-bd69-613d46dfaea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:00.486815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7337efae-9cb8-4cc3-bd69-613d46dfaea5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:29:00.486815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:00.486815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:00.486815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:00.486815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:00.486815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:00.486815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:00.486815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:00.486815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:00.486815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:00.486815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:00.486815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:00.486815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:00.486815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:00.486815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:00.486815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:00.487747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:00.487747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:00.487747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:00.487747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:00.487747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:00.487747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:00.487747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:00.487747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:00.487747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:00.487747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:00.487747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:00.487747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:00.487747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:00.487747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:00.487747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:00.487747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:00.489273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:00.489273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:00.489273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:00.489273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:00.489273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:00.489273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:00.489273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:00.489273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:00.489273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:00.489273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:00.489273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:29:00.489273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:00.489273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 135/257] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:29:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:00.494566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337efae-9cb8-4cc3-bd69-613d46dfaea5 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:00.570713 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 123/258] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:00.609044 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c41b5b-4a7c-4f09-adbe-ceaabf866e4e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:00.610501 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337efae-9cb8-4cc3-bd69-613d46dfaea5 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:00.651582 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9014a6-015c-411a-824c-e10666062f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:00.652259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9014a6-015c-411a-824c-e10666062f3f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:00.652561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9014a6-015c-411a-824c-e10666062f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:00.652836 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9014a6-015c-411a-824c-e10666062f3f None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:00.653620 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9014a6-015c-411a-824c-e10666062f3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:00.655095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9014a6-015c-411a-824c-e10666062f3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:00.656571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9014a6-015c-411a-824c-e10666062f3f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:00.675172 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 136/259] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:00.681761 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9014a6-015c-411a-824c-e10666062f3f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:00.818569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9014a6-015c-411a-824c-e10666062f3f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:00.828486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c41b5b-4a7c-4f09-adbe-ceaabf866e4e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:00.858810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b65d54-e8fc-4b3e-b513-93107680de1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:00.860045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b65d54-e8fc-4b3e-b513-93107680de1b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:00.860581 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b65d54-e8fc-4b3e-b513-93107680de1b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:00.861052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b65d54-e8fc-4b3e-b513-93107680de1b None admin] PATH_INFO: `/v3/users/e63cebd1573d4f608ff736d8c0828e58` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:00.862491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b65d54-e8fc-4b3e-b513-93107680de1b None admin] RBAC: Authorizing `identity:get_user(user_id=e63cebd1573d4f608ff736d8c0828e58)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:00.864128 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b65d54-e8fc-4b3e-b513-93107680de1b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:00.867244 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 137/260] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:29:00 2022] GET /identity/v3/users/e63cebd1573d4f608ff736d8c0828e58 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:00.880473 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b65d54-e8fc-4b3e-b513-93107680de1b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:00.901178 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a2d78-66b1-4a43-9d53-57df9cd0e300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:00.901996 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a2d78-66b1-4a43-9d53-57df9cd0e300 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:00.902332 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a2d78-66b1-4a43-9d53-57df9cd0e300 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:00.902608 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a2d78-66b1-4a43-9d53-57df9cd0e300 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:00.925359 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a2d78-66b1-4a43-9d53-57df9cd0e300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:00.938242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-936a2d78-66b1-4a43-9d53-57df9cd0e300 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:29:00.938242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:00.938242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:00.938242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:00.938242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:00.938242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:00.938242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:00.938242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:00.938242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:00.938242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:00.938242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:00.938242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:00.938242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:00.938242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:00.938242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:00.938242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:00.939160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:00.939160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:00.939160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:00.939160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:00.939160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:00.939160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:00.939160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:00.939160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:00.939160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:00.939160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:00.939160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:00.939160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:00.939160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:00.939160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:00.939160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:00.939160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:00.940577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:00.940577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:00.940577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:00.940577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:00.940577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:00.940577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:00.940577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:00.940577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:00.940577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:00.940577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:00.940577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:29:00.940577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:00.940577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 124/261] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:29:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:29:00.948578 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a2d78-66b1-4a43-9d53-57df9cd0e300 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:01.096116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b65d54-e8fc-4b3e-b513-93107680de1b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:01.108617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a2d78-66b1-4a43-9d53-57df9cd0e300 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:01.146067 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e800bd7-1cf8-4a50-855c-41724d8fd8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:01.147291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e800bd7-1cf8-4a50-855c-41724d8fd8ed None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:01.147574 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e800bd7-1cf8-4a50-855c-41724d8fd8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:01.147886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e800bd7-1cf8-4a50-855c-41724d8fd8ed None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:01.148632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e800bd7-1cf8-4a50-855c-41724d8fd8ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:01.148944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e800bd7-1cf8-4a50-855c-41724d8fd8ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:01.150342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e800bd7-1cf8-4a50-855c-41724d8fd8ed None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:01.166454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f91352-6a36-47d7-853a-fe74c5e8bd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:01.167113 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f91352-6a36-47d7-853a-fe74c5e8bd7d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:01.167603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f91352-6a36-47d7-853a-fe74c5e8bd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:01.168035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f91352-6a36-47d7-853a-fe74c5e8bd7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:01.172830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 125/262] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:01.181929 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e800bd7-1cf8-4a50-855c-41724d8fd8ed None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:01.312481 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f91352-6a36-47d7-853a-fe74c5e8bd7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:01.313956 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f91352-6a36-47d7-853a-fe74c5e8bd7d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:01.424046 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e800bd7-1cf8-4a50-855c-41724d8fd8ed None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:01.497144 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8236e-0b47-4a1b-9b26-d1f5dced6308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:01.498088 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8236e-0b47-4a1b-9b26-d1f5dced6308 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:01.498378 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8236e-0b47-4a1b-9b26-d1f5dced6308 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:01.498648 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8236e-0b47-4a1b-9b26-d1f5dced6308 None admin] PATH_INFO: `/v3/users/e63cebd1573d4f608ff736d8c0828e58` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:01.499883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8236e-0b47-4a1b-9b26-d1f5dced6308 None admin] RBAC: Authorizing `identity:get_user(user_id=e63cebd1573d4f608ff736d8c0828e58)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:01.501361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8236e-0b47-4a1b-9b26-d1f5dced6308 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:01.502990 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 126/263] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:29:01 2022] GET /identity/v3/users/e63cebd1573d4f608ff736d8c0828e58 => generated 283 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:01.511297 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8236e-0b47-4a1b-9b26-d1f5dced6308 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:01.514910 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 138/264] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:01.520411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f91352-6a36-47d7-853a-fe74c5e8bd7d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:01.727357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f91352-6a36-47d7-853a-fe74c5e8bd7d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:01.727527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8236e-0b47-4a1b-9b26-d1f5dced6308 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:01.768185 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6569794-128e-48f9-810b-6aae8c953c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:01.769160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6569794-128e-48f9-810b-6aae8c953c27 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:01.769443 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6569794-128e-48f9-810b-6aae8c953c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:01.769724 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6569794-128e-48f9-810b-6aae8c953c27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:01.809188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf2807-70e8-41a9-aa7f-929e23dd8c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:01.810109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf2807-70e8-41a9-aa7f-929e23dd8c08 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:01.810391 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf2807-70e8-41a9-aa7f-929e23dd8c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:01.810662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf2807-70e8-41a9-aa7f-929e23dd8c08 None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:01.811911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf2807-70e8-41a9-aa7f-929e23dd8c08 None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:01.813397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf2807-70e8-41a9-aa7f-929e23dd8c08 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:01.815175 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 139/265] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:01 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:01.821363 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf2807-70e8-41a9-aa7f-929e23dd8c08 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:01.845144 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6569794-128e-48f9-810b-6aae8c953c27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:01.847176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6569794-128e-48f9-810b-6aae8c953c27 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:01.961291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 127/266] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 17:29:01.967113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6569794-128e-48f9-810b-6aae8c953c27 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:02.061077 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf2807-70e8-41a9-aa7f-929e23dd8c08 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:02.081366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6569794-128e-48f9-810b-6aae8c953c27 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:02.121037 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ee2d9-66a5-4dc5-9eb1-a94755c8093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:02.121974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ee2d9-66a5-4dc5-9eb1-a94755c8093f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:02.122591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ee2d9-66a5-4dc5-9eb1-a94755c8093f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:02.122870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ee2d9-66a5-4dc5-9eb1-a94755c8093f None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:02.124549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ee2d9-66a5-4dc5-9eb1-a94755c8093f None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:02.126595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ee2d9-66a5-4dc5-9eb1-a94755c8093f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:02.128592 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 128/267] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:01 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:02.130318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cea49-c1f1-40e5-bda7-03823a18c6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:02.131097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cea49-c1f1-40e5-bda7-03823a18c6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:02.131473 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cea49-c1f1-40e5-bda7-03823a18c6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:02.131886 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cea49-c1f1-40e5-bda7-03823a18c6f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:02.133013 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cea49-c1f1-40e5-bda7-03823a18c6f6 None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=9d591a594b164a30b9a0094d1803ba23, user.id=e63cebd1573d4f608ff736d8c0828e58) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:02.133708 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cea49-c1f1-40e5-bda7-03823a18c6f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:02.134393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ee2d9-66a5-4dc5-9eb1-a94755c8093f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:02.135268 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cea49-c1f1-40e5-bda7-03823a18c6f6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:02.141692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 140/268] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:29:01 2022] GET /identity/v3/role_assignments?user.id=e63cebd1573d4f608ff736d8c0828e58&scope.project.id=9d591a594b164a30b9a0094d1803ba23&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:02.244293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ee2d9-66a5-4dc5-9eb1-a94755c8093f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:02.280971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f56ce-7c9e-4a26-a889-dc5cd887a4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:02.281653 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f56ce-7c9e-4a26-a889-dc5cd887a4bd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:02.281936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f56ce-7c9e-4a26-a889-dc5cd887a4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:02.282219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f56ce-7c9e-4a26-a889-dc5cd887a4bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:02.283082 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f56ce-7c9e-4a26-a889-dc5cd887a4bd None admin] RBAC: Adding query filter params (role.id=8c1bc4243dcc46979dd8ca40186c0ca7, scope.project.id=9d591a594b164a30b9a0094d1803ba23, user.id=e63cebd1573d4f608ff736d8c0828e58) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:02.283397 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f56ce-7c9e-4a26-a889-dc5cd887a4bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:02.284923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f56ce-7c9e-4a26-a889-dc5cd887a4bd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:02.293165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 129/269] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:29:02 2022] GET /identity/v3/role_assignments?user.id=e63cebd1573d4f608ff736d8c0828e58&scope.project.id=9d591a594b164a30b9a0094d1803ba23&role.id=8c1bc4243dcc46979dd8ca40186c0ca7 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:02.532467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab7eb2-03db-474b-b2f3-4d1de47c0c99 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:02.532467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab7eb2-03db-474b-b2f3-4d1de47c0c99 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:02.532467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab7eb2-03db-474b-b2f3-4d1de47c0c99 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:02.533730 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 141/270] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:02.539822 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e523d7-02bd-4497-acc2-bfb203b288a4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:02.540796 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e523d7-02bd-4497-acc2-bfb203b288a4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:02.541383 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e523d7-02bd-4497-acc2-bfb203b288a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:02.562150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-29e523d7-02bd-4497-acc2-bfb203b288a4 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:02.563653 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-29e523d7-02bd-4497-acc2-bfb203b288a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:02.645452 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 130/271] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:29:02.676387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab7eb2-03db-474b-b2f3-4d1de47c0c99 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:02.678928 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0434e-2e1f-48bb-ae6d-09db037671bc None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:02.679224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0434e-2e1f-48bb-ae6d-09db037671bc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:02.679504 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0434e-2e1f-48bb-ae6d-09db037671bc None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:02.681114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 131/272] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:29:02.693825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c9fa2-f9ab-4ff3-9594-4bcf70845e41 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:02.694142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c9fa2-f9ab-4ff3-9594-4bcf70845e41 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:02.694392 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c9fa2-f9ab-4ff3-9594-4bcf70845e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:02.718611 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a87c9fa2-f9ab-4ff3-9594-4bcf70845e41 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:02.719824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a87c9fa2-f9ab-4ff3-9594-4bcf70845e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:02.820883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 132/273] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:29:02.830376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab7eb2-03db-474b-b2f3-4d1de47c0c99 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:02.849113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c9fa2-f9ab-4ff3-9594-4bcf70845e41 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:02.869082 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8346d-2bd5-4d61-8610-735e7bd44642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:02.870163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8346d-2bd5-4d61-8610-735e7bd44642 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:02.870445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8346d-2bd5-4d61-8610-735e7bd44642 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:02.870720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8346d-2bd5-4d61-8610-735e7bd44642 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:02.884219 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8346d-2bd5-4d61-8610-735e7bd44642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:02.893720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-11b8346d-2bd5-4d61-8610-735e7bd44642 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:02.893720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:02.893720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:02.893720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:02.893720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:02.893720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:02.893720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:02.893720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:02.893720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:02.893720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:02.893720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:02.893720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:02.893720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:02.893720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:02.893720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:02.893720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:02.894596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:02.894596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:02.894596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:02.894596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:02.894596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:02.894596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:02.894596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:02.894596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:02.894596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:02.894596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:02.894596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:02.894596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:02.894596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:02.894596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:02.894596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:02.894596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:02.895357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:02.895357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:02.895357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:02.895357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:02.895357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:02.895357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:02.895357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:02.895357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:02.895357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:02.895357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:02.895357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:02.895357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:02.896657 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 142/274] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:02.901125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8346d-2bd5-4d61-8610-735e7bd44642 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:02.958577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c9fa2-f9ab-4ff3-9594-4bcf70845e41 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:02.993520 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf5a40-9ca5-426b-81ae-5a130ef7b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:02.994316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf5a40-9ca5-426b-81ae-5a130ef7b641 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:02.994598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf5a40-9ca5-426b-81ae-5a130ef7b641 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:02.994871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf5a40-9ca5-426b-81ae-5a130ef7b641 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:02.996050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf5a40-9ca5-426b-81ae-5a130ef7b641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:02.997536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf5a40-9ca5-426b-81ae-5a130ef7b641 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:03.003726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 133/275] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:03.007622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf5a40-9ca5-426b-81ae-5a130ef7b641 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:03.036198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8346d-2bd5-4d61-8610-735e7bd44642 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:03.071908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c937193-3287-448f-94b3-286565cc07c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:03.072909 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c937193-3287-448f-94b3-286565cc07c3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:03.073368 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c937193-3287-448f-94b3-286565cc07c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:03.073715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c937193-3287-448f-94b3-286565cc07c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:03.074535 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c937193-3287-448f-94b3-286565cc07c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:03.075072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c937193-3287-448f-94b3-286565cc07c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:03.077186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c937193-3287-448f-94b3-286565cc07c3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:03.092690 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 143/276] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:29:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:03.094566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c937193-3287-448f-94b3-286565cc07c3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:03.122206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf5a40-9ca5-426b-81ae-5a130ef7b641 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:03.157701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd341766-591e-4c53-b303-511c7a31d749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:03.158444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd341766-591e-4c53-b303-511c7a31d749 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:03.158734 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd341766-591e-4c53-b303-511c7a31d749 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:03.159103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd341766-591e-4c53-b303-511c7a31d749 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:03.159896 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd341766-591e-4c53-b303-511c7a31d749 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:03.161445 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd341766-591e-4c53-b303-511c7a31d749 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:03.204124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c937193-3287-448f-94b3-286565cc07c3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:03.241355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebb50f-4dda-4f35-b98e-f923bd612bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:03.242250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebb50f-4dda-4f35-b98e-f923bd612bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:03.242528 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebb50f-4dda-4f35-b98e-f923bd612bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:03.242797 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebb50f-4dda-4f35-b98e-f923bd612bb0 None admin] PATH_INFO: `/v3/users/b3392a69343841c38d42ab9da00ca76e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:03.262566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebb50f-4dda-4f35-b98e-f923bd612bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=b3392a69343841c38d42ab9da00ca76e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:03.272480 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 134/277] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:29:03 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:29:03.272758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebb50f-4dda-4f35-b98e-f923bd612bb0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:03.274016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 144/278] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:29:03 2022] GET /identity/v3/users/b3392a69343841c38d42ab9da00ca76e => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:03.280654 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd341766-591e-4c53-b303-511c7a31d749 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:03.407838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd341766-591e-4c53-b303-511c7a31d749 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:03.439873 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78bccc-200c-4ea7-a8b0-135945ff95fb None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:03.440213 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78bccc-200c-4ea7-a8b0-135945ff95fb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:03.440418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78bccc-200c-4ea7-a8b0-135945ff95fb None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:03.442092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 145/279] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:03.445726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439168d9-6188-4c86-a5dc-343caddc6e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:03.446477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439168d9-6188-4c86-a5dc-343caddc6e0e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:03.446768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439168d9-6188-4c86-a5dc-343caddc6e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:03.447043 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439168d9-6188-4c86-a5dc-343caddc6e0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:03.447900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439168d9-6188-4c86-a5dc-343caddc6e0e None admin] RBAC: Adding query filter params (role.id=42b0adbc87e347e18bd4412dc9e421c1, user.id=b3392a69343841c38d42ab9da00ca76e, scope.system=all) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:03.448163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287e191-7bfb-493a-86c5-5f0621082504 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:03.448264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439168d9-6188-4c86-a5dc-343caddc6e0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:03.448464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287e191-7bfb-493a-86c5-5f0621082504 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:03.448758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287e191-7bfb-493a-86c5-5f0621082504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:03.449701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439168d9-6188-4c86-a5dc-343caddc6e0e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:03.456174 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 135/280] 10.222.0.81 () {56 vars in 1308 bytes} [Wed May 4 17:29:03 2022] GET /identity/v3/role_assignments?user.id=b3392a69343841c38d42ab9da00ca76e&scope.system=all&role.id=42b0adbc87e347e18bd4412dc9e421c1 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:03.467207 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c287e191-7bfb-493a-86c5-5f0621082504 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:03.468412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c287e191-7bfb-493a-86c5-5f0621082504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:03.548104 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 146/281] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:29:03.571035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439168d9-6188-4c86-a5dc-343caddc6e0e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:03.686446 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439168d9-6188-4c86-a5dc-343caddc6e0e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:03.724496 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c1282-f234-4cea-9c7b-6dc1aa61b21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:03.725901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c1282-f234-4cea-9c7b-6dc1aa61b21b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:03.726229 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c1282-f234-4cea-9c7b-6dc1aa61b21b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:03.726498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c1282-f234-4cea-9c7b-6dc1aa61b21b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:03.737666 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c1282-f234-4cea-9c7b-6dc1aa61b21b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:03.746114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-3d0c1282-f234-4cea-9c7b-6dc1aa61b21b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:29:03.746114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:03.746114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:03.746114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:03.746114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:03.746114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:03.746114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:03.746114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:03.746114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:03.746114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:03.746114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:03.746114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:03.746114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:03.746114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:03.746114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:03.746114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:03.747209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:03.747209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:03.747209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:03.747209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:03.747209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:03.747209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:03.747209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:03.747209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:03.747209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:03.747209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:03.747209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:03.747209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:03.747209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:03.747209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:03.747209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:03.747209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:03.748721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:03.748721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:03.748721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:03.748721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:03.748721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:03.748721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:03.748721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:03.748721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:03.748721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:03.748721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:03.748721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:29:03.748721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:03.748721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 136/282] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:03.754036 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287e191-7bfb-493a-86c5-5f0621082504 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:03.863915 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287e191-7bfb-493a-86c5-5f0621082504 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:03.906514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa32bd-e9f9-404e-a0a7-c761ca4bfdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:03.907567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa32bd-e9f9-404e-a0a7-c761ca4bfdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:03.908064 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa32bd-e9f9-404e-a0a7-c761ca4bfdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:03.908554 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa32bd-e9f9-404e-a0a7-c761ca4bfdc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:03.909516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa32bd-e9f9-404e-a0a7-c761ca4bfdc6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:03.910013 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa32bd-e9f9-404e-a0a7-c761ca4bfdc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:03.911592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa32bd-e9f9-404e-a0a7-c761ca4bfdc6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:03.925338 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 147/283] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:29:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:03.932425 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c1282-f234-4cea-9c7b-6dc1aa61b21b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:03.950523 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d85b39-9c90-4942-9a65-7daeb3977e1d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:03.951128 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d85b39-9c90-4942-9a65-7daeb3977e1d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:03.951620 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d85b39-9c90-4942-9a65-7daeb3977e1d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:03.953322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 148/284] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:03.959912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75be46-8955-4cd6-9591-5eefb91a45d4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:03.960688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75be46-8955-4cd6-9591-5eefb91a45d4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:03.961366 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75be46-8955-4cd6-9591-5eefb91a45d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:03.996602 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3f75be46-8955-4cd6-9591-5eefb91a45d4 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:04.000346 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3f75be46-8955-4cd6-9591-5eefb91a45d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:04.091091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c1282-f234-4cea-9c7b-6dc1aa61b21b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:04.130109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 149/285] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:29:04.130999 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff2f4-e82d-4953-b311-414c91a12ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:04.131954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff2f4-e82d-4953-b311-414c91a12ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:04.132236 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff2f4-e82d-4953-b311-414c91a12ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:04.132532 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff2f4-e82d-4953-b311-414c91a12ab3 None admin] PATH_INFO: `/v3/users/d666a2339cd2423fbaa7b372f0e60c60` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:04.137189 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ff2f4-e82d-4953-b311-414c91a12ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=d666a2339cd2423fbaa7b372f0e60c60)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:04.138692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ff2f4-e82d-4953-b311-414c91a12ab3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:04.140617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 137/286] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:29:03 2022] GET /identity/v3/users/d666a2339cd2423fbaa7b372f0e60c60 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:04.148101 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75be46-8955-4cd6-9591-5eefb91a45d4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:04.205425 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff2f4-e82d-4953-b311-414c91a12ab3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:04.265237 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75be46-8955-4cd6-9591-5eefb91a45d4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:04.300216 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413a247-1135-45eb-87db-c9da5247b643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:04.301811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413a247-1135-45eb-87db-c9da5247b643 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:04.302091 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413a247-1135-45eb-87db-c9da5247b643 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:04.302560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413a247-1135-45eb-87db-c9da5247b643 None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:04.305755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413a247-1135-45eb-87db-c9da5247b643 None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:04.308600 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413a247-1135-45eb-87db-c9da5247b643 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:04.311578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 150/287] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:04 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:04.319420 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413a247-1135-45eb-87db-c9da5247b643 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:04.370500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff2f4-e82d-4953-b311-414c91a12ab3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:04.432842 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf0196-cef1-4d9c-b741-f39a896ce4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:04.433644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf0196-cef1-4d9c-b741-f39a896ce4ea None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:04.433928 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf0196-cef1-4d9c-b741-f39a896ce4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:04.434204 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf0196-cef1-4d9c-b741-f39a896ce4ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:04.450166 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf0196-cef1-4d9c-b741-f39a896ce4ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:04.465154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d0bf0196-cef1-4d9c-b741-f39a896ce4ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:04.465154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:04.465154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:04.465154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:04.465154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:04.465154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:04.465154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:04.465154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:04.465154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:04.465154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:04.465154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:04.465154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:04.465154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:04.465154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:04.465154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:04.465154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:04.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:04.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:04.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:04.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:04.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:04.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:04.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:04.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:04.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:04.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:04.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:04.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:04.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:04.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:04.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:04.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:04.467298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:04.467298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:04.467298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:04.467298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:04.467298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:04.467298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:04.467298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:04.467298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:04.467298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:04.467298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:04.467298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:04.467298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:04.467298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 138/288] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:04.474143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf0196-cef1-4d9c-b741-f39a896ce4ea None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:04.534313 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413a247-1135-45eb-87db-c9da5247b643 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:04.580801 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c8933-c155-4bca-9d0a-de22ef7eb65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:04.581758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c8933-c155-4bca-9d0a-de22ef7eb65e None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:04.582035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c8933-c155-4bca-9d0a-de22ef7eb65e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:04.582309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c8933-c155-4bca-9d0a-de22ef7eb65e None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23/users/d666a2339cd2423fbaa7b372f0e60c60/roles/14898ff2d2954978a29cb0b4cb85ba7e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:04.585320 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c8933-c155-4bca-9d0a-de22ef7eb65e None admin] RBAC: Authorizing `identity:create_grant(project_id=9d591a594b164a30b9a0094d1803ba23, user_id=d666a2339cd2423fbaa7b372f0e60c60, role_id=14898ff2d2954978a29cb0b4cb85ba7e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:04.586783 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c8933-c155-4bca-9d0a-de22ef7eb65e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:04.606603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf0196-cef1-4d9c-b741-f39a896ce4ea None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:04.643293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738eb29-0543-465b-b563-8edece9d27ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:04.644163 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738eb29-0543-465b-b563-8edece9d27ef None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:04.644464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738eb29-0543-465b-b563-8edece9d27ef None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:04.644757 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738eb29-0543-465b-b563-8edece9d27ef None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:04.645580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738eb29-0543-465b-b563-8edece9d27ef None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:04.645890 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738eb29-0543-465b-b563-8edece9d27ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:04.647733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738eb29-0543-465b-b563-8edece9d27ef None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:04.657318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 139/289] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:29:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:04.669855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 151/290] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:29:04 2022] PUT /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23/users/d666a2339cd2423fbaa7b372f0e60c60/roles/14898ff2d2954978a29cb0b4cb85ba7e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:29:04.670212 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738eb29-0543-465b-b563-8edece9d27ef None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:04.786785 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738eb29-0543-465b-b563-8edece9d27ef None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:04.822328 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2737a41-b541-4b84-a8bb-c69a7f645801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:04.823218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2737a41-b541-4b84-a8bb-c69a7f645801 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:04.823501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2737a41-b541-4b84-a8bb-c69a7f645801 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:04.823774 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2737a41-b541-4b84-a8bb-c69a7f645801 None admin] PATH_INFO: `/v3/users/1c81e38c2a054226a77291eedbd1aadd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:04.825070 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2737a41-b541-4b84-a8bb-c69a7f645801 None admin] RBAC: Authorizing `identity:get_user(user_id=1c81e38c2a054226a77291eedbd1aadd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:04.826528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2737a41-b541-4b84-a8bb-c69a7f645801 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:04.828510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 140/291] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:29:04 2022] GET /identity/v3/users/1c81e38c2a054226a77291eedbd1aadd => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:04.834733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c8933-c155-4bca-9d0a-de22ef7eb65e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:04.947373 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c8933-c155-4bca-9d0a-de22ef7eb65e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:04.984098 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6467fc4-6b50-4b3f-bd4b-0dbb9075d511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:04.984783 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6467fc4-6b50-4b3f-bd4b-0dbb9075d511 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:04.985057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6467fc4-6b50-4b3f-bd4b-0dbb9075d511 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:04.985331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6467fc4-6b50-4b3f-bd4b-0dbb9075d511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:05.059602 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6467fc4-6b50-4b3f-bd4b-0dbb9075d511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:05.061040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6467fc4-6b50-4b3f-bd4b-0dbb9075d511 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:05.164751 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 152/292] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:05.167031 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2737a41-b541-4b84-a8bb-c69a7f645801 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:05.270759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2737a41-b541-4b84-a8bb-c69a7f645801 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:05.306265 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057e9b7-9138-453e-83d1-1844905c061d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:05.307123 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057e9b7-9138-453e-83d1-1844905c061d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:05.307402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057e9b7-9138-453e-83d1-1844905c061d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:05.307675 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057e9b7-9138-453e-83d1-1844905c061d None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:05.308907 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057e9b7-9138-453e-83d1-1844905c061d None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:05.310413 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057e9b7-9138-453e-83d1-1844905c061d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:05.312284 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 141/293] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:05 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:05.319340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6467fc4-6b50-4b3f-bd4b-0dbb9075d511 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:05.442919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6467fc4-6b50-4b3f-bd4b-0dbb9075d511 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:05.494518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75291f7a-baea-4317-a366-171df16315de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:05.495243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75291f7a-baea-4317-a366-171df16315de None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:05.495523 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75291f7a-baea-4317-a366-171df16315de None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:05.495795 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75291f7a-baea-4317-a366-171df16315de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:05.496661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75291f7a-baea-4317-a366-171df16315de None admin] RBAC: Adding query filter params (role.id=42b0adbc87e347e18bd4412dc9e421c1, scope.project.id=9d591a594b164a30b9a0094d1803ba23, user.id=1c81e38c2a054226a77291eedbd1aadd) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:05.496966 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75291f7a-baea-4317-a366-171df16315de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:05.498395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75291f7a-baea-4317-a366-171df16315de None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:05.506900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 153/294] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:29:05 2022] GET /identity/v3/role_assignments?user.id=1c81e38c2a054226a77291eedbd1aadd&scope.project.id=9d591a594b164a30b9a0094d1803ba23&role.id=42b0adbc87e347e18bd4412dc9e421c1 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:06.079126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567c189-870f-4be0-8f93-523fa9a9573e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:06.079667 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567c189-870f-4be0-8f93-523fa9a9573e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:06.079667 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567c189-870f-4be0-8f93-523fa9a9573e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:06.081353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 142/295] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:06.087368 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b3cf-7269-4b21-a3bd-119896b3082a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:06.087820 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b3cf-7269-4b21-a3bd-119896b3082a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:06.087916 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b3cf-7269-4b21-a3bd-119896b3082a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:06.109289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3871b3cf-7269-4b21-a3bd-119896b3082a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:06.110546 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3871b3cf-7269-4b21-a3bd-119896b3082a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:06.188478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 154/296] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:06.214865 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567c189-870f-4be0-8f93-523fa9a9573e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:06.313661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde36e2a-2fdc-48e4-b513-e181f7a63d27 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:06.314010 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde36e2a-2fdc-48e4-b513-e181f7a63d27 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:06.314232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde36e2a-2fdc-48e4-b513-e181f7a63d27 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:06.316280 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 155/297] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:06.323605 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc461-687f-494e-ae8f-880d1698564e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:06.323605 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc461-687f-494e-ae8f-880d1698564e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:06.323605 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc461-687f-494e-ae8f-880d1698564e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:06.342216 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567c189-870f-4be0-8f93-523fa9a9573e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:06.342626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-675dc461-687f-494e-ae8f-880d1698564e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:06.343809 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-675dc461-687f-494e-ae8f-880d1698564e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:06.378270 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4dd4a-57be-42bb-b113-8e30018a781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:06.379446 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4dd4a-57be-42bb-b113-8e30018a781b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:06.380215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4dd4a-57be-42bb-b113-8e30018a781b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:06.381420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4dd4a-57be-42bb-b113-8e30018a781b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:06.398158 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4dd4a-57be-42bb-b113-8e30018a781b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:06.408706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-52d4dd4a-57be-42bb-b113-8e30018a781b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:29:06.408706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:06.408706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:06.408706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:06.408706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:06.408706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:06.408706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:06.408706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:06.408706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:06.408706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:06.408706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:06.408706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:06.408706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:06.408706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:06.408706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:06.408706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:06.409575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:06.409575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:06.409575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:06.409575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:06.409575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:06.409575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:06.409575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:06.409575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:06.409575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:06.409575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:06.409575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:06.409575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:06.409575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:06.409575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:06.409575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:06.409575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:06.410782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:06.410782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:06.410782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:06.410782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:06.410782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:06.410782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:06.410782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:06.410782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:06.410782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:06.410782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:06.410782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:29:06.410782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:06.415253 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 143/298] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:06.416148 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4dd4a-57be-42bb-b113-8e30018a781b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:06.429955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 156/299] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:06.431775 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1ceea-721a-44af-a936-2f5cdbe7a6c3 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:06.432258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1ceea-721a-44af-a936-2f5cdbe7a6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:06.432771 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1ceea-721a-44af-a936-2f5cdbe7a6c3 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:06.434295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 157/300] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:06.439461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3d444-a603-46ab-b1aa-37cf02fe8106 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:06.439745 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3d444-a603-46ab-b1aa-37cf02fe8106 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:06.440017 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3d444-a603-46ab-b1aa-37cf02fe8106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:06.460299 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-04e3d444-a603-46ab-b1aa-37cf02fe8106 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:06.461490 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-04e3d444-a603-46ab-b1aa-37cf02fe8106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:06.520129 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4dd4a-57be-42bb-b113-8e30018a781b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:06.532846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 158/301] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:29:06.532846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3d444-a603-46ab-b1aa-37cf02fe8106 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:06.561380 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353143fe-4824-4174-a588-6fbfe9ed8245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:06.562052 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353143fe-4824-4174-a588-6fbfe9ed8245 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:06.562396 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353143fe-4824-4174-a588-6fbfe9ed8245 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:06.562674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353143fe-4824-4174-a588-6fbfe9ed8245 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:06.563432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353143fe-4824-4174-a588-6fbfe9ed8245 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:06.563746 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353143fe-4824-4174-a588-6fbfe9ed8245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:06.565169 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353143fe-4824-4174-a588-6fbfe9ed8245 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:06.573857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 144/302] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:29:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:06.574485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353143fe-4824-4174-a588-6fbfe9ed8245 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:06.661777 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3d444-a603-46ab-b1aa-37cf02fe8106 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:06.678704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353143fe-4824-4174-a588-6fbfe9ed8245 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:06.699562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e3b0c-14de-480c-8f18-ec16fbfe1a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:06.700355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e3b0c-14de-480c-8f18-ec16fbfe1a7c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:06.700663 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e3b0c-14de-480c-8f18-ec16fbfe1a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:06.700932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e3b0c-14de-480c-8f18-ec16fbfe1a7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:06.702092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e3b0c-14de-480c-8f18-ec16fbfe1a7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:06.703576 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e3b0c-14de-480c-8f18-ec16fbfe1a7c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:06.705576 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 159/303] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:06.706139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e3b0c-14de-480c-8f18-ec16fbfe1a7c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:06.717896 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80f6d5-9956-488f-b5e4-ee6ae9fbc6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:06.719320 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80f6d5-9956-488f-b5e4-ee6ae9fbc6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:06.720105 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80f6d5-9956-488f-b5e4-ee6ae9fbc6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:06.720755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80f6d5-9956-488f-b5e4-ee6ae9fbc6b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:06.733824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80f6d5-9956-488f-b5e4-ee6ae9fbc6b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:06.741853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7a80f6d5-9956-488f-b5e4-ee6ae9fbc6b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:06.741853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:06.741853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:06.741853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:06.741853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:06.741853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:06.741853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:06.741853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:06.741853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:06.741853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:06.741853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:06.741853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:06.741853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:06.741853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:06.741853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:06.741853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:06.742812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:06.742812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:06.742812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:06.742812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:06.742812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:06.742812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:06.742812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:06.742812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:06.742812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:06.742812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:06.742812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:06.742812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:06.742812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:06.742812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:06.742812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:06.742812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:06.743690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:06.743690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:06.743690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:06.743690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:06.743690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:06.743690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:06.743690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:06.743690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:06.743690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:06.743690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:06.743690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:06.743690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:06.745977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 145/304] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:06.746954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80f6d5-9956-488f-b5e4-ee6ae9fbc6b5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:06.808592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e3b0c-14de-480c-8f18-ec16fbfe1a7c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:06.849029 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294934a-0c9e-4861-bc7e-71aecb7baca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:06.850467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294934a-0c9e-4861-bc7e-71aecb7baca4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:06.850745 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294934a-0c9e-4861-bc7e-71aecb7baca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:06.851091 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294934a-0c9e-4861-bc7e-71aecb7baca4 None admin] PATH_INFO: `/v3/users/04cef802f048478aad5ed2d7a5207aab` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:06.855759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80f6d5-9956-488f-b5e4-ee6ae9fbc6b5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:06.869871 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294934a-0c9e-4861-bc7e-71aecb7baca4 None admin] RBAC: Authorizing `identity:get_user(user_id=04cef802f048478aad5ed2d7a5207aab)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:06.871344 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294934a-0c9e-4861-bc7e-71aecb7baca4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:06.873296 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 160/305] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:29:06 2022] GET /identity/v3/users/04cef802f048478aad5ed2d7a5207aab => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:06.878744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294934a-0c9e-4861-bc7e-71aecb7baca4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:06.889225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313d09c-630f-41f5-b7e8-58ed65a0c167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:06.889901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313d09c-630f-41f5-b7e8-58ed65a0c167 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:06.890185 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313d09c-630f-41f5-b7e8-58ed65a0c167 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:06.890459 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313d09c-630f-41f5-b7e8-58ed65a0c167 None admin] PATH_INFO: `/v3/groups` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:06.891187 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313d09c-630f-41f5-b7e8-58ed65a0c167 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:06.892641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313d09c-630f-41f5-b7e8-58ed65a0c167 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:06.972466 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 146/306] 10.222.0.81 () {60 vars in 1134 bytes} [Wed May 4 17:29:06 2022] POST /identity/v3/groups => generated 229 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:29:06.972466 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313d09c-630f-41f5-b7e8-58ed65a0c167 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:06.994608 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294934a-0c9e-4861-bc7e-71aecb7baca4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:07.043457 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bce83-b8b9-44b8-82d4-c4b6894b627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:07.044779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bce83-b8b9-44b8-82d4-c4b6894b627f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:07.045066 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bce83-b8b9-44b8-82d4-c4b6894b627f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:07.045602 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bce83-b8b9-44b8-82d4-c4b6894b627f None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:07.046449 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bce83-b8b9-44b8-82d4-c4b6894b627f None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:07.046760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bce83-b8b9-44b8-82d4-c4b6894b627f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:07.048571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bce83-b8b9-44b8-82d4-c4b6894b627f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:07.064710 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 161/307] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:29:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:07.066200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bce83-b8b9-44b8-82d4-c4b6894b627f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:07.095492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313d09c-630f-41f5-b7e8-58ed65a0c167 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:07.131154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409021f-a668-4376-90a9-3d139594929f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:07.132084 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409021f-a668-4376-90a9-3d139594929f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:07.132348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409021f-a668-4376-90a9-3d139594929f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:07.132767 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409021f-a668-4376-90a9-3d139594929f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:07.133725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409021f-a668-4376-90a9-3d139594929f None admin] RBAC: Adding query filter params (role.id=14898ff2d2954978a29cb0b4cb85ba7e, user.id=04cef802f048478aad5ed2d7a5207aab, scope.system=all) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:07.134140 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409021f-a668-4376-90a9-3d139594929f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:07.135728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409021f-a668-4376-90a9-3d139594929f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:07.142885 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 147/308] 10.222.0.81 () {56 vars in 1308 bytes} [Wed May 4 17:29:06 2022] GET /identity/v3/role_assignments?user.id=04cef802f048478aad5ed2d7a5207aab&scope.system=all&role.id=14898ff2d2954978a29cb0b4cb85ba7e => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:07.194442 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bce83-b8b9-44b8-82d4-c4b6894b627f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:07.236646 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07978fd2-552b-4d89-8ede-ae8d6d3174e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:07.237460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07978fd2-552b-4d89-8ede-ae8d6d3174e7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:07.237737 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07978fd2-552b-4d89-8ede-ae8d6d3174e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:07.238008 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07978fd2-552b-4d89-8ede-ae8d6d3174e7 None admin] PATH_INFO: `/v3/users/b3392a69343841c38d42ab9da00ca76e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:07.239282 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07978fd2-552b-4d89-8ede-ae8d6d3174e7 None admin] RBAC: Authorizing `identity:get_user(user_id=b3392a69343841c38d42ab9da00ca76e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:07.241588 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07978fd2-552b-4d89-8ede-ae8d6d3174e7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:07.243425 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 162/309] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:29:07 2022] GET /identity/v3/users/b3392a69343841c38d42ab9da00ca76e => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:07.251349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409021f-a668-4376-90a9-3d139594929f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:07.356287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aa2b6-6fa0-4ac0-9c86-b20f1fb36d6c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:07.356631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aa2b6-6fa0-4ac0-9c86-b20f1fb36d6c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:07.356892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aa2b6-6fa0-4ac0-9c86-b20f1fb36d6c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:07.358398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 163/310] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:29:07.363116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfab268-633c-4d45-97aa-be1dc7a3dc20 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:07.363401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfab268-633c-4d45-97aa-be1dc7a3dc20 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:07.363676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfab268-633c-4d45-97aa-be1dc7a3dc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:07.373473 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409021f-a668-4376-90a9-3d139594929f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:07.381714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8cfab268-633c-4d45-97aa-be1dc7a3dc20 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:07.382916 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8cfab268-633c-4d45-97aa-be1dc7a3dc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:07.417698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf503ad-a5c4-4936-b0e9-dc1792e619fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:07.419585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf503ad-a5c4-4936-b0e9-dc1792e619fc None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:07.419882 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf503ad-a5c4-4936-b0e9-dc1792e619fc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:07.420167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf503ad-a5c4-4936-b0e9-dc1792e619fc None admin] PATH_INFO: `/v3/system/users/b3392a69343841c38d42ab9da00ca76e/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:07.421824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf503ad-a5c4-4936-b0e9-dc1792e619fc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b3392a69343841c38d42ab9da00ca76e, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:07.423202 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf503ad-a5c4-4936-b0e9-dc1792e619fc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:07.456372 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 164/311] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:29:07.476120 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfab268-633c-4d45-97aa-be1dc7a3dc20 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:07.538922 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 148/312] 10.222.0.81 () {58 vars in 1334 bytes} [Wed May 4 17:29:07 2022] PUT /identity/v3/system/users/b3392a69343841c38d42ab9da00ca76e/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:29:07.590235 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfab268-633c-4d45-97aa-be1dc7a3dc20 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:07.630027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25733d1-c64b-4496-91c6-15f179d8127d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:07.631391 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25733d1-c64b-4496-91c6-15f179d8127d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:07.631671 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25733d1-c64b-4496-91c6-15f179d8127d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:07.631947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25733d1-c64b-4496-91c6-15f179d8127d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:07.644430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25733d1-c64b-4496-91c6-15f179d8127d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:07.652828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-e25733d1-c64b-4496-91c6-15f179d8127d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:29:07.652828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:07.652828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:07.652828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:07.652828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:07.652828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:07.652828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:07.652828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:07.652828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:07.652828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:07.652828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:07.652828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:07.652828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:07.652828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:07.652828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:07.652828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:07.653742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:07.653742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:07.653742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:07.653742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:07.653742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:07.653742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:07.653742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:07.653742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:07.653742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:07.653742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:07.653742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:07.653742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:07.653742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:07.653742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:07.653742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:07.653742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:07.654503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:07.654503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:07.654503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:07.654503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:07.654503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:07.654503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:07.654503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:07.654503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:07.654503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:07.654503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:07.654503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:29:07.654503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:07.654503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 165/313] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:29:07.662000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf503ad-a5c4-4936-b0e9-dc1792e619fc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:07.776515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf503ad-a5c4-4936-b0e9-dc1792e619fc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:07.810102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a95068-d6b4-4d2b-be92-b1e0d72460cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:07.810752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a95068-d6b4-4d2b-be92-b1e0d72460cb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:07.811098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a95068-d6b4-4d2b-be92-b1e0d72460cb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:07.811374 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a95068-d6b4-4d2b-be92-b1e0d72460cb None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:07.812169 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a95068-d6b4-4d2b-be92-b1e0d72460cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:07.812535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a95068-d6b4-4d2b-be92-b1e0d72460cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:07.813912 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a95068-d6b4-4d2b-be92-b1e0d72460cb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:07.822251 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 149/314] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:29:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:07.827669 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25733d1-c64b-4496-91c6-15f179d8127d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:07.931287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25733d1-c64b-4496-91c6-15f179d8127d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:07.964624 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f42c8-3412-44f5-9af2-b4417a16df6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:07.965539 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f42c8-3412-44f5-9af2-b4417a16df6f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:07.965816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f42c8-3412-44f5-9af2-b4417a16df6f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:07.966078 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f42c8-3412-44f5-9af2-b4417a16df6f None admin] PATH_INFO: `/v3/users/d666a2339cd2423fbaa7b372f0e60c60` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:07.967266 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f42c8-3412-44f5-9af2-b4417a16df6f None admin] RBAC: Authorizing `identity:get_user(user_id=d666a2339cd2423fbaa7b372f0e60c60)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:07.968738 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f42c8-3412-44f5-9af2-b4417a16df6f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:07.970583 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 166/315] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:29:07 2022] GET /identity/v3/users/d666a2339cd2423fbaa7b372f0e60c60 => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:07.976914 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a95068-d6b4-4d2b-be92-b1e0d72460cb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:08.079897 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a95068-d6b4-4d2b-be92-b1e0d72460cb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:08.113802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21907a90-c987-47a3-b776-8ff62dadaa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:08.114445 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21907a90-c987-47a3-b776-8ff62dadaa00 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:08.115245 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21907a90-c987-47a3-b776-8ff62dadaa00 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:08.115527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21907a90-c987-47a3-b776-8ff62dadaa00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:08.183545 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21907a90-c987-47a3-b776-8ff62dadaa00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:08.185036 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21907a90-c987-47a3-b776-8ff62dadaa00 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:08.291807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 150/316] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:08.293225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f42c8-3412-44f5-9af2-b4417a16df6f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:08.398736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f42c8-3412-44f5-9af2-b4417a16df6f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:08.432683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82095b49-e6ad-48c5-9824-0f1d47179132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:08.433534 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82095b49-e6ad-48c5-9824-0f1d47179132 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:08.433813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82095b49-e6ad-48c5-9824-0f1d47179132 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:08.434081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82095b49-e6ad-48c5-9824-0f1d47179132 None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:08.435247 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82095b49-e6ad-48c5-9824-0f1d47179132 None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:08.436690 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82095b49-e6ad-48c5-9824-0f1d47179132 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:08.443730 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 167/317] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:08 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:08.445216 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21907a90-c987-47a3-b776-8ff62dadaa00 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:08.544841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21907a90-c987-47a3-b776-8ff62dadaa00 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:08.578428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85204f7b-1f11-4931-a17e-e021a59f7c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:08.579090 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85204f7b-1f11-4931-a17e-e021a59f7c7c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:08.579368 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85204f7b-1f11-4931-a17e-e021a59f7c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:08.579670 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85204f7b-1f11-4931-a17e-e021a59f7c7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:08.580627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85204f7b-1f11-4931-a17e-e021a59f7c7c None admin] RBAC: Adding query filter params (role.id=14898ff2d2954978a29cb0b4cb85ba7e, scope.project.id=9d591a594b164a30b9a0094d1803ba23, user.id=d666a2339cd2423fbaa7b372f0e60c60) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:08.580941 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85204f7b-1f11-4931-a17e-e021a59f7c7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:08.582436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85204f7b-1f11-4931-a17e-e021a59f7c7c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:08.595843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 151/318] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:29:08 2022] GET /identity/v3/role_assignments?user.id=d666a2339cd2423fbaa7b372f0e60c60&scope.project.id=9d591a594b164a30b9a0094d1803ba23&role.id=14898ff2d2954978a29cb0b4cb85ba7e => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:09.396930 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaefb68-f04e-4511-bf7c-89cb4815a9ec None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:09.397554 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaefb68-f04e-4511-bf7c-89cb4815a9ec None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:09.397554 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaefb68-f04e-4511-bf7c-89cb4815a9ec None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:09.398869 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 168/319] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:09.404853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314bbb-7419-4663-a274-d31a947be91c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:09.405398 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314bbb-7419-4663-a274-d31a947be91c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:09.405398 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314bbb-7419-4663-a274-d31a947be91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:09.422688 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b1314bbb-7419-4663-a274-d31a947be91c None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:09.423901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b1314bbb-7419-4663-a274-d31a947be91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:09.491224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 152/320] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:09.513795 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaefb68-f04e-4511-bf7c-89cb4815a9ec None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:09.580990 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081fb0-4f99-4fbe-9535-d954bcd235c2 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:09.581271 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081fb0-4f99-4fbe-9535-d954bcd235c2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:09.581759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081fb0-4f99-4fbe-9535-d954bcd235c2 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:09.583116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 153/321] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:29:09.589054 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067b3d6-5312-4506-87b1-895bf433e3b5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:09.589272 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067b3d6-5312-4506-87b1-895bf433e3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:09.589713 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067b3d6-5312-4506-87b1-895bf433e3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:09.606902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d067b3d6-5312-4506-87b1-895bf433e3b5 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:09.609372 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d067b3d6-5312-4506-87b1-895bf433e3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:09.619384 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaefb68-f04e-4511-bf7c-89cb4815a9ec None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:09.655010 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2ed20-3f14-4dbd-9d4d-1871dd4b66ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:09.655785 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2ed20-3f14-4dbd-9d4d-1871dd4b66ca None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:09.656060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2ed20-3f14-4dbd-9d4d-1871dd4b66ca None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:09.656329 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2ed20-3f14-4dbd-9d4d-1871dd4b66ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:09.657496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2ed20-3f14-4dbd-9d4d-1871dd4b66ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:09.658922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2ed20-3f14-4dbd-9d4d-1871dd4b66ca None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:09.660853 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 169/322] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:09.667147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2ed20-3f14-4dbd-9d4d-1871dd4b66ca None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:09.676633 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 154/323] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:29:09.701125 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067b3d6-5312-4506-87b1-895bf433e3b5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:09.777513 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2ed20-3f14-4dbd-9d4d-1871dd4b66ca None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:09.800751 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067b3d6-5312-4506-87b1-895bf433e3b5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:09.810306 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950ad07-0a9f-4e2a-98ed-de2be53e46d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:09.810996 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950ad07-0a9f-4e2a-98ed-de2be53e46d6 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:09.811285 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950ad07-0a9f-4e2a-98ed-de2be53e46d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:09.811559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950ad07-0a9f-4e2a-98ed-de2be53e46d6 None admin] PATH_INFO: `/v3/groups` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:09.812246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950ad07-0a9f-4e2a-98ed-de2be53e46d6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:09.813724 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950ad07-0a9f-4e2a-98ed-de2be53e46d6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:09.834403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93cd16-f3ae-43e4-889a-8c56683bb5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:09.835193 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93cd16-f3ae-43e4-889a-8c56683bb5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:09.835477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93cd16-f3ae-43e4-889a-8c56683bb5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:09.835754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93cd16-f3ae-43e4-889a-8c56683bb5d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:09.846123 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93cd16-f3ae-43e4-889a-8c56683bb5d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:09.854436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-bc93cd16-f3ae-43e4-889a-8c56683bb5d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:29:09.854436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:09.854436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:09.854436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:09.854436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:09.854436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:09.854436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:09.854436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:09.854436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:09.854436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:09.854436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:09.854436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:09.854436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:09.854436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:09.854436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:09.854436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:09.861176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:09.861176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:09.861176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:09.861176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:09.861176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:09.861176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:09.861176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:09.861176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:09.861176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:09.861176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:09.861176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:09.861176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:09.861176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:09.861176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:09.861176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:09.861176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:09.861944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:09.861944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:09.861944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:09.861944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:09.861944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:09.861944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:09.861944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:09.861944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:09.861944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:09.861944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:09.861944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:29:09.861944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:09.861944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 155/324] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:29:09.863635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93cd16-f3ae-43e4-889a-8c56683bb5d0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:09.914957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 170/325] 10.222.0.81 () {60 vars in 1134 bytes} [Wed May 4 17:29:09 2022] POST /identity/v3/groups => generated 226 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:29:09.916423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac4c14-d170-48a9-805b-d9be9200f558 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:09.916754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac4c14-d170-48a9-805b-d9be9200f558 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:09.917027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac4c14-d170-48a9-805b-d9be9200f558 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:09.918467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 171/326] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:09.924456 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05887adb-f84d-4483-baaa-3e058ad4311f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:09.924811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05887adb-f84d-4483-baaa-3e058ad4311f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:09.925098 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05887adb-f84d-4483-baaa-3e058ad4311f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:09.942806 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-05887adb-f84d-4483-baaa-3e058ad4311f None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:09.944070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-05887adb-f84d-4483-baaa-3e058ad4311f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:09.970312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93cd16-f3ae-43e4-889a-8c56683bb5d0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:10.007768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c6c43-9258-47d1-96ce-29848ba77b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:10.008477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c6c43-9258-47d1-96ce-29848ba77b39 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:10.008758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c6c43-9258-47d1-96ce-29848ba77b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:10.009038 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c6c43-9258-47d1-96ce-29848ba77b39 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:10.009806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c6c43-9258-47d1-96ce-29848ba77b39 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:10.010116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c6c43-9258-47d1-96ce-29848ba77b39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:10.011531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c6c43-9258-47d1-96ce-29848ba77b39 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:10.016641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 172/327] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:10.021515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 156/328] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:29:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:10.027169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05887adb-f84d-4483-baaa-3e058ad4311f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:10.042347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c6c43-9258-47d1-96ce-29848ba77b39 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:10.130316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05887adb-f84d-4483-baaa-3e058ad4311f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:10.148851 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c6c43-9258-47d1-96ce-29848ba77b39 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:10.165865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1147b-51bf-45d2-b126-f771b896fcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:10.166738 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1147b-51bf-45d2-b126-f771b896fcdd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:10.167019 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1147b-51bf-45d2-b126-f771b896fcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:10.167295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1147b-51bf-45d2-b126-f771b896fcdd None admin] PATH_INFO: `/v3/users/04cef802f048478aad5ed2d7a5207aab` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:10.168525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1147b-51bf-45d2-b126-f771b896fcdd None admin] RBAC: Authorizing `identity:get_user(user_id=04cef802f048478aad5ed2d7a5207aab)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:10.169963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1147b-51bf-45d2-b126-f771b896fcdd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:10.171590 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 173/329] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:29:10 2022] GET /identity/v3/users/04cef802f048478aad5ed2d7a5207aab => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:10.177840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1147b-51bf-45d2-b126-f771b896fcdd None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:10.189027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c6895-ebe8-4cb0-abb9-0633a090a830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:10.189825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c6895-ebe8-4cb0-abb9-0633a090a830 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:10.190108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c6895-ebe8-4cb0-abb9-0633a090a830 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:10.190381 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c6895-ebe8-4cb0-abb9-0633a090a830 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:10.203311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c6895-ebe8-4cb0-abb9-0633a090a830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:10.212091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e49c6895-ebe8-4cb0-abb9-0633a090a830 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:10.212091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:10.212091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:10.212091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:10.212091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:10.212091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:10.212091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:10.212091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:10.212091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:10.212091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:10.212091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:10.212091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:10.212091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:10.212091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:10.212091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:10.212091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:10.213566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:10.213566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:10.213566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:10.213566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:10.213566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:10.213566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:10.213566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:10.213566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:10.213566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:10.213566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:10.213566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:10.213566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:10.213566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:10.213566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:10.213566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:10.213566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:10.214547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:10.214547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:10.214547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:10.214547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:10.214547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:10.214547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:10.214547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:10.214547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:10.214547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:10.214547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:10.214547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:10.214547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:10.214547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 157/330] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:29:10.219249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c6895-ebe8-4cb0-abb9-0633a090a830 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:10.294288 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1147b-51bf-45d2-b126-f771b896fcdd None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:10.329873 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd598044-40a9-477e-838c-4df992b43970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:10.330741 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd598044-40a9-477e-838c-4df992b43970 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:10.331025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd598044-40a9-477e-838c-4df992b43970 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:10.331307 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd598044-40a9-477e-838c-4df992b43970 None admin] PATH_INFO: `/v3/system/users/04cef802f048478aad5ed2d7a5207aab/roles/14898ff2d2954978a29cb0b4cb85ba7e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:10.336128 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd598044-40a9-477e-838c-4df992b43970 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=04cef802f048478aad5ed2d7a5207aab, role_id=14898ff2d2954978a29cb0b4cb85ba7e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:10.337573 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd598044-40a9-477e-838c-4df992b43970 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:10.370632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c6895-ebe8-4cb0-abb9-0633a090a830 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:10.413443 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1a7ee-8e3a-4a5a-bb9f-829c7b57b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:10.414748 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 174/331] 10.222.0.81 () {58 vars in 1334 bytes} [Wed May 4 17:29:10 2022] PUT /identity/v3/system/users/04cef802f048478aad5ed2d7a5207aab/roles/14898ff2d2954978a29cb0b4cb85ba7e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:29:10.415274 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1a7ee-8e3a-4a5a-bb9f-829c7b57b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:10.415726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1a7ee-8e3a-4a5a-bb9f-829c7b57b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:10.415997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1a7ee-8e3a-4a5a-bb9f-829c7b57b9b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:10.416807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1a7ee-8e3a-4a5a-bb9f-829c7b57b9b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:10.417120 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1a7ee-8e3a-4a5a-bb9f-829c7b57b9b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:10.418546 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1a7ee-8e3a-4a5a-bb9f-829c7b57b9b7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:10.429882 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 158/332] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:29:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:10.435379 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd598044-40a9-477e-838c-4df992b43970 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:10.548055 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd598044-40a9-477e-838c-4df992b43970 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:10.587531 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e225345-f52d-4294-a5c8-9709f5702b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:10.588423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e225345-f52d-4294-a5c8-9709f5702b42 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:10.588797 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e225345-f52d-4294-a5c8-9709f5702b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:10.589068 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e225345-f52d-4294-a5c8-9709f5702b42 None admin] PATH_INFO: `/v3/users/b3392a69343841c38d42ab9da00ca76e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:10.590376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e225345-f52d-4294-a5c8-9709f5702b42 None admin] RBAC: Authorizing `identity:get_user(user_id=b3392a69343841c38d42ab9da00ca76e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:10.591967 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e225345-f52d-4294-a5c8-9709f5702b42 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:10.593995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 175/333] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:29:10 2022] GET /identity/v3/users/b3392a69343841c38d42ab9da00ca76e => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:10.600647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1a7ee-8e3a-4a5a-bb9f-829c7b57b9b7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:10.715415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1a7ee-8e3a-4a5a-bb9f-829c7b57b9b7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:10.749935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089e7b5-474e-4d34-913d-7d505635f381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:10.750603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089e7b5-474e-4d34-913d-7d505635f381 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:10.750890 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089e7b5-474e-4d34-913d-7d505635f381 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:10.751146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089e7b5-474e-4d34-913d-7d505635f381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:10.751993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089e7b5-474e-4d34-913d-7d505635f381 None admin] RBAC: Adding query filter params (role.id=42b0adbc87e347e18bd4412dc9e421c1, user.id=b3392a69343841c38d42ab9da00ca76e, scope.system=all) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:10.752304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089e7b5-474e-4d34-913d-7d505635f381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:10.753772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089e7b5-474e-4d34-913d-7d505635f381 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:10.767188 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 159/334] 10.222.0.81 () {56 vars in 1308 bytes} [Wed May 4 17:29:10 2022] GET /identity/v3/role_assignments?user.id=b3392a69343841c38d42ab9da00ca76e&scope.system=all&role.id=42b0adbc87e347e18bd4412dc9e421c1 => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:12.773585 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aa590-1c59-4685-b1f1-df20d3d8988c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:12.774589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aa590-1c59-4685-b1f1-df20d3d8988c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:12.775098 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aa590-1c59-4685-b1f1-df20d3d8988c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:12.777015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 176/335] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:12.782754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52a957-6939-41a6-9751-63f08925c108 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:12.783726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52a957-6939-41a6-9751-63f08925c108 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:12.784200 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52a957-6939-41a6-9751-63f08925c108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:12.805580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-df52a957-6939-41a6-9751-63f08925c108 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:12.807082 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-df52a957-6939-41a6-9751-63f08925c108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:12.905636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 160/336] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:12.943990 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619aa590-1c59-4685-b1f1-df20d3d8988c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:13.071905 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619aa590-1c59-4685-b1f1-df20d3d8988c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:13.117160 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad0e88-d85f-41fa-9ad0-c14e504d8727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:13.118340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad0e88-d85f-41fa-9ad0-c14e504d8727 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:13.118811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad0e88-d85f-41fa-9ad0-c14e504d8727 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:13.119292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad0e88-d85f-41fa-9ad0-c14e504d8727 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:13.135905 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad0e88-d85f-41fa-9ad0-c14e504d8727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:13.144816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-1fad0e88-d85f-41fa-9ad0-c14e504d8727 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:13.144816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:13.144816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:13.144816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:13.144816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:13.144816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:13.144816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:13.144816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:13.144816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:13.144816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:13.144816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:13.144816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:13.144816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:13.144816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:13.144816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:13.144816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:13.146419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:13.146419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:13.146419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:13.146419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:13.146419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:13.146419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:13.146419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:13.146419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:13.146419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:13.146419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:13.146419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:13.146419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:13.146419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:13.146419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:13.146419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:13.146419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:13.147179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:13.147179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:13.147179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:13.147179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:13.147179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:13.147179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:13.147179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:13.147179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:13.147179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:13.147179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:13.147179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:13.147179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:13.149764 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 177/337] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:13.155984 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52a957-6939-41a6-9751-63f08925c108 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:13.266115 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52a957-6939-41a6-9751-63f08925c108 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:13.306869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f620fd4-4a28-4aa0-9a4c-61171babb5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:13.307929 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f620fd4-4a28-4aa0-9a4c-61171babb5fe None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:13.308721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f620fd4-4a28-4aa0-9a4c-61171babb5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:13.309278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f620fd4-4a28-4aa0-9a4c-61171babb5fe None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:13.310256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f620fd4-4a28-4aa0-9a4c-61171babb5fe None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:13.310963 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f620fd4-4a28-4aa0-9a4c-61171babb5fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:13.312913 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f620fd4-4a28-4aa0-9a4c-61171babb5fe None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:13.327875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 161/338] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:29:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:13.334425 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad0e88-d85f-41fa-9ad0-c14e504d8727 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:13.354728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf83899-4568-4079-bc1d-31e575bfca6e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:13.355413 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf83899-4568-4079-bc1d-31e575bfca6e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:13.355895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf83899-4568-4079-bc1d-31e575bfca6e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:13.357750 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 162/339] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:29:13.360505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf3df1-f7e4-461e-a91c-978f53755e36 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:13.361025 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf3df1-f7e4-461e-a91c-978f53755e36 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:13.361512 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf3df1-f7e4-461e-a91c-978f53755e36 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:13.363189 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 163/340] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:29:13.365822 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d35f2-3601-4001-a6b8-7a6785997e54 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:13.366360 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d35f2-3601-4001-a6b8-7a6785997e54 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:13.366903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d35f2-3601-4001-a6b8-7a6785997e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:13.396865 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-488d35f2-3601-4001-a6b8-7a6785997e54 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:13.398072 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-488d35f2-3601-4001-a6b8-7a6785997e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:13.510273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad0e88-d85f-41fa-9ad0-c14e504d8727 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:13.510785 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 164/341] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:13.512091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714fa16-7290-409a-a1e9-61df802ca752 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:13.512475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714fa16-7290-409a-a1e9-61df802ca752 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:13.512734 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714fa16-7290-409a-a1e9-61df802ca752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:13.540850 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c714fa16-7290-409a-a1e9-61df802ca752 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:13.542051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c714fa16-7290-409a-a1e9-61df802ca752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:13.561195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93685029-b0f6-4c2f-bc98-d7941b443870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:13.561862 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93685029-b0f6-4c2f-bc98-d7941b443870 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:13.562141 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93685029-b0f6-4c2f-bc98-d7941b443870 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:13.562413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93685029-b0f6-4c2f-bc98-d7941b443870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:13.624878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 165/342] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:13.625735 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714fa16-7290-409a-a1e9-61df802ca752 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:13.722556 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93685029-b0f6-4c2f-bc98-d7941b443870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:13.724647 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93685029-b0f6-4c2f-bc98-d7941b443870 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:13.734211 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714fa16-7290-409a-a1e9-61df802ca752 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:13.771452 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e96f1-59ff-4a04-abe8-02ccfce0fd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:13.772087 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e96f1-59ff-4a04-abe8-02ccfce0fd5a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:13.772368 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e96f1-59ff-4a04-abe8-02ccfce0fd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:13.772675 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e96f1-59ff-4a04-abe8-02ccfce0fd5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:13.785670 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e96f1-59ff-4a04-abe8-02ccfce0fd5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:13.794420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-758e96f1-59ff-4a04-abe8-02ccfce0fd5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:29:13.794420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:13.794420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:13.794420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:13.794420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:13.794420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:13.794420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:13.794420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:13.794420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:13.794420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:13.794420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:13.794420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:13.794420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:13.794420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:13.794420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:13.794420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:13.799083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:13.799083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:13.799083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:13.799083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:13.799083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:13.799083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:13.799083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:13.799083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:13.799083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:13.799083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:13.799083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:13.799083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:13.799083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:13.799083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:13.799083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:13.799083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:13.799844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:13.799844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:13.799844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:13.799844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:13.799844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:13.799844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:13.799844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:13.799844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:13.799844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:13.799844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:13.799844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:29:13.799844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:13.799844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 166/343] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:29:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:13.799844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e96f1-59ff-4a04-abe8-02ccfce0fd5a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:13.874824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 178/344] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:13.875807 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93685029-b0f6-4c2f-bc98-d7941b443870 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:13.910352 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e96f1-59ff-4a04-abe8-02ccfce0fd5a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:13.945897 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b506c-84b7-49b7-a35a-8f4f737b0480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:13.946700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b506c-84b7-49b7-a35a-8f4f737b0480 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:13.946978 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b506c-84b7-49b7-a35a-8f4f737b0480 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:13.947256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b506c-84b7-49b7-a35a-8f4f737b0480 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:13.959028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b506c-84b7-49b7-a35a-8f4f737b0480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:13.966898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-376b506c-84b7-49b7-a35a-8f4f737b0480 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:29:13.966898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:13.966898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:13.966898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:13.966898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:13.966898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:13.966898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:13.966898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:13.966898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:13.966898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:13.966898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:13.966898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:13.966898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:13.966898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:13.966898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:13.966898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:13.974428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:13.974428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:13.974428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:13.974428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:13.974428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:13.974428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:13.974428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:13.974428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:13.974428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:13.974428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:13.974428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:13.974428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:13.974428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:13.974428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:13.974428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:13.974428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:13.976553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:13.976553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:13.976553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:13.976553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:13.976553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:13.976553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:13.976553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:13.976553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:13.976553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:13.976553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:13.976553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 17:29:13.976553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:13.976553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 167/345] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:13.976553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b506c-84b7-49b7-a35a-8f4f737b0480 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:13.980470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93685029-b0f6-4c2f-bc98-d7941b443870 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:14.019356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ebed4-7249-4e44-ae37-4e9f41684064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:14.020263 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ebed4-7249-4e44-ae37-4e9f41684064 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:14.021130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ebed4-7249-4e44-ae37-4e9f41684064 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:14.021130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ebed4-7249-4e44-ae37-4e9f41684064 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:14.021789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ebed4-7249-4e44-ae37-4e9f41684064 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:14.024499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ebed4-7249-4e44-ae37-4e9f41684064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:14.024499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ebed4-7249-4e44-ae37-4e9f41684064 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:14.037056 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 179/346] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:14.037524 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ebed4-7249-4e44-ae37-4e9f41684064 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:14.078472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b506c-84b7-49b7-a35a-8f4f737b0480 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:14.113363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda3462-5479-404c-81e5-09b4c82a3c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:14.114841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda3462-5479-404c-81e5-09b4c82a3c22 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:14.115115 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda3462-5479-404c-81e5-09b4c82a3c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:14.115365 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda3462-5479-404c-81e5-09b4c82a3c22 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:14.117590 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda3462-5479-404c-81e5-09b4c82a3c22 None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:14.119043 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda3462-5479-404c-81e5-09b4c82a3c22 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:14.120779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 168/347] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:13 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:14.121565 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda3462-5479-404c-81e5-09b4c82a3c22 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:14.148793 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ebed4-7249-4e44-ae37-4e9f41684064 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:14.182678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd0a87-897a-4dbc-9e00-0233123fbb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:14.183337 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd0a87-897a-4dbc-9e00-0233123fbb1e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:14.183614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd0a87-897a-4dbc-9e00-0233123fbb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:14.183885 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd0a87-897a-4dbc-9e00-0233123fbb1e None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:14.184650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd0a87-897a-4dbc-9e00-0233123fbb1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:14.185199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd0a87-897a-4dbc-9e00-0233123fbb1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:14.186308 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd0a87-897a-4dbc-9e00-0233123fbb1e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:14.195159 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 180/348] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:29:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:14.196050 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd0a87-897a-4dbc-9e00-0233123fbb1e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:14.230396 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda3462-5479-404c-81e5-09b4c82a3c22 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:14.268709 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2906c6-5523-4b38-8d29-abb5d9e836ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:14.269435 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2906c6-5523-4b38-8d29-abb5d9e836ab None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:14.269720 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2906c6-5523-4b38-8d29-abb5d9e836ab None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:14.270706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2906c6-5523-4b38-8d29-abb5d9e836ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:14.305561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd0a87-897a-4dbc-9e00-0233123fbb1e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:14.357852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a880cbc-ef2a-42b7-9eed-8ed4fe06b976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:14.358675 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2906c6-5523-4b38-8d29-abb5d9e836ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:14.358866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a880cbc-ef2a-42b7-9eed-8ed4fe06b976 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:14.359018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a880cbc-ef2a-42b7-9eed-8ed4fe06b976 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:14.359289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a880cbc-ef2a-42b7-9eed-8ed4fe06b976 None admin] PATH_INFO: `/v3/groups/7db85a8c23314f3ebab01abadca58494` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:14.360150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2906c6-5523-4b38-8d29-abb5d9e836ab None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:14.372306 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a880cbc-ef2a-42b7-9eed-8ed4fe06b976 None admin] RBAC: Authorizing `identity:get_group(group_id=7db85a8c23314f3ebab01abadca58494)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:14.373814 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a880cbc-ef2a-42b7-9eed-8ed4fe06b976 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:14.375590 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 181/349] 10.222.0.81 () {56 vars in 1180 bytes} [Wed May 4 17:29:14 2022] GET /identity/v3/groups/7db85a8c23314f3ebab01abadca58494 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:14.376449 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a880cbc-ef2a-42b7-9eed-8ed4fe06b976 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:14.495842 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 169/350] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:14.496739 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2906c6-5523-4b38-8d29-abb5d9e836ab None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:14.504375 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a880cbc-ef2a-42b7-9eed-8ed4fe06b976 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:14.544991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c19fa1-0b95-4781-b08b-f7d741a7b966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:14.544991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c19fa1-0b95-4781-b08b-f7d741a7b966 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:14.544991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c19fa1-0b95-4781-b08b-f7d741a7b966 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:14.544991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c19fa1-0b95-4781-b08b-f7d741a7b966 None admin] PATH_INFO: `/v3/users/04cef802f048478aad5ed2d7a5207aab` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:14.545730 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c19fa1-0b95-4781-b08b-f7d741a7b966 None admin] RBAC: Authorizing `identity:get_user(user_id=04cef802f048478aad5ed2d7a5207aab)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:14.547041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c19fa1-0b95-4781-b08b-f7d741a7b966 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:14.549895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 182/351] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:29:14 2022] GET /identity/v3/users/04cef802f048478aad5ed2d7a5207aab => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:14.550753 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c19fa1-0b95-4781-b08b-f7d741a7b966 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:14.657615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2906c6-5523-4b38-8d29-abb5d9e836ab None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:14.666801 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c19fa1-0b95-4781-b08b-f7d741a7b966 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:14.698634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a8c41-dc88-41e4-8fc0-58242c78bdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:14.699299 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a8c41-dc88-41e4-8fc0-58242c78bdd2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:14.699588 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a8c41-dc88-41e4-8fc0-58242c78bdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:14.699867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a8c41-dc88-41e4-8fc0-58242c78bdd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:14.700752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a8c41-dc88-41e4-8fc0-58242c78bdd2 None admin] RBAC: Adding query filter params (group.id=7db85a8c23314f3ebab01abadca58494, role.id=42b0adbc87e347e18bd4412dc9e421c1, scope.project.id=0c51097d14c64e869f8ce7b3df492b61) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:14.701074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a8c41-dc88-41e4-8fc0-58242c78bdd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:14.702521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a8c41-dc88-41e4-8fc0-58242c78bdd2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:14.707073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b0811-b1cc-4cc5-bc2b-f13270974942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:14.710556 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b0811-b1cc-4cc5-bc2b-f13270974942 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:14.710556 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b0811-b1cc-4cc5-bc2b-f13270974942 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:14.710767 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 170/352] 10.222.0.81 () {56 vars in 1376 bytes} [Wed May 4 17:29:14 2022] GET /identity/v3/role_assignments?group.id=7db85a8c23314f3ebab01abadca58494&scope.project.id=0c51097d14c64e869f8ce7b3df492b61&role.id=42b0adbc87e347e18bd4412dc9e421c1 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:14.710839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b0811-b1cc-4cc5-bc2b-f13270974942 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:14.710905 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a8c41-dc88-41e4-8fc0-58242c78bdd2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:14.710969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b0811-b1cc-4cc5-bc2b-f13270974942 None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:14.716476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b0811-b1cc-4cc5-bc2b-f13270974942 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:14.716476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 183/353] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:14 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:14.716476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac86072-1421-4755-a2e2-e4903f96127d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:14.716476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac86072-1421-4755-a2e2-e4903f96127d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:14.716476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac86072-1421-4755-a2e2-e4903f96127d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:14.717243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 184/354] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:14.718395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e6c9a-c36f-42a0-9df6-de11ffc487e0 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:14.718683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e6c9a-c36f-42a0-9df6-de11ffc487e0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:14.718958 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e6c9a-c36f-42a0-9df6-de11ffc487e0 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:14.724772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 185/355] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:14.725747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e6c9a-c36f-42a0-9df6-de11ffc487e0 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:14.839903 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e6c9a-c36f-42a0-9df6-de11ffc487e0 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:14.849277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a8c41-dc88-41e4-8fc0-58242c78bdd2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:14.877062 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6731b-3834-489b-9055-01c54df834d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:14.877932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6731b-3834-489b-9055-01c54df834d5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:14.878212 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6731b-3834-489b-9055-01c54df834d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:14.878486 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6731b-3834-489b-9055-01c54df834d5 None admin] PATH_INFO: `/v3/groups/7db85a8c23314f3ebab01abadca58494` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:14.880336 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6731b-3834-489b-9055-01c54df834d5 None admin] RBAC: Authorizing `identity:get_group(group_id=7db85a8c23314f3ebab01abadca58494)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:14.882105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6731b-3834-489b-9055-01c54df834d5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:14.883827 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 186/356] 10.222.0.81 () {56 vars in 1180 bytes} [Wed May 4 17:29:14 2022] GET /identity/v3/groups/7db85a8c23314f3ebab01abadca58494 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:14.893613 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127d99-fea2-4789-8dd4-a2a2dadbcf9a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:14.893613 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127d99-fea2-4789-8dd4-a2a2dadbcf9a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:14.893613 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127d99-fea2-4789-8dd4-a2a2dadbcf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:14.896207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6996d80-9463-4ab5-b75f-8e0ad6ea0955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:14.896991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6996d80-9463-4ab5-b75f-8e0ad6ea0955 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:14.897307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6996d80-9463-4ab5-b75f-8e0ad6ea0955 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:14.897588 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6996d80-9463-4ab5-b75f-8e0ad6ea0955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:14.898452 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6996d80-9463-4ab5-b75f-8e0ad6ea0955 None admin] RBAC: Adding query filter params (role.id=14898ff2d2954978a29cb0b4cb85ba7e, user.id=04cef802f048478aad5ed2d7a5207aab, scope.system=all) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:14.898768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6996d80-9463-4ab5-b75f-8e0ad6ea0955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:14.900287 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6996d80-9463-4ab5-b75f-8e0ad6ea0955 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:14.910180 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2a127d99-fea2-4789-8dd4-a2a2dadbcf9a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:14.911519 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2a127d99-fea2-4789-8dd4-a2a2dadbcf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:14.914995 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 171/357] 10.222.0.81 () {56 vars in 1308 bytes} [Wed May 4 17:29:14 2022] GET /identity/v3/role_assignments?user.id=04cef802f048478aad5ed2d7a5207aab&scope.system=all&role.id=14898ff2d2954978a29cb0b4cb85ba7e => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:14.925267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b46e7-5a1d-4908-9bac-11929818f379 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:14.925584 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b46e7-5a1d-4908-9bac-11929818f379 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:14.925846 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b46e7-5a1d-4908-9bac-11929818f379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:14.955855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4a9b46e7-5a1d-4908-9bac-11929818f379 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:14.958040 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4a9b46e7-5a1d-4908-9bac-11929818f379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:15.005643 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 187/358] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:15.006977 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a127d99-fea2-4789-8dd4-a2a2dadbcf9a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:15.079607 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 172/359] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:15.080471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b46e7-5a1d-4908-9bac-11929818f379 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:15.143123 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a127d99-fea2-4789-8dd4-a2a2dadbcf9a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:15.217177 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b46e7-5a1d-4908-9bac-11929818f379 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:15.221697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df799dd-f2bb-4ff8-9ec7-2afba3975527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:15.222365 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df799dd-f2bb-4ff8-9ec7-2afba3975527 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:15.222639 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df799dd-f2bb-4ff8-9ec7-2afba3975527 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:15.223494 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df799dd-f2bb-4ff8-9ec7-2afba3975527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:15.224342 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df799dd-f2bb-4ff8-9ec7-2afba3975527 None admin] RBAC: Adding query filter params (group.id=7db85a8c23314f3ebab01abadca58494, role.id=8c1bc4243dcc46979dd8ca40186c0ca7, scope.project.id=0c51097d14c64e869f8ce7b3df492b61) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:15.224682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df799dd-f2bb-4ff8-9ec7-2afba3975527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:15.226153 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df799dd-f2bb-4ff8-9ec7-2afba3975527 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:15.240766 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 188/360] 10.222.0.81 () {56 vars in 1376 bytes} [Wed May 4 17:29:15 2022] GET /identity/v3/role_assignments?group.id=7db85a8c23314f3ebab01abadca58494&scope.project.id=0c51097d14c64e869f8ce7b3df492b61&role.id=8c1bc4243dcc46979dd8ca40186c0ca7 => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:15.241629 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df799dd-f2bb-4ff8-9ec7-2afba3975527 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:15.300206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a84ca4-ef68-4b8e-973b-40a430294c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:15.301716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a84ca4-ef68-4b8e-973b-40a430294c6d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:15.301975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a84ca4-ef68-4b8e-973b-40a430294c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:15.302245 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a84ca4-ef68-4b8e-973b-40a430294c6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:15.328571 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a84ca4-ef68-4b8e-973b-40a430294c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:15.337249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-38a84ca4-ef68-4b8e-973b-40a430294c6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:15.337249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:15.337249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:15.337249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:15.337249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:15.337249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:15.337249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:15.337249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:15.337249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:15.337249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:15.337249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:15.337249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:15.337249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:15.337249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:15.337249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:15.337249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:15.338222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:15.338222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:15.338222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:15.338222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:15.338222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:15.338222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:15.338222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:15.338222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:15.338222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:15.338222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:15.338222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:15.338222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:15.338222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:15.338222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:15.338222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:15.338222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:15.339001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:15.339001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:15.339001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:15.339001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:15.339001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:15.339001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:15.339001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:15.339001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:15.339001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:15.339001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:15.339001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:15.339001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:15.339001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 173/361] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:15.350077 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a84ca4-ef68-4b8e-973b-40a430294c6d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:15.445958 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df799dd-f2bb-4ff8-9ec7-2afba3975527 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:15.518203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2c530-e5a0-4188-add9-d4d7d9b6d628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:15.519021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2c530-e5a0-4188-add9-d4d7d9b6d628 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:15.519299 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2c530-e5a0-4188-add9-d4d7d9b6d628 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:15.519571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2c530-e5a0-4188-add9-d4d7d9b6d628 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:15.541227 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2c530-e5a0-4188-add9-d4d7d9b6d628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:15.549538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-26e2c530-e5a0-4188-add9-d4d7d9b6d628 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:29:15.549538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:15.549538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:15.549538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:15.549538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:15.549538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:15.549538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:15.549538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:15.549538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:15.549538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:15.549538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:15.549538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:15.549538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:15.549538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:15.549538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:15.549538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:15.550454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:15.550454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:15.550454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:15.550454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:15.550454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:15.550454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:15.550454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:15.550454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:15.550454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:15.550454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:15.550454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:15.550454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:15.550454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:15.550454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:15.550454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:15.550454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:15.552286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:15.552286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:15.552286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:15.552286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:15.552286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:15.552286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:15.552286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:15.552286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:15.552286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:15.552286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:15.552286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:29:15.552286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:15.552286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 189/362] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:29:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:15.564999 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a84ca4-ef68-4b8e-973b-40a430294c6d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:15.574041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2c530-e5a0-4188-add9-d4d7d9b6d628 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:15.626868 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ea46e-008a-4849-9f0d-ddfd92251226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:15.627595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ea46e-008a-4849-9f0d-ddfd92251226 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:15.627884 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ea46e-008a-4849-9f0d-ddfd92251226 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:15.628156 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ea46e-008a-4849-9f0d-ddfd92251226 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:15.629926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ea46e-008a-4849-9f0d-ddfd92251226 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:15.630237 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ea46e-008a-4849-9f0d-ddfd92251226 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:15.631687 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ea46e-008a-4849-9f0d-ddfd92251226 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:15.650996 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 174/363] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:29:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:15.678468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ea46e-008a-4849-9f0d-ddfd92251226 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:15.711057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2c530-e5a0-4188-add9-d4d7d9b6d628 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:15.750346 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d1431-820a-473d-8aa4-6a9104438a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:15.751012 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d1431-820a-473d-8aa4-6a9104438a4c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:15.751290 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d1431-820a-473d-8aa4-6a9104438a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:15.751561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d1431-820a-473d-8aa4-6a9104438a4c None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:15.752308 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d1431-820a-473d-8aa4-6a9104438a4c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:15.752651 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d1431-820a-473d-8aa4-6a9104438a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:15.754876 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d1431-820a-473d-8aa4-6a9104438a4c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:15.764266 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 190/364] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:15.765823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105decd-18a2-4358-a625-efcfbdf1890e None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:15.766011 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105decd-18a2-4358-a625-efcfbdf1890e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:15.766291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105decd-18a2-4358-a625-efcfbdf1890e None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:15.772417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 191/365] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:15.773377 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105decd-18a2-4358-a625-efcfbdf1890e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:15.827657 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ea46e-008a-4849-9f0d-ddfd92251226 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:15.874313 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836bf27-4aa4-4e99-8c58-eb16164ecddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:15.875031 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836bf27-4aa4-4e99-8c58-eb16164ecddc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:15.875315 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836bf27-4aa4-4e99-8c58-eb16164ecddc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:15.875589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836bf27-4aa4-4e99-8c58-eb16164ecddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:15.898459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105decd-18a2-4358-a625-efcfbdf1890e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:15.944470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efa4a6-6af3-45e5-affb-2fb40815e540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:15.945538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efa4a6-6af3-45e5-affb-2fb40815e540 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:15.945824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efa4a6-6af3-45e5-affb-2fb40815e540 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:15.946102 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efa4a6-6af3-45e5-affb-2fb40815e540 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:15.959307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836bf27-4aa4-4e99-8c58-eb16164ecddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:15.960814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836bf27-4aa4-4e99-8c58-eb16164ecddc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:16.036836 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efa4a6-6af3-45e5-affb-2fb40815e540 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:16.039270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efa4a6-6af3-45e5-affb-2fb40815e540 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:16.081228 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 175/366] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:16.083017 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91106c8d-7e55-47f9-ac72-b932f2cb190a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:16.083537 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91106c8d-7e55-47f9-ac72-b932f2cb190a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:16.084024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91106c8d-7e55-47f9-ac72-b932f2cb190a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:16.101035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-91106c8d-7e55-47f9-ac72-b932f2cb190a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:16.102556 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-91106c8d-7e55-47f9-ac72-b932f2cb190a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:16.149290 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 192/367] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:16.149650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efa4a6-6af3-45e5-affb-2fb40815e540 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:16.178012 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 176/368] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:16.179300 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91106c8d-7e55-47f9-ac72-b932f2cb190a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:16.256206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efa4a6-6af3-45e5-affb-2fb40815e540 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:16.285650 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91106c8d-7e55-47f9-ac72-b932f2cb190a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:16.294804 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c67c5-5b0e-4a4e-a97b-0dfd4dc2ee3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:16.295590 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c67c5-5b0e-4a4e-a97b-0dfd4dc2ee3f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:16.295868 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c67c5-5b0e-4a4e-a97b-0dfd4dc2ee3f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:16.296141 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c67c5-5b0e-4a4e-a97b-0dfd4dc2ee3f None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:16.297685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c67c5-5b0e-4a4e-a97b-0dfd4dc2ee3f None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:16.299204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c67c5-5b0e-4a4e-a97b-0dfd4dc2ee3f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:16.302671 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 193/369] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:16 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:16.303635 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c67c5-5b0e-4a4e-a97b-0dfd4dc2ee3f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:16.324725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5efb3-9256-4e8f-9bcc-b61c2b425e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:16.325943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5efb3-9256-4e8f-9bcc-b61c2b425e02 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:16.326451 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5efb3-9256-4e8f-9bcc-b61c2b425e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:16.326925 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5efb3-9256-4e8f-9bcc-b61c2b425e02 None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:16.328356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5efb3-9256-4e8f-9bcc-b61c2b425e02 None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:16.330028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5efb3-9256-4e8f-9bcc-b61c2b425e02 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:16.332311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 177/370] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:16 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:16.333418 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5efb3-9256-4e8f-9bcc-b61c2b425e02 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:16.408113 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c67c5-5b0e-4a4e-a97b-0dfd4dc2ee3f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:16.434946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5efb3-9256-4e8f-9bcc-b61c2b425e02 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:16.445847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb09518-d095-4c40-83f1-8c5ab77d235c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:16.446646 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb09518-d095-4c40-83f1-8c5ab77d235c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:16.446925 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb09518-d095-4c40-83f1-8c5ab77d235c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:16.447198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb09518-d095-4c40-83f1-8c5ab77d235c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:16.457583 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb09518-d095-4c40-83f1-8c5ab77d235c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:16.465414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7cb09518-d095-4c40-83f1-8c5ab77d235c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:29:16.465414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:16.465414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:16.465414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:16.465414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:16.465414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:16.465414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:16.465414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:16.465414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:16.465414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:16.465414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:16.465414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:16.465414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:16.465414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:16.465414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:16.465414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:16.466314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:16.466314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:16.466314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:16.466314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:16.466314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:16.466314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:16.466314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:16.466314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:16.466314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:16.466314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:16.466314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:16.466314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:16.466314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:16.466314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:16.466314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:16.466314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:16.467499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:16.467499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:16.467499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:16.467499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:16.467499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:16.467499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:16.467499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:16.467499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:16.467499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:16.467499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:16.467499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:29:16.467499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:16.467499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 194/371] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:29:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:16.468316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb09518-d095-4c40-83f1-8c5ab77d235c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:16.469272 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5348e7-8e73-4879-bee0-b917788f0f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:16.470132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5348e7-8e73-4879-bee0-b917788f0f62 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:16.470418 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5348e7-8e73-4879-bee0-b917788f0f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:16.470701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5348e7-8e73-4879-bee0-b917788f0f62 None admin] PATH_INFO: `/v3/groups/7db85a8c23314f3ebab01abadca58494` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:16.471895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5348e7-8e73-4879-bee0-b917788f0f62 None admin] RBAC: Authorizing `identity:get_group(group_id=7db85a8c23314f3ebab01abadca58494)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:16.473440 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5348e7-8e73-4879-bee0-b917788f0f62 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:16.475246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 178/372] 10.222.0.81 () {56 vars in 1180 bytes} [Wed May 4 17:29:16 2022] GET /identity/v3/groups/7db85a8c23314f3ebab01abadca58494 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:16.476164 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5348e7-8e73-4879-bee0-b917788f0f62 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:16.588183 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb09518-d095-4c40-83f1-8c5ab77d235c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:16.591210 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5348e7-8e73-4879-bee0-b917788f0f62 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:16.623238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fc259-7611-42b3-b98f-8e6710a676cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:16.624162 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fc259-7611-42b3-b98f-8e6710a676cf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:16.624454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fc259-7611-42b3-b98f-8e6710a676cf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:16.624741 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fc259-7611-42b3-b98f-8e6710a676cf None admin] PATH_INFO: `/v3/groups/7db85a8c23314f3ebab01abadca58494` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:16.626127 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060fc259-7611-42b3-b98f-8e6710a676cf None admin] RBAC: Authorizing `identity:get_group(group_id=7db85a8c23314f3ebab01abadca58494)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:16.626296 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c25c1-8ffd-4420-a4ed-6b52f9275e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:16.626968 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c25c1-8ffd-4420-a4ed-6b52f9275e21 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:16.627257 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c25c1-8ffd-4420-a4ed-6b52f9275e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:16.627532 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c25c1-8ffd-4420-a4ed-6b52f9275e21 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:16.627628 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060fc259-7611-42b3-b98f-8e6710a676cf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:16.628290 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c25c1-8ffd-4420-a4ed-6b52f9275e21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:16.629548 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c25c1-8ffd-4420-a4ed-6b52f9275e21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:16.630642 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 195/373] 10.222.0.81 () {56 vars in 1180 bytes} [Wed May 4 17:29:16 2022] GET /identity/v3/groups/7db85a8c23314f3ebab01abadca58494 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:16.631002 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c25c1-8ffd-4420-a4ed-6b52f9275e21 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:16.631574 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fc259-7611-42b3-b98f-8e6710a676cf None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:16.646597 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 179/374] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:16.647706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c25c1-8ffd-4420-a4ed-6b52f9275e21 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:16.737011 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fc259-7611-42b3-b98f-8e6710a676cf None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:16.760286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c25c1-8ffd-4420-a4ed-6b52f9275e21 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:16.776406 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e46e26-aba7-4340-a989-ad22b9611004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:16.777100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e46e26-aba7-4340-a989-ad22b9611004 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:16.777389 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e46e26-aba7-4340-a989-ad22b9611004 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:16.777657 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e46e26-aba7-4340-a989-ad22b9611004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:16.778584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e46e26-aba7-4340-a989-ad22b9611004 None admin] RBAC: Adding query filter params (group.id=7db85a8c23314f3ebab01abadca58494, role.id=42b0adbc87e347e18bd4412dc9e421c1, scope.project.id=9d591a594b164a30b9a0094d1803ba23) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:16.778975 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e46e26-aba7-4340-a989-ad22b9611004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:16.780503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e46e26-aba7-4340-a989-ad22b9611004 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:16.786817 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 196/375] 10.222.0.81 () {56 vars in 1376 bytes} [Wed May 4 17:29:16 2022] GET /identity/v3/role_assignments?group.id=7db85a8c23314f3ebab01abadca58494&scope.project.id=9d591a594b164a30b9a0094d1803ba23&role.id=42b0adbc87e347e18bd4412dc9e421c1 => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:16.787645 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e46e26-aba7-4340-a989-ad22b9611004 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:16.799309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b88c8f-7057-4ec8-bcaa-0d3d18695286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:16.800235 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b88c8f-7057-4ec8-bcaa-0d3d18695286 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:16.800788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b88c8f-7057-4ec8-bcaa-0d3d18695286 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:16.801383 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b88c8f-7057-4ec8-bcaa-0d3d18695286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:16.802438 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b88c8f-7057-4ec8-bcaa-0d3d18695286 None admin] RBAC: Adding query filter params (group.id=7db85a8c23314f3ebab01abadca58494, role.id=8c1bc4243dcc46979dd8ca40186c0ca7, scope.project.id=9d591a594b164a30b9a0094d1803ba23) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:16.802948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b88c8f-7057-4ec8-bcaa-0d3d18695286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:16.804593 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b88c8f-7057-4ec8-bcaa-0d3d18695286 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:16.811665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 180/376] 10.222.0.81 () {56 vars in 1376 bytes} [Wed May 4 17:29:16 2022] GET /identity/v3/role_assignments?group.id=7db85a8c23314f3ebab01abadca58494&scope.project.id=9d591a594b164a30b9a0094d1803ba23&role.id=8c1bc4243dcc46979dd8ca40186c0ca7 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:16.907774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e46e26-aba7-4340-a989-ad22b9611004 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:16.947417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4711f-795c-4208-925b-24ac941f2507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:16.948116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4711f-795c-4208-925b-24ac941f2507 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:16.948396 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4711f-795c-4208-925b-24ac941f2507 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:16.948707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4711f-795c-4208-925b-24ac941f2507 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:17.029816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4711f-795c-4208-925b-24ac941f2507 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:17.030381 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4711f-795c-4208-925b-24ac941f2507 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:17.140801 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 197/377] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:17.146817 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b88c8f-7057-4ec8-bcaa-0d3d18695286 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:17.257230 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b88c8f-7057-4ec8-bcaa-0d3d18695286 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:17.293868 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b627d2-3a7e-4b5f-8d09-da839cb7bd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:17.294733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b627d2-3a7e-4b5f-8d09-da839cb7bd9c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:17.295016 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b627d2-3a7e-4b5f-8d09-da839cb7bd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:17.295292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b627d2-3a7e-4b5f-8d09-da839cb7bd9c None admin] PATH_INFO: `/v3/projects/24f269e9f1b44f73928e694fdc60f6bd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:17.296596 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b627d2-3a7e-4b5f-8d09-da839cb7bd9c None admin] RBAC: Authorizing `identity:get_project(project_id=24f269e9f1b44f73928e694fdc60f6bd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:17.298061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b627d2-3a7e-4b5f-8d09-da839cb7bd9c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:17.300197 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 181/378] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:17 2022] GET /identity/v3/projects/24f269e9f1b44f73928e694fdc60f6bd => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:17.306361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4711f-795c-4208-925b-24ac941f2507 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:17.432500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4711f-795c-4208-925b-24ac941f2507 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:17.469901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50923469-ce44-4644-8199-e63b35e4dada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:17.470811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50923469-ce44-4644-8199-e63b35e4dada None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:17.471084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50923469-ce44-4644-8199-e63b35e4dada None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:17.471348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50923469-ce44-4644-8199-e63b35e4dada None admin] PATH_INFO: `/v3/groups/e43e228521b74e5e806fc7486e51f097` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:17.477875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50923469-ce44-4644-8199-e63b35e4dada None admin] RBAC: Authorizing `identity:get_group(group_id=e43e228521b74e5e806fc7486e51f097)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:17.479340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50923469-ce44-4644-8199-e63b35e4dada None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:17.481334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 198/379] 10.222.0.81 () {56 vars in 1180 bytes} [Wed May 4 17:29:17 2022] GET /identity/v3/groups/e43e228521b74e5e806fc7486e51f097 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:17.494998 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b627d2-3a7e-4b5f-8d09-da839cb7bd9c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:17.614724 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b627d2-3a7e-4b5f-8d09-da839cb7bd9c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:17.653148 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4543623-0df5-48ea-b609-48faf4cb2a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:17.653814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4543623-0df5-48ea-b609-48faf4cb2a65 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:17.654098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4543623-0df5-48ea-b609-48faf4cb2a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:17.654375 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4543623-0df5-48ea-b609-48faf4cb2a65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:17.655224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4543623-0df5-48ea-b609-48faf4cb2a65 None admin] RBAC: Adding query filter params (group.id=e43e228521b74e5e806fc7486e51f097, role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=24f269e9f1b44f73928e694fdc60f6bd) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:17.655540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4543623-0df5-48ea-b609-48faf4cb2a65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:17.656999 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4543623-0df5-48ea-b609-48faf4cb2a65 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:17.663727 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 182/380] 10.222.0.81 () {56 vars in 1376 bytes} [Wed May 4 17:29:17 2022] GET /identity/v3/role_assignments?group.id=e43e228521b74e5e806fc7486e51f097&scope.project.id=24f269e9f1b44f73928e694fdc60f6bd&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:17.941185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78735c-1e72-4210-b38f-f93e263fd3b6 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:17.942240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78735c-1e72-4210-b38f-f93e263fd3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:17.942240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78735c-1e72-4210-b38f-f93e263fd3b6 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:17.943951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 199/381] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:17.949895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0359ba6-34dc-49c4-9764-5780c666d026 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:17.950184 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0359ba6-34dc-49c4-9764-5780c666d026 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:17.950455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0359ba6-34dc-49c4-9764-5780c666d026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:17.974073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e0359ba6-34dc-49c4-9764-5780c666d026 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:17.975619 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e0359ba6-34dc-49c4-9764-5780c666d026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:18.009212 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324f9f2-eee5-4305-a276-89fb3cac6389 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:18.009838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324f9f2-eee5-4305-a276-89fb3cac6389 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:18.010320 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324f9f2-eee5-4305-a276-89fb3cac6389 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:18.012318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 200/382] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:18.017753 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57210a6d-a6e6-4de1-ba91-d50fafa4d983 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:18.018037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57210a6d-a6e6-4de1-ba91-d50fafa4d983 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:18.018323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57210a6d-a6e6-4de1-ba91-d50fafa4d983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:18.051102 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-57210a6d-a6e6-4de1-ba91-d50fafa4d983 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:18.052311 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-57210a6d-a6e6-4de1-ba91-d50fafa4d983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:18.058172 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 183/383] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:18.083344 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0359ba6-34dc-49c4-9764-5780c666d026 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:18.152217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 201/384] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:18.186355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57210a6d-a6e6-4de1-ba91-d50fafa4d983 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:18.186903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0359ba6-34dc-49c4-9764-5780c666d026 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:18.225000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a1c4b-92f2-4689-bb06-facdb294089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:18.226178 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a1c4b-92f2-4689-bb06-facdb294089f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:18.226664 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a1c4b-92f2-4689-bb06-facdb294089f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:18.227139 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a1c4b-92f2-4689-bb06-facdb294089f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:18.238092 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a1c4b-92f2-4689-bb06-facdb294089f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:18.246267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c08a1c4b-92f2-4689-bb06-facdb294089f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:18.246267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:18.246267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:18.246267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:18.246267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:18.246267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:18.246267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:18.246267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:18.246267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:18.246267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:18.246267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:18.246267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:18.246267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:18.246267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:18.246267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:18.246267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:18.247181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:18.247181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:18.247181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:18.247181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:18.247181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:18.247181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:18.247181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:18.247181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:18.247181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:18.247181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:18.247181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:18.247181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:18.247181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:18.247181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:18.247181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:18.247181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:18.247967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:18.247967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:18.247967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:18.247967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:18.247967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:18.247967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:18.247967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:18.247967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:18.247967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:18.247967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:18.247967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:18.247967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:18.250684 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 184/385] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:18.257644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a1c4b-92f2-4689-bb06-facdb294089f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:18.364104 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a1c4b-92f2-4689-bb06-facdb294089f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:18.400884 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461f382-7b02-4663-a4bf-a7c5a825065a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:18.401900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461f382-7b02-4663-a4bf-a7c5a825065a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:18.402384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461f382-7b02-4663-a4bf-a7c5a825065a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:18.402857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461f382-7b02-4663-a4bf-a7c5a825065a None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:18.403808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461f382-7b02-4663-a4bf-a7c5a825065a None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:18.404360 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461f382-7b02-4663-a4bf-a7c5a825065a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:18.405967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461f382-7b02-4663-a4bf-a7c5a825065a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:18.415841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 185/386] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:29:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:18.421726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461f382-7b02-4663-a4bf-a7c5a825065a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:18.423829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57210a6d-a6e6-4de1-ba91-d50fafa4d983 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:18.475785 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb2bc5-4189-48d4-a71a-435428f7e826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:18.476347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb2bc5-4189-48d4-a71a-435428f7e826 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:18.476658 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb2bc5-4189-48d4-a71a-435428f7e826 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:18.476928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb2bc5-4189-48d4-a71a-435428f7e826 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:18.501048 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb2bc5-4189-48d4-a71a-435428f7e826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:18.509770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-afdb2bc5-4189-48d4-a71a-435428f7e826 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:29:18.509770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:18.509770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:18.509770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:18.509770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:18.509770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:18.509770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:18.509770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:18.509770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:18.509770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:18.509770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:18.509770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:18.509770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:18.509770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:18.509770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:18.509770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:18.510686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:18.510686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:18.510686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:18.510686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:18.510686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:18.510686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:18.510686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:18.510686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:18.510686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:18.510686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:18.510686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:18.510686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:18.510686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:18.510686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:18.510686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:18.510686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:18.511460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:18.511460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:18.511460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:18.511460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:18.511460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:18.511460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:18.511460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:18.511460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:18.511460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:18.511460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:18.511460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:29:18.511460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:18.511460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 202/387] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:29:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:29:18.519067 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb2bc5-4189-48d4-a71a-435428f7e826 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:18.533455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461f382-7b02-4663-a4bf-a7c5a825065a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:18.569078 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c6214-0c2f-4e6e-ac26-fa725ca28a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:18.570299 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c6214-0c2f-4e6e-ac26-fa725ca28a99 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:18.570801 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c6214-0c2f-4e6e-ac26-fa725ca28a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:18.571276 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c6214-0c2f-4e6e-ac26-fa725ca28a99 None admin] PATH_INFO: `/v3/groups/7db85a8c23314f3ebab01abadca58494` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:18.572831 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c6214-0c2f-4e6e-ac26-fa725ca28a99 None admin] RBAC: Authorizing `identity:get_group(group_id=7db85a8c23314f3ebab01abadca58494)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:18.574489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c6214-0c2f-4e6e-ac26-fa725ca28a99 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:18.576635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 186/388] 10.222.0.81 () {56 vars in 1180 bytes} [Wed May 4 17:29:18 2022] GET /identity/v3/groups/7db85a8c23314f3ebab01abadca58494 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:18.582425 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c6214-0c2f-4e6e-ac26-fa725ca28a99 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:18.687808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c6214-0c2f-4e6e-ac26-fa725ca28a99 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:18.724833 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184da6e-4e9f-4477-b3a2-02b04bebea56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:18.726183 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184da6e-4e9f-4477-b3a2-02b04bebea56 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:18.726676 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184da6e-4e9f-4477-b3a2-02b04bebea56 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:18.727217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184da6e-4e9f-4477-b3a2-02b04bebea56 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:18.728668 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184da6e-4e9f-4477-b3a2-02b04bebea56 None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:18.730306 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184da6e-4e9f-4477-b3a2-02b04bebea56 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:18.736265 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 187/389] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:18 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:18.739067 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184da6e-4e9f-4477-b3a2-02b04bebea56 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:18.749172 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb2bc5-4189-48d4-a71a-435428f7e826 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:18.839904 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898af89e-bb4a-4401-8d64-369bdf6ca09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:18.840524 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af89e-bb4a-4401-8d64-369bdf6ca09b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:18.840802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af89e-bb4a-4401-8d64-369bdf6ca09b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:18.841071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af89e-bb4a-4401-8d64-369bdf6ca09b None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:18.841822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898af89e-bb4a-4401-8d64-369bdf6ca09b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:18.842117 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898af89e-bb4a-4401-8d64-369bdf6ca09b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:18.843476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898af89e-bb4a-4401-8d64-369bdf6ca09b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:18.850139 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184da6e-4e9f-4477-b3a2-02b04bebea56 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:18.860080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 203/390] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:18.867072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898af89e-bb4a-4401-8d64-369bdf6ca09b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:18.894024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53486762-0b24-4368-be87-4d3e7234965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:18.895478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53486762-0b24-4368-be87-4d3e7234965b None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:18.895966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53486762-0b24-4368-be87-4d3e7234965b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:18.896527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53486762-0b24-4368-be87-4d3e7234965b None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61/groups/7db85a8c23314f3ebab01abadca58494/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:18.899700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53486762-0b24-4368-be87-4d3e7234965b None admin] RBAC: Authorizing `identity:create_grant(project_id=0c51097d14c64e869f8ce7b3df492b61, group_id=7db85a8c23314f3ebab01abadca58494, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:18.902693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53486762-0b24-4368-be87-4d3e7234965b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:18.995720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898af89e-bb4a-4401-8d64-369bdf6ca09b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:19.004779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 188/391] 10.222.0.81 () {58 vars in 1442 bytes} [Wed May 4 17:29:18 2022] PUT /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61/groups/7db85a8c23314f3ebab01abadca58494/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:29:19.039881 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617691e-e7ee-4aae-942d-b4d33aa16f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:19.040795 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617691e-e7ee-4aae-942d-b4d33aa16f2d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:19.041063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617691e-e7ee-4aae-942d-b4d33aa16f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:19.041335 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617691e-e7ee-4aae-942d-b4d33aa16f2d None admin] PATH_INFO: `/v3/groups/7db85a8c23314f3ebab01abadca58494` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:19.042554 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617691e-e7ee-4aae-942d-b4d33aa16f2d None admin] RBAC: Authorizing `identity:get_group(group_id=7db85a8c23314f3ebab01abadca58494)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:19.044015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617691e-e7ee-4aae-942d-b4d33aa16f2d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:19.046069 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 204/392] 10.222.0.81 () {56 vars in 1180 bytes} [Wed May 4 17:29:18 2022] GET /identity/v3/groups/7db85a8c23314f3ebab01abadca58494 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:19.053511 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53486762-0b24-4368-be87-4d3e7234965b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:19.204706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53486762-0b24-4368-be87-4d3e7234965b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:19.241226 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c972e4b-8cd4-4582-8544-b8cef929447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:19.242448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c972e4b-8cd4-4582-8544-b8cef929447e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:19.242943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c972e4b-8cd4-4582-8544-b8cef929447e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:19.243406 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c972e4b-8cd4-4582-8544-b8cef929447e None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:19.244850 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c972e4b-8cd4-4582-8544-b8cef929447e None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:19.246615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c972e4b-8cd4-4582-8544-b8cef929447e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:19.248951 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 189/393] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:19 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:19.256742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617691e-e7ee-4aae-942d-b4d33aa16f2d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:19.370157 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617691e-e7ee-4aae-942d-b4d33aa16f2d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:19.411924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb90d71-751a-4b37-8e30-7ed3574a1c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:19.412847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb90d71-751a-4b37-8e30-7ed3574a1c28 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:19.413212 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb90d71-751a-4b37-8e30-7ed3574a1c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:19.413483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb90d71-751a-4b37-8e30-7ed3574a1c28 None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61/groups/7db85a8c23314f3ebab01abadca58494/roles/8c1bc4243dcc46979dd8ca40186c0ca7` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:19.415721 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb90d71-751a-4b37-8e30-7ed3574a1c28 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c51097d14c64e869f8ce7b3df492b61, group_id=7db85a8c23314f3ebab01abadca58494, role_id=8c1bc4243dcc46979dd8ca40186c0ca7)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:19.417281 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb90d71-751a-4b37-8e30-7ed3574a1c28 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:19.491341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 205/394] 10.222.0.81 () {58 vars in 1442 bytes} [Wed May 4 17:29:19 2022] PUT /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61/groups/7db85a8c23314f3ebab01abadca58494/roles/8c1bc4243dcc46979dd8ca40186c0ca7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:29:19.890491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931f773-9eb4-48f8-91ad-aca031cd8f8a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:19.890917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931f773-9eb4-48f8-91ad-aca031cd8f8a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:19.891162 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931f773-9eb4-48f8-91ad-aca031cd8f8a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:19.892690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 190/395] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:19.897988 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8915a5-2c39-4b7f-866e-76e2d1b85dbd None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:19.898269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8915a5-2c39-4b7f-866e-76e2d1b85dbd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:19.898539 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8915a5-2c39-4b7f-866e-76e2d1b85dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:19.919238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-bc8915a5-2c39-4b7f-866e-76e2d1b85dbd None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:19.920608 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bc8915a5-2c39-4b7f-866e-76e2d1b85dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:20.000467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 206/396] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:20.037857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931f773-9eb4-48f8-91ad-aca031cd8f8a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:20.180946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931f773-9eb4-48f8-91ad-aca031cd8f8a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:20.221996 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad908478-f656-410a-be9b-b652679e53be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:20.224196 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad908478-f656-410a-be9b-b652679e53be None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:20.224641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad908478-f656-410a-be9b-b652679e53be None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:20.225050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad908478-f656-410a-be9b-b652679e53be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:20.245386 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad908478-f656-410a-be9b-b652679e53be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:20.254680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ad908478-f656-410a-be9b-b652679e53be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:29:20.254680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:20.254680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:20.254680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:20.254680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:20.254680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:20.254680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:20.254680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:20.254680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:20.254680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:20.254680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:20.254680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:20.254680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:20.254680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:20.254680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:20.254680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:20.255732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:20.255732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:20.255732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:20.255732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:20.255732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:20.255732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:20.255732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:20.255732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:20.255732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:20.255732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:20.255732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:20.255732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:20.255732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:20.255732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:20.255732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:20.255732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:20.256745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:20.256745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:20.256745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:20.256745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:20.256745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:20.256745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:20.256745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:20.256745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:20.256745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:20.256745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:20.256745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:29:20.256745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:20.260928 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 191/397] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:29:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:29:20.264252 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad908478-f656-410a-be9b-b652679e53be None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:20.264953 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d9d58-ae72-4724-bbf3-b8b89c4f1bc4 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:20.265461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d9d58-ae72-4724-bbf3-b8b89c4f1bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:20.265912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d9d58-ae72-4724-bbf3-b8b89c4f1bc4 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:20.267702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 207/398] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:20.273490 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aacaa0-73aa-407b-85ef-8e9f92826716 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:20.273870 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aacaa0-73aa-407b-85ef-8e9f92826716 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:20.274244 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aacaa0-73aa-407b-85ef-8e9f92826716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:20.305659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-50aacaa0-73aa-407b-85ef-8e9f92826716 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:20.306848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-50aacaa0-73aa-407b-85ef-8e9f92826716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:20.391312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad908478-f656-410a-be9b-b652679e53be None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:20.411496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 208/399] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:20.436940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aacaa0-73aa-407b-85ef-8e9f92826716 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:20.437480 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a8f66-9121-4e8a-9d60-be364de3a483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:20.438393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a8f66-9121-4e8a-9d60-be364de3a483 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:20.438880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a8f66-9121-4e8a-9d60-be364de3a483 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:20.439367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a8f66-9121-4e8a-9d60-be364de3a483 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:20.440321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a8f66-9121-4e8a-9d60-be364de3a483 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:20.441462 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a8f66-9121-4e8a-9d60-be364de3a483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:20.443086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a8f66-9121-4e8a-9d60-be364de3a483 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:20.454698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 192/400] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:20.461716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a8f66-9121-4e8a-9d60-be364de3a483 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:20.577414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a8f66-9121-4e8a-9d60-be364de3a483 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:20.582512 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aacaa0-73aa-407b-85ef-8e9f92826716 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:20.614295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea74549-70fd-45bf-895c-9ba5fd188b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:20.615495 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea74549-70fd-45bf-895c-9ba5fd188b5c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:20.615969 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea74549-70fd-45bf-895c-9ba5fd188b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:20.616404 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea74549-70fd-45bf-895c-9ba5fd188b5c None admin] PATH_INFO: `/v3/groups/7db85a8c23314f3ebab01abadca58494` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:20.617799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea74549-70fd-45bf-895c-9ba5fd188b5c None admin] RBAC: Authorizing `identity:get_group(group_id=7db85a8c23314f3ebab01abadca58494)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:20.619496 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea74549-70fd-45bf-895c-9ba5fd188b5c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:20.621714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 193/401] 10.222.0.81 () {56 vars in 1180 bytes} [Wed May 4 17:29:20 2022] GET /identity/v3/groups/7db85a8c23314f3ebab01abadca58494 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:20.627731 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea74549-70fd-45bf-895c-9ba5fd188b5c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:20.628215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b3a94-7c90-4e29-8a1f-aff8b14626cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:20.629546 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b3a94-7c90-4e29-8a1f-aff8b14626cf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:20.629827 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b3a94-7c90-4e29-8a1f-aff8b14626cf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:20.630169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b3a94-7c90-4e29-8a1f-aff8b14626cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:20.641265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b3a94-7c90-4e29-8a1f-aff8b14626cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:20.650492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-0e4b3a94-7c90-4e29-8a1f-aff8b14626cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:20.650492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:20.650492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:20.650492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:20.650492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:20.650492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:20.650492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:20.650492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:20.650492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:20.650492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:20.650492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:20.650492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:20.650492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:20.650492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:20.650492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:20.650492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:20.651426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:20.651426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:20.651426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:20.651426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:20.651426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:20.651426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:20.651426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:20.651426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:20.651426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:20.651426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:20.651426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:20.651426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:20.651426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:20.651426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:20.651426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:20.651426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:20.652378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:20.652378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:20.652378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:20.652378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:20.652378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:20.652378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:20.652378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:20.652378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:20.652378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:20.652378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:20.652378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:20.652378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:20.652378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 209/402] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:29:20.657294 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b3a94-7c90-4e29-8a1f-aff8b14626cf None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:20.834323 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea74549-70fd-45bf-895c-9ba5fd188b5c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:20.865107 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b3a94-7c90-4e29-8a1f-aff8b14626cf None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:20.906343 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8723b-8862-467e-b3c0-dd368fefa399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:20.907646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8723b-8862-467e-b3c0-dd368fefa399 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:20.908168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8723b-8862-467e-b3c0-dd368fefa399 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:20.908693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8723b-8862-467e-b3c0-dd368fefa399 None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:20.910793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8723b-8862-467e-b3c0-dd368fefa399 None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:20.912480 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8723b-8862-467e-b3c0-dd368fefa399 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:20.914760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 194/403] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:20 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:20.920225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8723b-8862-467e-b3c0-dd368fefa399 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:20.920621 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f7ad0-f077-4b28-89bf-03aee2ee5c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:20.921290 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f7ad0-f077-4b28-89bf-03aee2ee5c65 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:20.921571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f7ad0-f077-4b28-89bf-03aee2ee5c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:20.921847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f7ad0-f077-4b28-89bf-03aee2ee5c65 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:20.922599 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f7ad0-f077-4b28-89bf-03aee2ee5c65 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:20.922902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f7ad0-f077-4b28-89bf-03aee2ee5c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:20.924263 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f7ad0-f077-4b28-89bf-03aee2ee5c65 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:20.937672 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 210/404] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:29:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:20.943851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f7ad0-f077-4b28-89bf-03aee2ee5c65 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:21.046773 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8723b-8862-467e-b3c0-dd368fefa399 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:21.071717 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f7ad0-f077-4b28-89bf-03aee2ee5c65 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:21.089250 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228c198-2418-4d1f-bb13-f5797685cfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:21.090422 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228c198-2418-4d1f-bb13-f5797685cfe7 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:21.090422 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228c198-2418-4d1f-bb13-f5797685cfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:21.090683 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228c198-2418-4d1f-bb13-f5797685cfe7 None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23/groups/7db85a8c23314f3ebab01abadca58494/roles/8c1bc4243dcc46979dd8ca40186c0ca7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:21.094604 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228c198-2418-4d1f-bb13-f5797685cfe7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d591a594b164a30b9a0094d1803ba23, group_id=7db85a8c23314f3ebab01abadca58494, role_id=8c1bc4243dcc46979dd8ca40186c0ca7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:21.096110 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228c198-2418-4d1f-bb13-f5797685cfe7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:21.113307 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad57ba-29c4-4818-a86f-01ca68e417e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:21.114464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad57ba-29c4-4818-a86f-01ca68e417e2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:21.127291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad57ba-29c4-4818-a86f-01ca68e417e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:21.127291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad57ba-29c4-4818-a86f-01ca68e417e2 None admin] PATH_INFO: `/v3/groups/7db85a8c23314f3ebab01abadca58494` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:21.127291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad57ba-29c4-4818-a86f-01ca68e417e2 None admin] RBAC: Authorizing `identity:get_group(group_id=7db85a8c23314f3ebab01abadca58494)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:21.127291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad57ba-29c4-4818-a86f-01ca68e417e2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:21.127291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 211/405] 10.222.0.81 () {56 vars in 1180 bytes} [Wed May 4 17:29:20 2022] GET /identity/v3/groups/7db85a8c23314f3ebab01abadca58494 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:21.127291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11525c83-5fe4-43d7-989b-7a79228125ca None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:21.127720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11525c83-5fe4-43d7-989b-7a79228125ca None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:21.127720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11525c83-5fe4-43d7-989b-7a79228125ca None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:21.127720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 212/406] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:21.127720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11525c83-5fe4-43d7-989b-7a79228125ca None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:21.230217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11525c83-5fe4-43d7-989b-7a79228125ca None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:21.253919 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 195/407] 10.222.0.81 () {58 vars in 1442 bytes} [Wed May 4 17:29:20 2022] PUT /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23/groups/7db85a8c23314f3ebab01abadca58494/roles/8c1bc4243dcc46979dd8ca40186c0ca7 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:29:21.255929 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099f803-2f7d-4336-9fb7-698d63d741de None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:21.256221 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099f803-2f7d-4336-9fb7-698d63d741de None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:21.257804 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099f803-2f7d-4336-9fb7-698d63d741de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:21.286059 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7099f803-2f7d-4336-9fb7-698d63d741de None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:21.287301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7099f803-2f7d-4336-9fb7-698d63d741de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:21.302039 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bf82e-05e4-48c2-bb7b-25d1eac7a3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:21.302914 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bf82e-05e4-48c2-bb7b-25d1eac7a3fa None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:21.303187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bf82e-05e4-48c2-bb7b-25d1eac7a3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:21.303509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bf82e-05e4-48c2-bb7b-25d1eac7a3fa None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:21.305163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bf82e-05e4-48c2-bb7b-25d1eac7a3fa None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:21.306636 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bf82e-05e4-48c2-bb7b-25d1eac7a3fa None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:21.309966 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 213/408] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:21 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:21.317216 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bf82e-05e4-48c2-bb7b-25d1eac7a3fa None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:21.430077 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 196/409] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:21.459074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099f803-2f7d-4336-9fb7-698d63d741de None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:21.504946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bf82e-05e4-48c2-bb7b-25d1eac7a3fa None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:21.552472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe73d5-fa3d-4697-864a-dd25420c9cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:21.553887 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe73d5-fa3d-4697-864a-dd25420c9cb3 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:21.553887 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe73d5-fa3d-4697-864a-dd25420c9cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:21.554148 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe73d5-fa3d-4697-864a-dd25420c9cb3 None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23/groups/7db85a8c23314f3ebab01abadca58494/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:21.558087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe73d5-fa3d-4697-864a-dd25420c9cb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d591a594b164a30b9a0094d1803ba23, group_id=7db85a8c23314f3ebab01abadca58494, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:21.559518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe73d5-fa3d-4697-864a-dd25420c9cb3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:21.590901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099f803-2f7d-4336-9fb7-698d63d741de None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:21.628583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e69c1e-a411-4719-97a6-f4ccc3a2bab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:21.629766 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69c1e-a411-4719-97a6-f4ccc3a2bab0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:21.630266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69c1e-a411-4719-97a6-f4ccc3a2bab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:21.630730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69c1e-a411-4719-97a6-f4ccc3a2bab0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:21.641774 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e69c1e-a411-4719-97a6-f4ccc3a2bab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:21.650312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-72e69c1e-a411-4719-97a6-f4ccc3a2bab0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:29:21.650312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:21.650312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:21.650312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:21.650312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:21.650312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:21.650312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:21.650312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:21.650312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:21.650312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:21.650312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:21.650312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:21.650312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:21.650312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:21.650312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:21.650312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:21.651181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:21.651181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:21.651181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:21.651181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:21.651181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:21.651181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:21.651181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:21.651181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:21.651181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:21.651181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:21.651181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:21.651181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:21.651181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:21.651181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:21.651181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:21.651181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:21.651948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:21.651948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:21.651948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:21.651948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:21.651948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:21.651948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:21.651948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:21.651948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:21.651948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:21.651948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:21.651948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:29:21.651948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:21.654706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 197/410] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:29:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:29:21.661682 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e69c1e-a411-4719-97a6-f4ccc3a2bab0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:21.674342 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 214/411] 10.222.0.81 () {58 vars in 1442 bytes} [Wed May 4 17:29:21 2022] PUT /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23/groups/7db85a8c23314f3ebab01abadca58494/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:29:21.788576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e69c1e-a411-4719-97a6-f4ccc3a2bab0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:21.834380 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180236aa-44f7-4ee7-b2a6-9a5844bd83f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:21.835390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180236aa-44f7-4ee7-b2a6-9a5844bd83f2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:21.835883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180236aa-44f7-4ee7-b2a6-9a5844bd83f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:21.836366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180236aa-44f7-4ee7-b2a6-9a5844bd83f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:21.837368 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180236aa-44f7-4ee7-b2a6-9a5844bd83f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:21.837914 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180236aa-44f7-4ee7-b2a6-9a5844bd83f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:21.839472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180236aa-44f7-4ee7-b2a6-9a5844bd83f2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:21.852216 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 198/412] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:21.864487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe73d5-fa3d-4697-864a-dd25420c9cb3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:22.022346 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe73d5-fa3d-4697-864a-dd25420c9cb3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:22.059551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd4e0a-5181-4ec6-994d-21bd4ebf025d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:22.060327 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd4e0a-5181-4ec6-994d-21bd4ebf025d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:22.060626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd4e0a-5181-4ec6-994d-21bd4ebf025d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:22.060895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd4e0a-5181-4ec6-994d-21bd4ebf025d None admin] PATH_INFO: `/v3/groups/e43e228521b74e5e806fc7486e51f097` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:22.063290 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd4e0a-5181-4ec6-994d-21bd4ebf025d None admin] RBAC: Authorizing `identity:get_group(group_id=e43e228521b74e5e806fc7486e51f097)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:22.067912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd4e0a-5181-4ec6-994d-21bd4ebf025d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:22.067912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 215/413] 10.222.0.81 () {56 vars in 1180 bytes} [Wed May 4 17:29:21 2022] GET /identity/v3/groups/e43e228521b74e5e806fc7486e51f097 => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:22.072468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180236aa-44f7-4ee7-b2a6-9a5844bd83f2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:22.183597 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180236aa-44f7-4ee7-b2a6-9a5844bd83f2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:22.224084 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04384b-3978-4220-8dd0-c75d567ccafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:22.224975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04384b-3978-4220-8dd0-c75d567ccafd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:22.225255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04384b-3978-4220-8dd0-c75d567ccafd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:22.225527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04384b-3978-4220-8dd0-c75d567ccafd None admin] PATH_INFO: `/v3/projects/24f269e9f1b44f73928e694fdc60f6bd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:22.226763 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04384b-3978-4220-8dd0-c75d567ccafd None admin] RBAC: Authorizing `identity:get_project(project_id=24f269e9f1b44f73928e694fdc60f6bd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:22.228195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04384b-3978-4220-8dd0-c75d567ccafd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:22.229921 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 199/414] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:22 2022] GET /identity/v3/projects/24f269e9f1b44f73928e694fdc60f6bd => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:22.235567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd4e0a-5181-4ec6-994d-21bd4ebf025d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:22.334206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbe3b9-54f3-45cd-85ff-d53338ef225a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:22.334872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbe3b9-54f3-45cd-85ff-d53338ef225a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:22.334872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbe3b9-54f3-45cd-85ff-d53338ef225a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:22.336050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 200/415] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:22.342056 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ec9b8-7e5d-42cd-9edc-e50a2c3a7ce2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:22.342331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ec9b8-7e5d-42cd-9edc-e50a2c3a7ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:22.342603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ec9b8-7e5d-42cd-9edc-e50a2c3a7ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:22.363866 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7f9ec9b8-7e5d-42cd-9edc-e50a2c3a7ce2 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:22.364806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7f9ec9b8-7e5d-42cd-9edc-e50a2c3a7ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:22.451328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd4e0a-5181-4ec6-994d-21bd4ebf025d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:22.488617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 201/416] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:22.500769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cff796-925d-4734-a525-80f3f411426a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:22.501644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cff796-925d-4734-a525-80f3f411426a None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:22.501924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cff796-925d-4734-a525-80f3f411426a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:22.502192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cff796-925d-4734-a525-80f3f411426a None admin] PATH_INFO: `/v3/projects/24f269e9f1b44f73928e694fdc60f6bd/groups/e43e228521b74e5e806fc7486e51f097/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:22.504414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cff796-925d-4734-a525-80f3f411426a None admin] RBAC: Authorizing `identity:create_grant(project_id=24f269e9f1b44f73928e694fdc60f6bd, group_id=e43e228521b74e5e806fc7486e51f097, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:22.505865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cff796-925d-4734-a525-80f3f411426a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:22.515085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ec9b8-7e5d-42cd-9edc-e50a2c3a7ce2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:22.615443 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ec9b8-7e5d-42cd-9edc-e50a2c3a7ce2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:22.628475 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 216/417] 10.222.0.81 () {58 vars in 1442 bytes} [Wed May 4 17:29:22 2022] PUT /identity/v3/projects/24f269e9f1b44f73928e694fdc60f6bd/groups/e43e228521b74e5e806fc7486e51f097/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:29:22.634318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1ecb6-4155-437b-96c0-41d00bfc0686 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:22.634827 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1ecb6-4155-437b-96c0-41d00bfc0686 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:22.635239 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1ecb6-4155-437b-96c0-41d00bfc0686 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:22.637837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 217/418] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:22.645293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc7f48-8ecc-4daa-9eac-f9f7558fe2f1 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:22.645987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc7f48-8ecc-4daa-9eac-f9f7558fe2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:22.646416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc7f48-8ecc-4daa-9eac-f9f7558fe2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:22.667591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2fdc7f48-8ecc-4daa-9eac-f9f7558fe2f1 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:22.669117 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2fdc7f48-8ecc-4daa-9eac-f9f7558fe2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:22.702315 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a3a10-4caf-4568-877c-a06a1255b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:22.703137 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a3a10-4caf-4568-877c-a06a1255b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:22.703502 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a3a10-4caf-4568-877c-a06a1255b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:22.703863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a3a10-4caf-4568-877c-a06a1255b9b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:22.735367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a3a10-4caf-4568-877c-a06a1255b9b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:22.743937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-030a3a10-4caf-4568-877c-a06a1255b9b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:22.743937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:22.743937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:22.743937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:22.743937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:22.743937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:22.743937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:22.743937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:22.743937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:22.743937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:22.743937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:22.743937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:22.743937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:22.743937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:22.743937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:22.743937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:22.744926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:22.744926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:22.744926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:22.744926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:22.744926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:22.744926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:22.744926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:22.744926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:22.744926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:22.744926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:22.744926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:22.744926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:22.744926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:22.744926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:22.744926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:22.744926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:22.745704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:22.745704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:22.745704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:22.745704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:22.745704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:22.745704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:22.745704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:22.745704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:22.745704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:22.745704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:22.745704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:22.745704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:22.755765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 202/419] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:22.776033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a3a10-4caf-4568-877c-a06a1255b9b7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:22.792978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 218/420] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:29:22.835920 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc7f48-8ecc-4daa-9eac-f9f7558fe2f1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:22.929617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a3a10-4caf-4568-877c-a06a1255b9b7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:22.956515 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc7f48-8ecc-4daa-9eac-f9f7558fe2f1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:22.973093 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27018a75-9a4f-410d-bb62-72205174d75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:22.974111 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27018a75-9a4f-410d-bb62-72205174d75c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:22.974611 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27018a75-9a4f-410d-bb62-72205174d75c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:22.975081 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27018a75-9a4f-410d-bb62-72205174d75c None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:22.976030 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27018a75-9a4f-410d-bb62-72205174d75c None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:22.976558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27018a75-9a4f-410d-bb62-72205174d75c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:22.978147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27018a75-9a4f-410d-bb62-72205174d75c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:22.997956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 203/421] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:29:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:23.006159 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07048156-a64d-4209-b9a5-9053414352fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:23.006982 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07048156-a64d-4209-b9a5-9053414352fc None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:23.007262 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07048156-a64d-4209-b9a5-9053414352fc None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:23.007533 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07048156-a64d-4209-b9a5-9053414352fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:23.015852 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27018a75-9a4f-410d-bb62-72205174d75c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:23.029349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07048156-a64d-4209-b9a5-9053414352fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:23.037505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-07048156-a64d-4209-b9a5-9053414352fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:29:23.037505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:23.037505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:23.037505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:23.037505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:23.037505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:23.037505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:23.037505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:23.037505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:23.037505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:23.037505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:23.037505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:23.037505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:23.037505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:23.037505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:23.037505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:23.038364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:23.038364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:23.038364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:23.038364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:23.038364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:23.038364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:23.038364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:23.038364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:23.038364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:23.038364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:23.038364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:23.038364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:23.038364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:23.038364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:23.038364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:23.038364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:23.039158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:23.039158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:23.039158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:23.039158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:23.039158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:23.039158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:23.039158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:23.039158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:23.039158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:23.039158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:23.039158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:29:23.039158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:23.041192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 219/422] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:29:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:29:23.046723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07048156-a64d-4209-b9a5-9053414352fc None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:23.170269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07048156-a64d-4209-b9a5-9053414352fc None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:23.211620 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0498a29-26b5-459e-882f-97bdd6973e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:23.212206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0498a29-26b5-459e-882f-97bdd6973e8a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:23.212502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0498a29-26b5-459e-882f-97bdd6973e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:23.214364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0498a29-26b5-459e-882f-97bdd6973e8a None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:23.214364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0498a29-26b5-459e-882f-97bdd6973e8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:23.214364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0498a29-26b5-459e-882f-97bdd6973e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:23.215176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0498a29-26b5-459e-882f-97bdd6973e8a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:23.219207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27018a75-9a4f-410d-bb62-72205174d75c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:23.235098 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 220/423] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:23.241173 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0498a29-26b5-459e-882f-97bdd6973e8a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:23.294329 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231469b-da25-4c40-bd01-2b06fb7be60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:23.294988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231469b-da25-4c40-bd01-2b06fb7be60c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:23.295268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231469b-da25-4c40-bd01-2b06fb7be60c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:23.295539 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231469b-da25-4c40-bd01-2b06fb7be60c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:23.385277 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0498a29-26b5-459e-882f-97bdd6973e8a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:23.419788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231469b-da25-4c40-bd01-2b06fb7be60c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:23.421414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231469b-da25-4c40-bd01-2b06fb7be60c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:23.433209 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc9551-f665-4c66-ac83-2daf76b3a230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:23.433913 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc9551-f665-4c66-ac83-2daf76b3a230 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:23.434199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc9551-f665-4c66-ac83-2daf76b3a230 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:23.434474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc9551-f665-4c66-ac83-2daf76b3a230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:23.557098 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc9551-f665-4c66-ac83-2daf76b3a230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:23.558778 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc9551-f665-4c66-ac83-2daf76b3a230 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:23.587515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 204/424] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:23.594228 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231469b-da25-4c40-bd01-2b06fb7be60c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:23.677260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 221/425] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 17:29:23.685947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc9551-f665-4c66-ac83-2daf76b3a230 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:23.785688 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231469b-da25-4c40-bd01-2b06fb7be60c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:23.791552 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc9551-f665-4c66-ac83-2daf76b3a230 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:23.829029 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc38e04-7205-4c26-984d-4be8a6b0871c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:23.829799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc38e04-7205-4c26-984d-4be8a6b0871c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:23.830074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc38e04-7205-4c26-984d-4be8a6b0871c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:23.830343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc38e04-7205-4c26-984d-4be8a6b0871c None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:23.834262 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc38e04-7205-4c26-984d-4be8a6b0871c None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:23.835697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc38e04-7205-4c26-984d-4be8a6b0871c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:23.837705 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 222/426] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:23 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:23.845287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc38e04-7205-4c26-984d-4be8a6b0871c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:23.865187 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6edfea-8b66-4fd4-912e-17eff9a031fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:23.866065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6edfea-8b66-4fd4-912e-17eff9a031fb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:23.866346 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6edfea-8b66-4fd4-912e-17eff9a031fb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:23.866617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6edfea-8b66-4fd4-912e-17eff9a031fb None admin] PATH_INFO: `/v3/projects/0c51097d14c64e869f8ce7b3df492b61` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:23.868081 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6edfea-8b66-4fd4-912e-17eff9a031fb None admin] RBAC: Authorizing `identity:get_project(project_id=0c51097d14c64e869f8ce7b3df492b61)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:23.869533 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6edfea-8b66-4fd4-912e-17eff9a031fb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:23.871370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 205/427] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:23 2022] GET /identity/v3/projects/0c51097d14c64e869f8ce7b3df492b61 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:23.887437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6edfea-8b66-4fd4-912e-17eff9a031fb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:23.959385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc38e04-7205-4c26-984d-4be8a6b0871c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:23.994586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dc1cd-d741-4d1e-bdef-b889876d6075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:23.995442 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dc1cd-d741-4d1e-bdef-b889876d6075 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:23.995717 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dc1cd-d741-4d1e-bdef-b889876d6075 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:23.995986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dc1cd-d741-4d1e-bdef-b889876d6075 None admin] PATH_INFO: `/v3/groups/7db85a8c23314f3ebab01abadca58494` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:24.000707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dc1cd-d741-4d1e-bdef-b889876d6075 None admin] RBAC: Authorizing `identity:get_group(group_id=7db85a8c23314f3ebab01abadca58494)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:24.002159 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dc1cd-d741-4d1e-bdef-b889876d6075 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:24.004514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 223/428] 10.222.0.81 () {56 vars in 1180 bytes} [Wed May 4 17:29:23 2022] GET /identity/v3/groups/7db85a8c23314f3ebab01abadca58494 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:24.010541 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dc1cd-d741-4d1e-bdef-b889876d6075 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:24.087507 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6edfea-8b66-4fd4-912e-17eff9a031fb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:24.169441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dc1cd-d741-4d1e-bdef-b889876d6075 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:24.187354 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6470b-d7b4-4c5c-8953-da305283ecbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:24.188773 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6470b-d7b4-4c5c-8953-da305283ecbf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:24.189056 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6470b-d7b4-4c5c-8953-da305283ecbf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:24.189331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6470b-d7b4-4c5c-8953-da305283ecbf None admin] PATH_INFO: `/v3/groups/7db85a8c23314f3ebab01abadca58494` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:24.192218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6470b-d7b4-4c5c-8953-da305283ecbf None admin] RBAC: Authorizing `identity:get_group(group_id=7db85a8c23314f3ebab01abadca58494)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:24.193693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6470b-d7b4-4c5c-8953-da305283ecbf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:24.195311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 206/429] 10.222.0.81 () {56 vars in 1180 bytes} [Wed May 4 17:29:23 2022] GET /identity/v3/groups/7db85a8c23314f3ebab01abadca58494 => generated 226 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:24.203068 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6470b-d7b4-4c5c-8953-da305283ecbf None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:24.232045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa21e7-1310-42f5-a277-328afff67314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:24.232740 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa21e7-1310-42f5-a277-328afff67314 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:24.233024 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa21e7-1310-42f5-a277-328afff67314 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:24.233295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa21e7-1310-42f5-a277-328afff67314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:24.234131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa21e7-1310-42f5-a277-328afff67314 None admin] RBAC: Adding query filter params (group.id=7db85a8c23314f3ebab01abadca58494, role.id=8c1bc4243dcc46979dd8ca40186c0ca7, scope.project.id=0c51097d14c64e869f8ce7b3df492b61) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:24.234441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa21e7-1310-42f5-a277-328afff67314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:24.235869 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa21e7-1310-42f5-a277-328afff67314 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:24.246268 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 224/430] 10.222.0.81 () {56 vars in 1376 bytes} [Wed May 4 17:29:24 2022] GET /identity/v3/role_assignments?group.id=7db85a8c23314f3ebab01abadca58494&scope.project.id=0c51097d14c64e869f8ce7b3df492b61&role.id=8c1bc4243dcc46979dd8ca40186c0ca7 => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:24.287487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad4ece-1e17-4c28-9021-d6f2d5710418 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:24.287828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad4ece-1e17-4c28-9021-d6f2d5710418 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:24.288043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad4ece-1e17-4c28-9021-d6f2d5710418 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:24.289908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 225/431] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:29:24.295683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30e96b-675e-4173-8cad-3e57ad5d6d16 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:24.296027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30e96b-675e-4173-8cad-3e57ad5d6d16 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:24.296243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30e96b-675e-4173-8cad-3e57ad5d6d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:24.326005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0b30e96b-675e-4173-8cad-3e57ad5d6d16 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:24.327599 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0b30e96b-675e-4173-8cad-3e57ad5d6d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:24.383448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6470b-d7b4-4c5c-8953-da305283ecbf None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:24.434976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd762527-bdbb-4b74-8ee7-e4ef8cdcbe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:24.435753 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd762527-bdbb-4b74-8ee7-e4ef8cdcbe3c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:24.435912 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd762527-bdbb-4b74-8ee7-e4ef8cdcbe3c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:24.436172 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd762527-bdbb-4b74-8ee7-e4ef8cdcbe3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:24.437133 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd762527-bdbb-4b74-8ee7-e4ef8cdcbe3c None admin] RBAC: Adding query filter params (group.id=7db85a8c23314f3ebab01abadca58494, role.id=42b0adbc87e347e18bd4412dc9e421c1, scope.project.id=0c51097d14c64e869f8ce7b3df492b61) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:24.437441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd762527-bdbb-4b74-8ee7-e4ef8cdcbe3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:24.438898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd762527-bdbb-4b74-8ee7-e4ef8cdcbe3c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:24.446402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 207/432] 10.222.0.81 () {56 vars in 1376 bytes} [Wed May 4 17:29:24 2022] GET /identity/v3/role_assignments?group.id=7db85a8c23314f3ebab01abadca58494&scope.project.id=0c51097d14c64e869f8ce7b3df492b61&role.id=42b0adbc87e347e18bd4412dc9e421c1 => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:24.484061 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 226/433] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:29:24.509327 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd762527-bdbb-4b74-8ee7-e4ef8cdcbe3c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:24.544195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597d87d-5401-4ddc-8cd3-98963421588f None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:24.544560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597d87d-5401-4ddc-8cd3-98963421588f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:24.545734 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597d87d-5401-4ddc-8cd3-98963421588f None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:24.547063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 227/434] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:29:24.558075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead50c86-18c2-4a29-9f49-1c1c3e87d1bc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:24.558433 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead50c86-18c2-4a29-9f49-1c1c3e87d1bc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:24.558779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead50c86-18c2-4a29-9f49-1c1c3e87d1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:24.579348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ead50c86-18c2-4a29-9f49-1c1c3e87d1bc None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:24.581423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ead50c86-18c2-4a29-9f49-1c1c3e87d1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:24.653569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd762527-bdbb-4b74-8ee7-e4ef8cdcbe3c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:24.668592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 228/435] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:24.689442 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead50c86-18c2-4a29-9f49-1c1c3e87d1bc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:24.702742 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1024b49-3623-450c-b3fb-3f021e7ea5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:24.703728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1024b49-3623-450c-b3fb-3f021e7ea5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:24.704010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1024b49-3623-450c-b3fb-3f021e7ea5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:24.704281 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1024b49-3623-450c-b3fb-3f021e7ea5f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:24.727915 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1024b49-3623-450c-b3fb-3f021e7ea5f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:24.736718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a1024b49-3623-450c-b3fb-3f021e7ea5f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:29:24.736718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:24.736718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:24.736718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:24.736718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:24.736718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:24.736718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:24.736718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:24.736718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:24.736718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:24.736718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:24.736718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:24.736718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:24.736718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:24.736718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:24.736718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:24.737717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:24.737717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:24.737717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:24.737717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:24.737717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:24.737717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:24.737717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:24.737717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:24.737717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:24.737717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:24.737717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:24.737717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:24.737717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:24.737717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:24.737717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:24.737717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:24.738500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:24.738500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:24.738500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:24.738500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:24.738500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:24.738500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:24.738500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:24.738500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:24.738500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:24.738500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:24.738500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:29:24.738500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:24.739092 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 208/436] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:29:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:24.746476 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1024b49-3623-450c-b3fb-3f021e7ea5f2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:24.819293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead50c86-18c2-4a29-9f49-1c1c3e87d1bc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:24.858939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53a63c-d694-4606-a476-ff399b1ce63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:24.859742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53a63c-d694-4606-a476-ff399b1ce63b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:24.859945 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1024b49-3623-450c-b3fb-3f021e7ea5f2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:24.860046 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53a63c-d694-4606-a476-ff399b1ce63b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:24.860275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53a63c-d694-4606-a476-ff399b1ce63b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:24.876908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53a63c-d694-4606-a476-ff399b1ce63b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:24.886630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-5f53a63c-d694-4606-a476-ff399b1ce63b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:24.886630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:24.886630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:24.886630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:24.886630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:24.886630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:24.886630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:24.886630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:24.886630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:24.886630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:24.886630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:24.886630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:24.886630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:24.886630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:24.886630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:24.886630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:24.887511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:24.887511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:24.887511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:24.887511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:24.887511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:24.887511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:24.887511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:24.887511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:24.887511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:24.887511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:24.887511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:24.887511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:24.887511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:24.887511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:24.887511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:24.887511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:24.888289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:24.888289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:24.888289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:24.888289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:24.888289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:24.888289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:24.888289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:24.888289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:24.888289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:24.888289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:24.888289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 17:29:24.888289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:24.888289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 229/437] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:29:24.897226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53a63c-d694-4606-a476-ff399b1ce63b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:24.911397 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b39a8-2abf-4b5c-b3c2-175e246593b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:24.912007 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b39a8-2abf-4b5c-b3c2-175e246593b2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:24.912309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b39a8-2abf-4b5c-b3c2-175e246593b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:24.912705 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b39a8-2abf-4b5c-b3c2-175e246593b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:24.913465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b39a8-2abf-4b5c-b3c2-175e246593b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:24.913774 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b39a8-2abf-4b5c-b3c2-175e246593b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:24.915162 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b39a8-2abf-4b5c-b3c2-175e246593b2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:24.923555 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 209/438] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:24.930579 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b39a8-2abf-4b5c-b3c2-175e246593b2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:25.025740 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53a63c-d694-4606-a476-ff399b1ce63b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:25.067167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b39a8-2abf-4b5c-b3c2-175e246593b2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:25.070417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af242bf-3239-46ff-bd34-903256cb2632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:25.073292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af242bf-3239-46ff-bd34-903256cb2632 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:25.073292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af242bf-3239-46ff-bd34-903256cb2632 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:25.073292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af242bf-3239-46ff-bd34-903256cb2632 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:25.073292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af242bf-3239-46ff-bd34-903256cb2632 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:25.073292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af242bf-3239-46ff-bd34-903256cb2632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:25.074053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af242bf-3239-46ff-bd34-903256cb2632 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:25.088520 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 230/439] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:29:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:25.093807 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af242bf-3239-46ff-bd34-903256cb2632 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:25.105123 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d446078-5b3d-47db-90e8-8e55b17cf26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:25.105783 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d446078-5b3d-47db-90e8-8e55b17cf26f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:25.106075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d446078-5b3d-47db-90e8-8e55b17cf26f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:25.106356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d446078-5b3d-47db-90e8-8e55b17cf26f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:25.182037 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d446078-5b3d-47db-90e8-8e55b17cf26f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:25.183881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d446078-5b3d-47db-90e8-8e55b17cf26f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:25.211596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af242bf-3239-46ff-bd34-903256cb2632 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:25.248298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa063b6a-9679-4dfd-86cd-1d2c4d6dfe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:25.249083 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa063b6a-9679-4dfd-86cd-1d2c4d6dfe22 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:25.249275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa063b6a-9679-4dfd-86cd-1d2c4d6dfe22 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:25.249550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa063b6a-9679-4dfd-86cd-1d2c4d6dfe22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:25.286415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 210/440] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:25.291779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d446078-5b3d-47db-90e8-8e55b17cf26f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:25.320687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa063b6a-9679-4dfd-86cd-1d2c4d6dfe22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:25.322151 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa063b6a-9679-4dfd-86cd-1d2c4d6dfe22 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:25.394454 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d446078-5b3d-47db-90e8-8e55b17cf26f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:25.421546 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 231/441] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:25.422856 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17c6aa-b70a-490f-ac69-a9edff8f825b None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:25.423143 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17c6aa-b70a-490f-ac69-a9edff8f825b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:25.423415 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17c6aa-b70a-490f-ac69-a9edff8f825b None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:25.425496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 232/442] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:25.427680 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17c6aa-b70a-490f-ac69-a9edff8f825b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:25.428286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c28302-85a0-47c1-a48b-da859dd88fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:25.429239 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c28302-85a0-47c1-a48b-da859dd88fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:25.429531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c28302-85a0-47c1-a48b-da859dd88fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:25.429805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c28302-85a0-47c1-a48b-da859dd88fe0 None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:25.430993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c28302-85a0-47c1-a48b-da859dd88fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:25.432499 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c28302-85a0-47c1-a48b-da859dd88fe0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:25.434124 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 211/443] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:25 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:25.439645 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b85b8-e560-4dcc-b086-445a6b502bea None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:25.440918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b85b8-e560-4dcc-b086-445a6b502bea None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:25.441209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b85b8-e560-4dcc-b086-445a6b502bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:25.462065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-573b85b8-e560-4dcc-b086-445a6b502bea None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:25.464141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-573b85b8-e560-4dcc-b086-445a6b502bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:25.528768 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17c6aa-b70a-490f-ac69-a9edff8f825b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:25.529606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 212/444] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:25.530441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b85b8-e560-4dcc-b086-445a6b502bea None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:25.561978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef07cca-c2b9-45f3-9325-48a40dc5e0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:25.562829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef07cca-c2b9-45f3-9325-48a40dc5e0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:25.563103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef07cca-c2b9-45f3-9325-48a40dc5e0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:25.563369 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef07cca-c2b9-45f3-9325-48a40dc5e0f8 None admin] PATH_INFO: `/v3/projects/9d591a594b164a30b9a0094d1803ba23` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:25.564550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef07cca-c2b9-45f3-9325-48a40dc5e0f8 None admin] RBAC: Authorizing `identity:get_project(project_id=9d591a594b164a30b9a0094d1803ba23)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:25.566039 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef07cca-c2b9-45f3-9325-48a40dc5e0f8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:25.567693 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 233/445] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:25 2022] GET /identity/v3/projects/9d591a594b164a30b9a0094d1803ba23 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:25.568469 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef07cca-c2b9-45f3-9325-48a40dc5e0f8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:25.624737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b85b8-e560-4dcc-b086-445a6b502bea None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:25.656860 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0191b6-a869-4212-ab4b-d106f033265a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:25.657709 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0191b6-a869-4212-ab4b-d106f033265a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:25.657990 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0191b6-a869-4212-ab4b-d106f033265a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:25.658261 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0191b6-a869-4212-ab4b-d106f033265a None admin] PATH_INFO: `/v3/groups/7db85a8c23314f3ebab01abadca58494` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:25.660159 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0191b6-a869-4212-ab4b-d106f033265a None admin] RBAC: Authorizing `identity:get_group(group_id=7db85a8c23314f3ebab01abadca58494)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:25.661643 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0191b6-a869-4212-ab4b-d106f033265a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:25.662815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef07cca-c2b9-45f3-9325-48a40dc5e0f8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:25.663246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 213/446] 10.222.0.81 () {56 vars in 1180 bytes} [Wed May 4 17:29:25 2022] GET /identity/v3/groups/7db85a8c23314f3ebab01abadca58494 => generated 226 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:25.664007 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0191b6-a869-4212-ab4b-d106f033265a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:25.700589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b384f57-a322-4ca5-877a-1d5e316e5ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:25.701320 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b384f57-a322-4ca5-877a-1d5e316e5ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:25.701570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b384f57-a322-4ca5-877a-1d5e316e5ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:25.701838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b384f57-a322-4ca5-877a-1d5e316e5ca4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:25.712247 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b384f57-a322-4ca5-877a-1d5e316e5ca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:25.719926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-2b384f57-a322-4ca5-877a-1d5e316e5ca4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:29:25.719926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:25.719926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:25.719926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:25.719926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:25.719926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:25.719926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:25.719926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:25.719926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:25.719926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:25.719926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:25.719926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:25.719926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:25.719926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:25.719926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:25.719926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:25.721003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:25.721003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:25.721003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:25.721003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:25.721003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:25.721003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:25.721003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:25.721003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:25.721003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:25.721003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:25.721003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:25.721003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:25.721003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:25.721003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:25.721003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:25.721003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:25.722383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:25.722383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:25.722383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:25.722383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:25.722383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:25.722383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:25.722383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:25.722383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:25.722383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:25.722383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:25.722383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:29:25.722383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:25.722383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 234/447] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:29:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:25.723064 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b384f57-a322-4ca5-877a-1d5e316e5ca4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:25.763845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0191b6-a869-4212-ab4b-d106f033265a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:25.796329 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0040f-d7f6-40fb-8631-499219c30609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:25.797258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0040f-d7f6-40fb-8631-499219c30609 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:25.797472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0040f-d7f6-40fb-8631-499219c30609 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:25.797749 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0040f-d7f6-40fb-8631-499219c30609 None admin] PATH_INFO: `/v3/groups/7db85a8c23314f3ebab01abadca58494` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:25.799103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0040f-d7f6-40fb-8631-499219c30609 None admin] RBAC: Authorizing `identity:get_group(group_id=7db85a8c23314f3ebab01abadca58494)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:25.800809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0040f-d7f6-40fb-8631-499219c30609 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:25.802430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 214/448] 10.222.0.81 () {56 vars in 1180 bytes} [Wed May 4 17:29:25 2022] GET /identity/v3/groups/7db85a8c23314f3ebab01abadca58494 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:25.803195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0040f-d7f6-40fb-8631-499219c30609 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:25.818543 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b384f57-a322-4ca5-877a-1d5e316e5ca4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:25.851221 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ee94e-3ca6-4340-9f63-279c07f5d080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:25.851869 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ee94e-3ca6-4340-9f63-279c07f5d080 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:25.852149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ee94e-3ca6-4340-9f63-279c07f5d080 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:25.852421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ee94e-3ca6-4340-9f63-279c07f5d080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:25.853278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ee94e-3ca6-4340-9f63-279c07f5d080 None admin] RBAC: Adding query filter params (group.id=7db85a8c23314f3ebab01abadca58494, role.id=8c1bc4243dcc46979dd8ca40186c0ca7, scope.project.id=9d591a594b164a30b9a0094d1803ba23) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:25.853587 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ee94e-3ca6-4340-9f63-279c07f5d080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:25.855031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ee94e-3ca6-4340-9f63-279c07f5d080 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:25.860737 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 235/449] 10.222.0.81 () {56 vars in 1376 bytes} [Wed May 4 17:29:25 2022] GET /identity/v3/role_assignments?group.id=7db85a8c23314f3ebab01abadca58494&scope.project.id=9d591a594b164a30b9a0094d1803ba23&role.id=8c1bc4243dcc46979dd8ca40186c0ca7 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:25.861525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ee94e-3ca6-4340-9f63-279c07f5d080 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:25.907538 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0040f-d7f6-40fb-8631-499219c30609 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:25.946085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da236e46-645a-4866-a874-1a8cc3efc5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:25.946921 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da236e46-645a-4866-a874-1a8cc3efc5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:25.947205 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da236e46-645a-4866-a874-1a8cc3efc5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:25.947487 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da236e46-645a-4866-a874-1a8cc3efc5d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:25.948257 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da236e46-645a-4866-a874-1a8cc3efc5d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:25.948603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da236e46-645a-4866-a874-1a8cc3efc5d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:25.950002 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da236e46-645a-4866-a874-1a8cc3efc5d0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:25.959765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 215/450] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:25.965270 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da236e46-645a-4866-a874-1a8cc3efc5d0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:25.970023 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ee94e-3ca6-4340-9f63-279c07f5d080 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:26.007580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447e24f-e041-45ac-b45b-4a12d206a592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:26.008664 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447e24f-e041-45ac-b45b-4a12d206a592 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:26.008947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447e24f-e041-45ac-b45b-4a12d206a592 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:26.009223 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447e24f-e041-45ac-b45b-4a12d206a592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:26.010072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447e24f-e041-45ac-b45b-4a12d206a592 None admin] RBAC: Adding query filter params (group.id=7db85a8c23314f3ebab01abadca58494, role.id=42b0adbc87e347e18bd4412dc9e421c1, scope.project.id=9d591a594b164a30b9a0094d1803ba23) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:26.010384 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447e24f-e041-45ac-b45b-4a12d206a592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:26.011845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447e24f-e041-45ac-b45b-4a12d206a592 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:26.018330 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 236/451] 10.222.0.81 () {56 vars in 1376 bytes} [Wed May 4 17:29:25 2022] GET /identity/v3/role_assignments?group.id=7db85a8c23314f3ebab01abadca58494&scope.project.id=9d591a594b164a30b9a0094d1803ba23&role.id=42b0adbc87e347e18bd4412dc9e421c1 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:26.083330 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da236e46-645a-4866-a874-1a8cc3efc5d0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:26.121750 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75aba81-f103-41b1-98b7-4b665b5a2668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:26.122408 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75aba81-f103-41b1-98b7-4b665b5a2668 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:26.122690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75aba81-f103-41b1-98b7-4b665b5a2668 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:26.122960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75aba81-f103-41b1-98b7-4b665b5a2668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:26.195062 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75aba81-f103-41b1-98b7-4b665b5a2668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:26.197249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75aba81-f103-41b1-98b7-4b665b5a2668 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:26.293255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 216/452] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 17:29:26.298748 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447e24f-e041-45ac-b45b-4a12d206a592 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:26.399295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447e24f-e041-45ac-b45b-4a12d206a592 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:26.432524 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7045c-986c-43d0-84e8-d13764f1c8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:26.433352 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7045c-986c-43d0-84e8-d13764f1c8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:26.433629 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7045c-986c-43d0-84e8-d13764f1c8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:26.433901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7045c-986c-43d0-84e8-d13764f1c8f3 None admin] PATH_INFO: `/v3/projects/24f269e9f1b44f73928e694fdc60f6bd` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:26.435073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7045c-986c-43d0-84e8-d13764f1c8f3 None admin] RBAC: Authorizing `identity:get_project(project_id=24f269e9f1b44f73928e694fdc60f6bd)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:26.436538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7045c-986c-43d0-84e8-d13764f1c8f3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:26.438218 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 237/453] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:29:26 2022] GET /identity/v3/projects/24f269e9f1b44f73928e694fdc60f6bd => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:26.443819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75aba81-f103-41b1-98b7-4b665b5a2668 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:26.539809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75aba81-f103-41b1-98b7-4b665b5a2668 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:26.572548 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a7b20-543a-4f6d-b79d-4f937f98aab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:26.573312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a7b20-543a-4f6d-b79d-4f937f98aab2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:26.573591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a7b20-543a-4f6d-b79d-4f937f98aab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:26.573859 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a7b20-543a-4f6d-b79d-4f937f98aab2 None admin] PATH_INFO: `/v3/groups/e43e228521b74e5e806fc7486e51f097` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:26.575087 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a7b20-543a-4f6d-b79d-4f937f98aab2 None admin] RBAC: Authorizing `identity:get_group(group_id=e43e228521b74e5e806fc7486e51f097)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:26.576527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a7b20-543a-4f6d-b79d-4f937f98aab2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:26.581119 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 217/454] 10.222.0.81 () {56 vars in 1180 bytes} [Wed May 4 17:29:26 2022] GET /identity/v3/groups/e43e228521b74e5e806fc7486e51f097 => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:26.584778 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7045c-986c-43d0-84e8-d13764f1c8f3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:26.678783 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7045c-986c-43d0-84e8-d13764f1c8f3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:26.712377 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927de2f-5cb0-4e81-a945-0891ddbdc45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:26.713037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927de2f-5cb0-4e81-a945-0891ddbdc45b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:26.713311 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927de2f-5cb0-4e81-a945-0891ddbdc45b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:26.713580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927de2f-5cb0-4e81-a945-0891ddbdc45b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:26.714403 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927de2f-5cb0-4e81-a945-0891ddbdc45b None admin] RBAC: Adding query filter params (group.id=e43e228521b74e5e806fc7486e51f097, role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=24f269e9f1b44f73928e694fdc60f6bd) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:26.714709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927de2f-5cb0-4e81-a945-0891ddbdc45b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:26.716138 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927de2f-5cb0-4e81-a945-0891ddbdc45b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:26.722662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 238/455] 10.222.0.81 () {56 vars in 1376 bytes} [Wed May 4 17:29:26 2022] GET /identity/v3/role_assignments?group.id=e43e228521b74e5e806fc7486e51f097&scope.project.id=24f269e9f1b44f73928e694fdc60f6bd&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:29.525849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c699dbd-d8cd-4c31-8199-ef1058ee4459 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:29.526364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c699dbd-d8cd-4c31-8199-ef1058ee4459 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:29.526364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c699dbd-d8cd-4c31-8199-ef1058ee4459 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:29.527978 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 218/456] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:29.533635 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae4b3-bfd1-42a6-ac8a-a95bac70152f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:29.534254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae4b3-bfd1-42a6-ac8a-a95bac70152f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:29.534254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae4b3-bfd1-42a6-ac8a-a95bac70152f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:29.557559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-997ae4b3-bfd1-42a6-ac8a-a95bac70152f None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:29.558788 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-997ae4b3-bfd1-42a6-ac8a-a95bac70152f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:29.600712 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148760e9-f23a-467b-ab0c-2c87c0552eea None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:29.601326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148760e9-f23a-467b-ab0c-2c87c0552eea None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:29.601802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148760e9-f23a-467b-ab0c-2c87c0552eea None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:29.604541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 219/457] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:29.609152 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50846ee1-b9a5-4a97-9e85-8e4814492210 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:29.609710 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50846ee1-b9a5-4a97-9e85-8e4814492210 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:29.610188 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50846ee1-b9a5-4a97-9e85-8e4814492210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:29.636639 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 239/458] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:29.645322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-50846ee1-b9a5-4a97-9e85-8e4814492210 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:29.646522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-50846ee1-b9a5-4a97-9e85-8e4814492210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:29.659693 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ae4b3-bfd1-42a6-ac8a-a95bac70152f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:29.768858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 220/459] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:29.793336 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50846ee1-b9a5-4a97-9e85-8e4814492210 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:29.828449 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ae4b3-bfd1-42a6-ac8a-a95bac70152f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:29.895197 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d48233-12c9-4b8b-850e-8d46af890c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:29.895197 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d48233-12c9-4b8b-850e-8d46af890c83 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:29.895464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d48233-12c9-4b8b-850e-8d46af890c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:29.895697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d48233-12c9-4b8b-850e-8d46af890c83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:29.906024 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d48233-12c9-4b8b-850e-8d46af890c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:29.907480 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d48233-12c9-4b8b-850e-8d46af890c83 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:29.927845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d4d48233-12c9-4b8b-850e-8d46af890c83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:29.927845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:29.927845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:29.927845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:29.927845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:29.927845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:29.927845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:29.927845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:29.927845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:29.927845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:29.927845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:29.927845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:29.927845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:29.927845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:29.927845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:29.928763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:29.929574 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:29.929574 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:29.929574 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:29.929574 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:29.929574 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 240/460] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:29:29.935014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d48233-12c9-4b8b-850e-8d46af890c83 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:29.980588 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50846ee1-b9a5-4a97-9e85-8e4814492210 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:30.057150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb0b72-f4c4-452b-9682-fc2005cd4cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:30.058275 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb0b72-f4c4-452b-9682-fc2005cd4cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:30.058760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb0b72-f4c4-452b-9682-fc2005cd4cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:30.059198 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb0b72-f4c4-452b-9682-fc2005cd4cc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:30.066536 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d48233-12c9-4b8b-850e-8d46af890c83 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:30.082568 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb0b72-f4c4-452b-9682-fc2005cd4cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:30.084010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb0b72-f4c4-452b-9682-fc2005cd4cc9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:30.114366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-48bb0b72-f4c4-452b-9682-fc2005cd4cc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:30.114366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:30.114366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:30.114366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:30.114366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:30.114366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:30.114366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:30.114366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:30.114366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:30.114366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:30.114366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:30.114366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:30.114366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:30.114366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:30.114366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:30.115260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:30.116061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:30.116061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:30.116061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:30.116061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:30.116061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 221/461] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:30.122052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4e913-b13d-4194-aa52-df81c6e7de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:30.122719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4e913-b13d-4194-aa52-df81c6e7de61 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:30.122992 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4e913-b13d-4194-aa52-df81c6e7de61 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:30.123260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4e913-b13d-4194-aa52-df81c6e7de61 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:30.123988 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4e913-b13d-4194-aa52-df81c6e7de61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:30.124287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4e913-b13d-4194-aa52-df81c6e7de61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:30.125702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4e913-b13d-4194-aa52-df81c6e7de61 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:30.130240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7599e3-0329-4695-9a19-d5519a71e75d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:30.130610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7599e3-0329-4695-9a19-d5519a71e75d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:30.130885 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7599e3-0329-4695-9a19-d5519a71e75d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:30.132341 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 222/462] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:30.135055 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7599e3-0329-4695-9a19-d5519a71e75d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:30.155932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 241/463] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:30.155932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d1ae2-b9f5-472d-b128-edc7422e36db None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:30.155932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d1ae2-b9f5-472d-b128-edc7422e36db None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:30.155932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d1ae2-b9f5-472d-b128-edc7422e36db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:30.178348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e38d1ae2-b9f5-472d-b128-edc7422e36db None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:30.179575 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e38d1ae2-b9f5-472d-b128-edc7422e36db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:30.264462 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 242/464] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:30.264462 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d1ae2-b9f5-472d-b128-edc7422e36db None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:30.272257 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7599e3-0329-4695-9a19-d5519a71e75d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:30.338056 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae724d9-673a-4bfd-9981-6d5224588dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:30.338993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae724d9-673a-4bfd-9981-6d5224588dbf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:30.339474 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae724d9-673a-4bfd-9981-6d5224588dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:30.339941 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae724d9-673a-4bfd-9981-6d5224588dbf None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:30.340894 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae724d9-673a-4bfd-9981-6d5224588dbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:30.341495 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae724d9-673a-4bfd-9981-6d5224588dbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:30.343080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae724d9-673a-4bfd-9981-6d5224588dbf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:30.356191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 223/465] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:30.357336 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae724d9-673a-4bfd-9981-6d5224588dbf None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:30.380410 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d1ae2-b9f5-472d-b128-edc7422e36db None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:30.416318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757684d0-44f5-4ddd-a396-1ff5a381d717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:30.416940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757684d0-44f5-4ddd-a396-1ff5a381d717 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:30.417215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757684d0-44f5-4ddd-a396-1ff5a381d717 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:30.417486 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757684d0-44f5-4ddd-a396-1ff5a381d717 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:30.418179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757684d0-44f5-4ddd-a396-1ff5a381d717 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:30.419620 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757684d0-44f5-4ddd-a396-1ff5a381d717 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:30.457715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae724d9-673a-4bfd-9981-6d5224588dbf None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:30.489762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f0235-9ecb-4c7c-ba93-d742b7b34d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:30.490544 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0235-9ecb-4c7c-ba93-d742b7b34d20 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:30.490826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0235-9ecb-4c7c-ba93-d742b7b34d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:30.491098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0235-9ecb-4c7c-ba93-d742b7b34d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:30.501011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f0235-9ecb-4c7c-ba93-d742b7b34d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:30.503266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f0235-9ecb-4c7c-ba93-d742b7b34d20 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:30.521902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7d0f0235-9ecb-4c7c-ba93-d742b7b34d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:30.521902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:30.521902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:30.521902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:30.521902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:30.521902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:30.521902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:30.521902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:30.521902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:30.521902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:30.521902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:30.521902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:30.521902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:30.521902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:30.521902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:30.522979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:30.537577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:30.537577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:30.537577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:30.537577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:30.537577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 224/466] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:30.537577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f0235-9ecb-4c7c-ba93-d742b7b34d20 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:30.537911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 243/467] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:29:30 2022] POST /identity/v3/users => generated 246 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:29:30.537911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b4478-aa1b-4fe2-8e05-23a669a7254c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:30.537911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b4478-aa1b-4fe2-8e05-23a669a7254c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:30.537911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b4478-aa1b-4fe2-8e05-23a669a7254c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:30.542350 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 244/468] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:30.542350 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b4478-aa1b-4fe2-8e05-23a669a7254c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:30.646041 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f0235-9ecb-4c7c-ba93-d742b7b34d20 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:30.662385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b4478-aa1b-4fe2-8e05-23a669a7254c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:30.681842 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e553b77-e39e-48f3-9726-b3093c2588a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:30.682524 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e553b77-e39e-48f3-9726-b3093c2588a7 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:30.682802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e553b77-e39e-48f3-9726-b3093c2588a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:30.683078 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e553b77-e39e-48f3-9726-b3093c2588a7 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:30.683851 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e553b77-e39e-48f3-9726-b3093c2588a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:30.685418 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e553b77-e39e-48f3-9726-b3093c2588a7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:30.702631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf608b-3f10-4644-92b2-7869bf2e4fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:30.703313 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf608b-3f10-4644-92b2-7869bf2e4fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:30.703791 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf608b-3f10-4644-92b2-7869bf2e4fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:30.704233 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf608b-3f10-4644-92b2-7869bf2e4fc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:30.711215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf608b-3f10-4644-92b2-7869bf2e4fc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:30.711215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf608b-3f10-4644-92b2-7869bf2e4fc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:30.711215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf608b-3f10-4644-92b2-7869bf2e4fc1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:30.721323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 245/469] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:30.722688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6fb8b-6e16-4121-82f1-f01eb0849ddc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:30.722972 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6fb8b-6e16-4121-82f1-f01eb0849ddc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:30.723380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6fb8b-6e16-4121-82f1-f01eb0849ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:30.744773 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3db6fb8b-6e16-4121-82f1-f01eb0849ddc None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:30.746809 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3db6fb8b-6e16-4121-82f1-f01eb0849ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:30.777181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 225/470] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:29:30 2022] POST /identity/v3/users => generated 248 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:29:30.778621 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e553b77-e39e-48f3-9726-b3093c2588a7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:30.871053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 246/471] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:30.872766 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ce4a2-5ad0-45bc-aa17-898776b94535 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:30.873224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ce4a2-5ad0-45bc-aa17-898776b94535 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:30.873632 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ce4a2-5ad0-45bc-aa17-898776b94535 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:30.879418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 247/472] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:30.881075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacf2fa-115e-418f-8022-bcc0aac309b8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:30.881359 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacf2fa-115e-418f-8022-bcc0aac309b8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:30.881767 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacf2fa-115e-418f-8022-bcc0aac309b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:30.899468 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0dacf2fa-115e-418f-8022-bcc0aac309b8 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:30.900715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0dacf2fa-115e-418f-8022-bcc0aac309b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:30.951085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e553b77-e39e-48f3-9726-b3093c2588a7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:30.991437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844346b-7e5d-453a-83fa-5b0a204149de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:30.992328 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844346b-7e5d-453a-83fa-5b0a204149de None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:30.992748 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844346b-7e5d-453a-83fa-5b0a204149de None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:30.993127 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844346b-7e5d-453a-83fa-5b0a204149de None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:30.993955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844346b-7e5d-453a-83fa-5b0a204149de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:30.995645 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844346b-7e5d-453a-83fa-5b0a204149de None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:31.004683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 248/473] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:31.004683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacf2fa-115e-418f-8022-bcc0aac309b8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:31.105940 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 226/474] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:29:30 2022] POST /identity/v3/users => generated 248 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:29:31.107167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844346b-7e5d-453a-83fa-5b0a204149de None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:31.132649 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacf2fa-115e-418f-8022-bcc0aac309b8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:31.208221 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e749196-8203-4bdb-b70b-aace4d11f0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:31.209047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e749196-8203-4bdb-b70b-aace4d11f0be None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:31.209328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e749196-8203-4bdb-b70b-aace4d11f0be None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:31.209597 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e749196-8203-4bdb-b70b-aace4d11f0be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:31.225700 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e749196-8203-4bdb-b70b-aace4d11f0be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:31.227996 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e749196-8203-4bdb-b70b-aace4d11f0be None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:31.266450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-0e749196-8203-4bdb-b70b-aace4d11f0be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:31.266450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:31.266450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:31.266450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:31.266450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:31.266450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:31.266450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:31.266450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:31.266450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:31.266450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:31.266450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:31.266450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:31.266450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:31.266450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:31.266450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:31.267631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:31.268715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:31.268715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:31.268715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:31.268715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:31.270274 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 249/475] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:31.275019 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e749196-8203-4bdb-b70b-aace4d11f0be None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:31.305592 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844346b-7e5d-453a-83fa-5b0a204149de None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:31.345077 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9210614-9f19-4b7c-8e33-0bd2435dd1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:31.345781 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9210614-9f19-4b7c-8e33-0bd2435dd1bb None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:31.346057 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9210614-9f19-4b7c-8e33-0bd2435dd1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:31.346326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9210614-9f19-4b7c-8e33-0bd2435dd1bb None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:31.347068 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9210614-9f19-4b7c-8e33-0bd2435dd1bb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:31.348430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9210614-9f19-4b7c-8e33-0bd2435dd1bb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:31.397011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.sql.core [None req-a9210614-9f19-4b7c-8e33-0bd2435dd1bb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 17:29:31.397011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 17:29:31.397011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [parameters: {'id': '1ba97cad1c354bbc8948897097a5cc02', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 17:29:31.397011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 17:29:31.409734 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e749196-8203-4bdb-b70b-aace4d11f0be None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:31.415646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a9210614-9f19-4b7c-8e33-0bd2435dd1bb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 17:29:31.415646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:31.415646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 17:29:31.415646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 17:29:31.415646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 17:29:31.415646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 17:29:31.415646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 17:29:31.415646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result = self._query(query) May 04 17:29:31.415646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 17:29:31.415646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application conn.query(q) May 04 17:29:31.415646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 17:29:31.415646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 17:29:31.415646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 17:29:31.415646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result.read() May 04 17:29:31.415646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return ref.to_dict() May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 17:29:31.416505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application next(self.gen) May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application yield resource May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application next(self.gen) May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.session.rollback() May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.force_reraise() May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise self.value May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application session.commit() May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 17:29:31.417479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._prepare_impl() May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.session.flush() May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._flush(objects) May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application compat.raise_( May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application flush_context.execute() May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rec.execute(self) May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 17:29:31.418321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 17:29:31.419171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 17:29:31.419171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 17:29:31.419171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 17:29:31.419171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 17:29:31.419171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 17:29:31.419171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 17:29:31.419171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 17:29:31.419171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 17:29:31.419171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 17:29:31.419171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 17:29:31.419171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 17:29:31.419171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 17:29:31.419171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 17:29:31.419171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 17:29:31.419171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 17:29:31.419171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception May 04 17:29:31.419976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 17:29:31.419976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 17:29:31.419976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 17:29:31.419976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 17:29:31.419976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 17:29:31.419976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result = self._query(query) May 04 17:29:31.419976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 17:29:31.419976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application conn.query(q) May 04 17:29:31.419976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 17:29:31.419976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 17:29:31.419976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 17:29:31.419976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result.read() May 04 17:29:31.419976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 17:29:31.419976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 17:29:31.419976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 17:29:31.419976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 17:29:31.420756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 17:29:31.420756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 17:29:31.420756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 17:29:31.420756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 17:29:31.420756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 17:29:31.420756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 17:29:31.420756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [parameters: {'id': '1ba97cad1c354bbc8948897097a5cc02', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 17:29:31.420756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 17:29:31.420756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:31.420756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:29:31.420756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:31.420756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:31.420756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:31.420756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:31.420756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:31.420756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:31.421549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:31.421549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:31.421549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:31.421549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:31.421549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:31.421549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:31.421549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 04 17:29:31.421549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 04 17:29:31.421549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:31.421549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:31.421549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 04 17:29:31.421549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 04 17:29:31.421549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 17:29:31.421549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 17:29:31.421549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 17:29:31.421549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:31.422359 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 227/476] 10.222.0.81 () {60 vars in 1131 bytes} [Wed May 4 17:29:31 2022] POST /identity/v3/roles => generated 144 bytes in 310 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:31.424321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9210614-9f19-4b7c-8e33-0bd2435dd1bb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:31.474407 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f9a25-09fe-4795-a5ec-62a0d96e8e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:31.474407 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f9a25-09fe-4795-a5ec-62a0d96e8e40 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:31.474407 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f9a25-09fe-4795-a5ec-62a0d96e8e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:31.474407 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f9a25-09fe-4795-a5ec-62a0d96e8e40 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:31.474761 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f9a25-09fe-4795-a5ec-62a0d96e8e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:31.474761 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f9a25-09fe-4795-a5ec-62a0d96e8e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:31.474761 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f9a25-09fe-4795-a5ec-62a0d96e8e40 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:31.484806 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 250/477] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:31.491093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f9a25-09fe-4795-a5ec-62a0d96e8e40 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:31.570004 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9210614-9f19-4b7c-8e33-0bd2435dd1bb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:31.613889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b179c-9097-4015-aa23-14453f455ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:31.614713 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b179c-9097-4015-aa23-14453f455ddf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:31.614999 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b179c-9097-4015-aa23-14453f455ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:31.615274 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b179c-9097-4015-aa23-14453f455ddf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:31.625856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b179c-9097-4015-aa23-14453f455ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:31.634997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f46b179c-9097-4015-aa23-14453f455ddf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:29:31.634997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:31.634997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:31.634997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:31.634997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:31.634997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:31.634997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:31.634997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:31.634997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:31.634997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:31.634997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:31.634997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:31.634997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:31.634997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:31.634997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:31.634997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:31.643542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:31.643542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:31.643542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:31.643542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:31.643542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:31.643542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:31.643542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:31.643542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:31.643542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:31.643542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:31.643542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:31.643542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:31.643542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:31.643542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:31.643542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:31.643542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:31.644357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:31.644357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:31.644357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:31.644357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:31.644357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:31.644357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:31.644357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:31.644357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:31.644357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:31.644357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:31.644357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 17:29:31.644357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:31.644357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 228/478] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:29:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:31.645050 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f9a25-09fe-4795-a5ec-62a0d96e8e40 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:31.645446 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b179c-9097-4015-aa23-14453f455ddf None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:31.676414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f4dc7-509a-4767-a044-9807bd7b6c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:31.677106 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f4dc7-509a-4767-a044-9807bd7b6c82 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:31.677681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f4dc7-509a-4767-a044-9807bd7b6c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:31.677983 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f4dc7-509a-4767-a044-9807bd7b6c82 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:31.678691 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f4dc7-509a-4767-a044-9807bd7b6c82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:31.680126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f4dc7-509a-4767-a044-9807bd7b6c82 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:31.776479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b179c-9097-4015-aa23-14453f455ddf None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:31.791551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 251/479] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:29:31 2022] POST /identity/v3/users => generated 249 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:29:31.821689 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e96485-7a92-48a6-ba04-15c41f2e1999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:31.822409 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e96485-7a92-48a6-ba04-15c41f2e1999 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:31.822753 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e96485-7a92-48a6-ba04-15c41f2e1999 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:31.823084 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e96485-7a92-48a6-ba04-15c41f2e1999 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:31.823951 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e96485-7a92-48a6-ba04-15c41f2e1999 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:31.824295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e96485-7a92-48a6-ba04-15c41f2e1999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:31.825830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e96485-7a92-48a6-ba04-15c41f2e1999 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:31.835170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 229/480] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:33.380682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884213b2-f31f-49e9-9e62-113f6e3ff035 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:33.381675 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884213b2-f31f-49e9-9e62-113f6e3ff035 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:33.382182 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884213b2-f31f-49e9-9e62-113f6e3ff035 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:33.384060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 252/481] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:33.390178 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e366d-bc36-45de-9d9b-2346d787fed8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:33.390690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e366d-bc36-45de-9d9b-2346d787fed8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:33.390762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e366d-bc36-45de-9d9b-2346d787fed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:33.416665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-418e366d-bc36-45de-9d9b-2346d787fed8 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:33.417861 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-418e366d-bc36-45de-9d9b-2346d787fed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:33.503965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 230/482] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:33.537344 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884213b2-f31f-49e9-9e62-113f6e3ff035 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:33.592898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc2129-a307-44a0-a73a-e506dc2d7fcb None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:33.593176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc2129-a307-44a0-a73a-e506dc2d7fcb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:33.593352 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc2129-a307-44a0-a73a-e506dc2d7fcb None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:33.594852 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 231/483] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:29:33.607509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ab0dd-be7a-4ab7-86b5-b822b1d7956e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:33.607793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ab0dd-be7a-4ab7-86b5-b822b1d7956e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:33.608070 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ab0dd-be7a-4ab7-86b5-b822b1d7956e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:33.652488 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-783ab0dd-be7a-4ab7-86b5-b822b1d7956e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:33.653690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-783ab0dd-be7a-4ab7-86b5-b822b1d7956e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:33.676477 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884213b2-f31f-49e9-9e62-113f6e3ff035 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:33.733436 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660083d-6109-4e27-8d75-0625f27a7543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:33.734994 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660083d-6109-4e27-8d75-0625f27a7543 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:33.736693 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660083d-6109-4e27-8d75-0625f27a7543 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:33.738458 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660083d-6109-4e27-8d75-0625f27a7543 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:33.763396 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660083d-6109-4e27-8d75-0625f27a7543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:33.773500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3660083d-6109-4e27-8d75-0625f27a7543 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:33.773500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:33.773500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:33.773500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:33.773500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:33.773500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:33.773500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:33.773500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:33.773500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:33.773500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:33.773500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:33.773500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:33.773500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:33.773500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:33.773500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:33.773500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:33.774444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:33.774444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:33.774444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:33.774444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:33.774444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:33.774444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:33.774444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:33.774444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:33.774444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:33.774444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:33.774444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:33.774444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:33.774444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:33.774444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:33.774444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:33.774444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:33.775198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:33.775198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:33.775198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:33.775198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:33.775198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:33.775198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:33.775198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:33.775198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:33.775198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:33.775198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:33.775198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:33.775198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:33.793510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 253/484] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:33.805881 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660083d-6109-4e27-8d75-0625f27a7543 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:33.822034 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 232/485] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:33.892432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ab0dd-be7a-4ab7-86b5-b822b1d7956e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:33.940496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660083d-6109-4e27-8d75-0625f27a7543 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:33.981474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7039301-fc85-4889-aaaf-221e525eceae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:33.982591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7039301-fc85-4889-aaaf-221e525eceae None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:33.983069 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7039301-fc85-4889-aaaf-221e525eceae None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:33.983534 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7039301-fc85-4889-aaaf-221e525eceae None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:33.984549 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7039301-fc85-4889-aaaf-221e525eceae None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:33.985063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7039301-fc85-4889-aaaf-221e525eceae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:33.987130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7039301-fc85-4889-aaaf-221e525eceae None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:33.996380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 254/486] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:29:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:34.003455 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7039301-fc85-4889-aaaf-221e525eceae None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:34.115899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7039301-fc85-4889-aaaf-221e525eceae None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:34.130117 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ab0dd-be7a-4ab7-86b5-b822b1d7956e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:34.158441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c05ae-1e24-4c3d-840c-cf2815e1715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:34.160006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c05ae-1e24-4c3d-840c-cf2815e1715f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:34.160603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c05ae-1e24-4c3d-840c-cf2815e1715f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:34.161052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c05ae-1e24-4c3d-840c-cf2815e1715f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:34.163531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be252f-b49d-4448-8603-4f675b85e14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:34.164525 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be252f-b49d-4448-8603-4f675b85e14c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:34.164833 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be252f-b49d-4448-8603-4f675b85e14c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:34.165204 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be252f-b49d-4448-8603-4f675b85e14c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:34.175199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c05ae-1e24-4c3d-840c-cf2815e1715f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:34.175628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be252f-b49d-4448-8603-4f675b85e14c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:34.177066 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c05ae-1e24-4c3d-840c-cf2815e1715f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:34.183942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d8be252f-b49d-4448-8603-4f675b85e14c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:34.183942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:34.183942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:34.183942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:34.183942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:34.183942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:34.183942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:34.183942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:34.183942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:34.183942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:34.183942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:34.183942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:34.183942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:34.183942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:34.183942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:34.183942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:34.184971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:34.184971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:34.184971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:34.184971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:34.184971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:34.184971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:34.184971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:34.184971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:34.184971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:34.184971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:34.184971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:34.184971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:34.184971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:34.184971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:34.184971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:34.184971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:34.185730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:34.185730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:34.185730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:34.185730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:34.185730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:34.185730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:34.185730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:34.185730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:34.185730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:34.185730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:34.185730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:34.185730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:34.186316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 233/487] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:29:34.187540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120184d1-e9d7-497b-ade0-215138518afb None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:34.187886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120184d1-e9d7-497b-ade0-215138518afb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:34.188225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120184d1-e9d7-497b-ade0-215138518afb None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:34.190392 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 234/488] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:34.195139 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120184d1-e9d7-497b-ade0-215138518afb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:34.200578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ba7c05ae-1e24-4c3d-840c-cf2815e1715f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:34.200578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:34.200578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:34.200578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:34.200578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:34.200578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:34.200578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:34.200578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:34.200578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:34.200578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:34.200578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:34.200578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:34.200578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:34.200578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:34.200578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:34.201400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:34.202217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:34.202217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:34.202217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:34.202217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:34.208924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 255/489] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:29:34.211232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1260f-8f59-4963-bc0a-40ba5090d687 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:34.211757 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1260f-8f59-4963-bc0a-40ba5090d687 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:34.212229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1260f-8f59-4963-bc0a-40ba5090d687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:34.235061 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-20f1260f-8f59-4963-bc0a-40ba5090d687 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:34.237531 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-20f1260f-8f59-4963-bc0a-40ba5090d687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:34.306961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120184d1-e9d7-497b-ade0-215138518afb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:34.328587 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 256/490] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:34.330335 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1260f-8f59-4963-bc0a-40ba5090d687 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:34.349888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6500d6c-3b72-4f1d-a9e2-7146e1cdff24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:34.351415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6500d6c-3b72-4f1d-a9e2-7146e1cdff24 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:34.351891 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6500d6c-3b72-4f1d-a9e2-7146e1cdff24 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:34.352313 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6500d6c-3b72-4f1d-a9e2-7146e1cdff24 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:34.353628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6500d6c-3b72-4f1d-a9e2-7146e1cdff24 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:34.354099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6500d6c-3b72-4f1d-a9e2-7146e1cdff24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:34.356011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6500d6c-3b72-4f1d-a9e2-7146e1cdff24 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:34.367958 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 235/491] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:29:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:34.377926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6500d6c-3b72-4f1d-a9e2-7146e1cdff24 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:34.456286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1260f-8f59-4963-bc0a-40ba5090d687 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:34.486585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6500d6c-3b72-4f1d-a9e2-7146e1cdff24 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:34.491700 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3e635-af5d-4784-ac14-36ffbdb54de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:34.492493 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3e635-af5d-4784-ac14-36ffbdb54de6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:34.492869 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3e635-af5d-4784-ac14-36ffbdb54de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:34.493255 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3e635-af5d-4784-ac14-36ffbdb54de6 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:34.494073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3e635-af5d-4784-ac14-36ffbdb54de6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:34.494472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3e635-af5d-4784-ac14-36ffbdb54de6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:34.495946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3e635-af5d-4784-ac14-36ffbdb54de6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:34.511031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 257/492] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:34.512376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3e635-af5d-4784-ac14-36ffbdb54de6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:34.573263 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b94a4e-6175-406b-989a-753bc61ab6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:34.574058 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b94a4e-6175-406b-989a-753bc61ab6bc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:34.574341 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b94a4e-6175-406b-989a-753bc61ab6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:34.574611 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b94a4e-6175-406b-989a-753bc61ab6bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:34.585752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b94a4e-6175-406b-989a-753bc61ab6bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:34.593793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-95b94a4e-6175-406b-989a-753bc61ab6bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:34.593793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:34.593793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:34.593793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:34.593793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:34.593793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:34.593793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:34.593793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:34.593793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:34.593793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:34.593793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:34.593793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:34.593793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:34.593793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:34.593793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:34.593793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:34.594703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:34.594703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:34.594703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:34.594703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:34.594703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:34.594703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:34.594703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:34.594703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:34.594703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:34.594703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:34.594703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:34.594703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:34.594703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:34.594703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:34.594703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:34.594703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:34.601391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:34.601391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:34.601391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:34.601391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:34.601391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:34.601391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:34.601391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:34.601391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:34.601391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:34.601391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:34.601391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:34.601391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:34.601391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 236/493] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:34.601391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b94a4e-6175-406b-989a-753bc61ab6bc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:34.648630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3e635-af5d-4784-ac14-36ffbdb54de6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:34.684259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a1d61-37da-4162-98d8-f8d0fb7edf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:34.685113 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a1d61-37da-4162-98d8-f8d0fb7edf57 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:34.685394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a1d61-37da-4162-98d8-f8d0fb7edf57 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:34.685681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a1d61-37da-4162-98d8-f8d0fb7edf57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:34.697242 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a1d61-37da-4162-98d8-f8d0fb7edf57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:34.698700 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a1d61-37da-4162-98d8-f8d0fb7edf57 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:34.705098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b94a4e-6175-406b-989a-753bc61ab6bc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:34.717478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-846a1d61-37da-4162-98d8-f8d0fb7edf57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:34.717478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:34.717478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:34.717478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:34.717478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:34.717478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:34.717478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:34.717478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:34.717478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:34.717478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:34.717478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:34.717478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:34.717478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:34.717478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:34.717478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:34.718361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:34.719178 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:34.719178 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:34.719178 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:34.719178 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:34.719178 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 258/494] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:34.720607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144009c-2cb7-40c2-b2af-a1f8238a1cfe None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:34.720986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144009c-2cb7-40c2-b2af-a1f8238a1cfe None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:34.721354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144009c-2cb7-40c2-b2af-a1f8238a1cfe None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:34.726586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 259/495] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:34.726586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144009c-2cb7-40c2-b2af-a1f8238a1cfe None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:34.746243 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472dd74-4ea8-4441-87fb-db733ec48033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:34.747108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472dd74-4ea8-4441-87fb-db733ec48033 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:34.747338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472dd74-4ea8-4441-87fb-db733ec48033 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:34.747656 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472dd74-4ea8-4441-87fb-db733ec48033 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:34.755963 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472dd74-4ea8-4441-87fb-db733ec48033 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:34.757455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472dd74-4ea8-4441-87fb-db733ec48033 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:34.773591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d472dd74-4ea8-4441-87fb-db733ec48033 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 17:29:34.773591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:34.773591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:34.773591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:34.773591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:34.773591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:34.773591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:34.773591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:34.773591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:34.773591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:34.773591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:34.773591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:34.773591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:29:34.773591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:29:34.773591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:29:34.773591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:34.774514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:34.775386 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:34.775386 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:34.775386 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:29:34.775386 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:29:34.775386 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:29:34.775386 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:29:34.775386 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:29:34.775386 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:29:34.775386 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 17:29:34.775386 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:34.779696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 237/496] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:34.781235 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472dd74-4ea8-4441-87fb-db733ec48033 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:34.842045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144009c-2cb7-40c2-b2af-a1f8238a1cfe None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:34.875603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30211c08-4c59-4f52-8615-d7b1f7f23c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:34.876333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30211c08-4c59-4f52-8615-d7b1f7f23c10 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:34.876906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30211c08-4c59-4f52-8615-d7b1f7f23c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:34.877187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30211c08-4c59-4f52-8615-d7b1f7f23c10 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:34.877926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30211c08-4c59-4f52-8615-d7b1f7f23c10 None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:34.878232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30211c08-4c59-4f52-8615-d7b1f7f23c10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:34.879594 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30211c08-4c59-4f52-8615-d7b1f7f23c10 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:34.887308 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 260/497] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:29:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:34.888248 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472dd74-4ea8-4441-87fb-db733ec48033 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:34.888496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502fc5c-22bc-4489-8ec2-c20ccea96e86 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:34.888786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502fc5c-22bc-4489-8ec2-c20ccea96e86 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:34.889063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502fc5c-22bc-4489-8ec2-c20ccea96e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:34.906085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6502fc5c-22bc-4489-8ec2-c20ccea96e86 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:34.907346 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6502fc5c-22bc-4489-8ec2-c20ccea96e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:34.921264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51caab06-51c2-4c61-b564-028547db6a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:34.921911 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51caab06-51c2-4c61-b564-028547db6a3f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:34.922190 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51caab06-51c2-4c61-b564-028547db6a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:34.922463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51caab06-51c2-4c61-b564-028547db6a3f None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:34.923791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51caab06-51c2-4c61-b564-028547db6a3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:34.924175 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51caab06-51c2-4c61-b564-028547db6a3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:34.925562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51caab06-51c2-4c61-b564-028547db6a3f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:34.936616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 238/498] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:34.937446 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51caab06-51c2-4c61-b564-028547db6a3f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:34.974425 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 261/499] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:34.975670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0daaf-d4fa-4043-a26e-abfff09b4182 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:34.975957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0daaf-d4fa-4043-a26e-abfff09b4182 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:34.976231 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0daaf-d4fa-4043-a26e-abfff09b4182 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:34.981563 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 262/500] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:34.982323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0daaf-d4fa-4043-a26e-abfff09b4182 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:35.033158 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51caab06-51c2-4c61-b564-028547db6a3f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:35.065924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c335136-8a28-462e-b54f-f3d5ab88c88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:35.066590 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c335136-8a28-462e-b54f-f3d5ab88c88d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:35.066874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c335136-8a28-462e-b54f-f3d5ab88c88d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:35.067150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c335136-8a28-462e-b54f-f3d5ab88c88d None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:35.067998 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c335136-8a28-462e-b54f-f3d5ab88c88d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:35.068308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c335136-8a28-462e-b54f-f3d5ab88c88d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:35.069761 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c335136-8a28-462e-b54f-f3d5ab88c88d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:35.082203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0daaf-d4fa-4043-a26e-abfff09b4182 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:35.107128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 239/501] 10.222.0.81 () {56 vars in 1137 bytes} [Wed May 4 17:29:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:35.107784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c335136-8a28-462e-b54f-f3d5ab88c88d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:35.120030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee6aa8-8ddc-42d7-a50d-2f24102e0d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:35.120843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee6aa8-8ddc-42d7-a50d-2f24102e0d0b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:35.121124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee6aa8-8ddc-42d7-a50d-2f24102e0d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:35.121398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee6aa8-8ddc-42d7-a50d-2f24102e0d0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:35.131442 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee6aa8-8ddc-42d7-a50d-2f24102e0d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:35.132938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee6aa8-8ddc-42d7-a50d-2f24102e0d0b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:35.150049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-1cee6aa8-8ddc-42d7-a50d-2f24102e0d0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:35.150049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:35.150049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:35.150049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:35.150049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:35.150049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:35.150049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:35.150049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:35.150049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:35.150049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:35.150049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:35.150049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:35.150049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:35.150049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:35.150049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:35.151005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:35.151804 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:35.151804 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:35.151804 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:35.151804 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:35.151804 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 263/502] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:35.152402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce27211-1c71-4f32-97c5-d67f3bdf3bcb None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:35.152704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce27211-1c71-4f32-97c5-d67f3bdf3bcb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:35.152980 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce27211-1c71-4f32-97c5-d67f3bdf3bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:35.170095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4ce27211-1c71-4f32-97c5-d67f3bdf3bcb None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:35.171282 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4ce27211-1c71-4f32-97c5-d67f3bdf3bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:35.208665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c335136-8a28-462e-b54f-f3d5ab88c88d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:35.235360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 264/503] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:35.236596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce27211-1c71-4f32-97c5-d67f3bdf3bcb None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:35.241519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00bace-feb5-41e2-8bed-e31cff841e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:35.242306 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00bace-feb5-41e2-8bed-e31cff841e53 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:35.242591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00bace-feb5-41e2-8bed-e31cff841e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:35.242867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00bace-feb5-41e2-8bed-e31cff841e53 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:35.249725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00bace-feb5-41e2-8bed-e31cff841e53 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:35.251979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00bace-feb5-41e2-8bed-e31cff841e53 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:35.268529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-af00bace-feb5-41e2-8bed-e31cff841e53 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:29:35.268529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:35.268529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:35.268529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:35.268529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:35.268529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:35.268529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:35.268529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:35.268529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:35.268529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:35.268529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:35.268529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:35.268529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:29:35.268529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:29:35.268529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:29:35.268529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:35.269449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:35.270503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:35.270503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:35.270503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:29:35.270503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:29:35.270503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:29:35.270503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:29:35.270503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:29:35.270503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:29:35.270503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:29:35.270503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:35.270503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 240/504] 10.222.0.81 () {56 vars in 1093 bytes} [Wed May 4 17:29:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:35.270503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00bace-feb5-41e2-8bed-e31cff841e53 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:35.334752 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce27211-1c71-4f32-97c5-d67f3bdf3bcb None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:35.368381 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00bace-feb5-41e2-8bed-e31cff841e53 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:35.376895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025b6f8-63f1-436e-8d10-9c67e0f7b580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:35.377682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025b6f8-63f1-436e-8d10-9c67e0f7b580 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:35.377960 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025b6f8-63f1-436e-8d10-9c67e0f7b580 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:35.378233 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025b6f8-63f1-436e-8d10-9c67e0f7b580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:35.392135 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025b6f8-63f1-436e-8d10-9c67e0f7b580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:35.393632 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025b6f8-63f1-436e-8d10-9c67e0f7b580 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:35.411702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-4025b6f8-63f1-436e-8d10-9c67e0f7b580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:35.411702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:35.411702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:35.411702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:35.411702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:35.411702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:35.411702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:35.411702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:35.411702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:35.411702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:35.411702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:35.411702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:35.411702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:35.411702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:35.411702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:35.412709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:35.413519 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:35.413519 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:35.413519 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:35.413519 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:35.413519 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 265/505] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:35.413775 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025b6f8-63f1-436e-8d10-9c67e0f7b580 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:35.423331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb1f0e-e7ee-4e53-9cba-b90c4056c2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:35.423989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb1f0e-e7ee-4e53-9cba-b90c4056c2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:35.424273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb1f0e-e7ee-4e53-9cba-b90c4056c2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:35.424577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb1f0e-e7ee-4e53-9cba-b90c4056c2a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:35.490957 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb1f0e-e7ee-4e53-9cba-b90c4056c2a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:35.492319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb1f0e-e7ee-4e53-9cba-b90c4056c2a9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:35.514733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025b6f8-63f1-436e-8d10-9c67e0f7b580 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:35.553358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db9338-df74-4c22-99e1-7869cdb65724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:35.554491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db9338-df74-4c22-99e1-7869cdb65724 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:35.555001 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db9338-df74-4c22-99e1-7869cdb65724 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:35.555494 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db9338-df74-4c22-99e1-7869cdb65724 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:35.556591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db9338-df74-4c22-99e1-7869cdb65724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:35.557147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db9338-df74-4c22-99e1-7869cdb65724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:35.564951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db9338-df74-4c22-99e1-7869cdb65724 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:35.586378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 266/506] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:35.586378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db9338-df74-4c22-99e1-7869cdb65724 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:35.603891 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 241/507] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:35.604770 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb1f0e-e7ee-4e53-9cba-b90c4056c2a9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:35.686730 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db9338-df74-4c22-99e1-7869cdb65724 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:35.705191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb1f0e-e7ee-4e53-9cba-b90c4056c2a9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:35.720680 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55048f1f-fe34-42d0-ac6d-d5af6c6330b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:35.721472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55048f1f-fe34-42d0-ac6d-d5af6c6330b2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:35.721745 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55048f1f-fe34-42d0-ac6d-d5af6c6330b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:35.722018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55048f1f-fe34-42d0-ac6d-d5af6c6330b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:35.733030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55048f1f-fe34-42d0-ac6d-d5af6c6330b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:35.739624 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41bc9d-fa9c-42c5-a99a-adbac84d2735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:35.740290 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41bc9d-fa9c-42c5-a99a-adbac84d2735 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:35.740606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41bc9d-fa9c-42c5-a99a-adbac84d2735 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:35.740886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41bc9d-fa9c-42c5-a99a-adbac84d2735 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:35.741781 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41bc9d-fa9c-42c5-a99a-adbac84d2735 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:35.742043 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41bc9d-fa9c-42c5-a99a-adbac84d2735 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:35.742441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-55048f1f-fe34-42d0-ac6d-d5af6c6330b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:35.742441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:35.742441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:35.742441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:35.742441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:35.742441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:35.742441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:35.742441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:35.742441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:35.742441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:35.742441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:35.742441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:35.742441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:35.742441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:35.742441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:35.742441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:35.744140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:35.744140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:35.744140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:35.744140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:35.744140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:35.744140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:35.744140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:35.744140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:35.744140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:35.744140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:35.744140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:35.744140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:35.744140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:35.744140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:35.744140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:35.744140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:35.745918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:35.745918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:35.745918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:35.745918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:35.745918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:35.745918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:35.745918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:35.745918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:35.745918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:35.745918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:35.745918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:35.745918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:35.747191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41bc9d-fa9c-42c5-a99a-adbac84d2735 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:35.748592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 267/508] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:35.749329 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55048f1f-fe34-42d0-ac6d-d5af6c6330b2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:35.763108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 242/509] 10.222.0.81 () {56 vars in 1133 bytes} [Wed May 4 17:29:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:35.763944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41bc9d-fa9c-42c5-a99a-adbac84d2735 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:35.857861 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55048f1f-fe34-42d0-ac6d-d5af6c6330b2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:35.864292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41bc9d-fa9c-42c5-a99a-adbac84d2735 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:35.893157 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829fd9d-c911-426c-948c-49196d88365d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:35.893796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829fd9d-c911-426c-948c-49196d88365d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:35.894073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829fd9d-c911-426c-948c-49196d88365d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:35.894341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829fd9d-c911-426c-948c-49196d88365d None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:35.895060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829fd9d-c911-426c-948c-49196d88365d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:35.895355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829fd9d-c911-426c-948c-49196d88365d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:35.896763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829fd9d-c911-426c-948c-49196d88365d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:35.899217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fb787-3b5e-4fe5-b24e-55cb1efeffcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:35.900083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fb787-3b5e-4fe5-b24e-55cb1efeffcd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:35.900428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fb787-3b5e-4fe5-b24e-55cb1efeffcd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:35.900803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fb787-3b5e-4fe5-b24e-55cb1efeffcd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:35.909390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fb787-3b5e-4fe5-b24e-55cb1efeffcd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:35.909990 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 268/510] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:35.910719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829fd9d-c911-426c-948c-49196d88365d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:35.911729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fb787-3b5e-4fe5-b24e-55cb1efeffcd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:35.929423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a71fb787-3b5e-4fe5-b24e-55cb1efeffcd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 17:29:35.929423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:35.929423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:35.929423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:35.929423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:35.929423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:35.929423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:35.929423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:35.929423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:35.929423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:35.929423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:35.929423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:35.929423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:29:35.929423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:29:35.929423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:29:35.929423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:35.935887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:35.936992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:35.936992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:35.936992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:29:35.936992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:29:35.936992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:29:35.936992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:29:35.936992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:29:35.936992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:29:35.936992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 17:29:35.936992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:35.936992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 243/511] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:35.936992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fb787-3b5e-4fe5-b24e-55cb1efeffcd None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:36.030425 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829fd9d-c911-426c-948c-49196d88365d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:36.046666 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fb787-3b5e-4fe5-b24e-55cb1efeffcd None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:36.065535 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71229e9e-72ee-44fd-b594-d73098cd544c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:36.066310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71229e9e-72ee-44fd-b594-d73098cd544c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:36.066581 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71229e9e-72ee-44fd-b594-d73098cd544c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:36.066847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71229e9e-72ee-44fd-b594-d73098cd544c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:36.076514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71229e9e-72ee-44fd-b594-d73098cd544c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:36.077965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71229e9e-72ee-44fd-b594-d73098cd544c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:36.082451 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e32cf8-73ec-4122-ba0a-85cd7090400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:36.083116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e32cf8-73ec-4122-ba0a-85cd7090400c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:36.083398 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e32cf8-73ec-4122-ba0a-85cd7090400c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:36.083672 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e32cf8-73ec-4122-ba0a-85cd7090400c None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:36.084427 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e32cf8-73ec-4122-ba0a-85cd7090400c None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:36.084766 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e32cf8-73ec-4122-ba0a-85cd7090400c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:36.086143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e32cf8-73ec-4122-ba0a-85cd7090400c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:36.094193 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 244/512] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:29:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:36.095290 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e32cf8-73ec-4122-ba0a-85cd7090400c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:36.097251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-71229e9e-72ee-44fd-b594-d73098cd544c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:36.097251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:36.097251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:36.097251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:36.097251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:36.097251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:36.097251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:36.097251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:36.097251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:36.097251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:36.097251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:36.097251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:36.097251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:36.097251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:36.097251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:36.098838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:36.100823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:36.100823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:36.100823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:36.100823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:36.100823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 269/513] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:36.100823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71229e9e-72ee-44fd-b594-d73098cd544c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:36.212034 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e32cf8-73ec-4122-ba0a-85cd7090400c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:36.226937 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71229e9e-72ee-44fd-b594-d73098cd544c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:36.248000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de182ee4-5bf1-41fc-8a0b-31a2d94fe5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:36.249182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de182ee4-5bf1-41fc-8a0b-31a2d94fe5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:36.249549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de182ee4-5bf1-41fc-8a0b-31a2d94fe5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:36.249909 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de182ee4-5bf1-41fc-8a0b-31a2d94fe5f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:36.262445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29839d15-d209-41a7-8ff6-4d38aca67e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:36.263117 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839d15-d209-41a7-8ff6-4d38aca67e0f None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:36.263402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839d15-d209-41a7-8ff6-4d38aca67e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:36.263677 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839d15-d209-41a7-8ff6-4d38aca67e0f None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:36.264383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29839d15-d209-41a7-8ff6-4d38aca67e0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:36.265847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29839d15-d209-41a7-8ff6-4d38aca67e0f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:36.320502 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de182ee4-5bf1-41fc-8a0b-31a2d94fe5f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:36.321897 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de182ee4-5bf1-41fc-8a0b-31a2d94fe5f7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:36.344855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 270/514] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:29:36 2022] POST /identity/v3/users => generated 247 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:29:36.345840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29839d15-d209-41a7-8ff6-4d38aca67e0f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:36.460114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 245/515] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:36.461403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de182ee4-5bf1-41fc-8a0b-31a2d94fe5f7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:36.473369 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29839d15-d209-41a7-8ff6-4d38aca67e0f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:36.520508 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763d309-40b8-4ea5-bba4-0d93f9603f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:36.521282 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763d309-40b8-4ea5-bba4-0d93f9603f71 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:36.521466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763d309-40b8-4ea5-bba4-0d93f9603f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:36.521742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763d309-40b8-4ea5-bba4-0d93f9603f71 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:36.522666 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763d309-40b8-4ea5-bba4-0d93f9603f71 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:36.523025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763d309-40b8-4ea5-bba4-0d93f9603f71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:36.524524 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763d309-40b8-4ea5-bba4-0d93f9603f71 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:36.564305 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 271/516] 10.222.0.81 () {56 vars in 1137 bytes} [Wed May 4 17:29:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:36.565807 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763d309-40b8-4ea5-bba4-0d93f9603f71 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:36.623154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de182ee4-5bf1-41fc-8a0b-31a2d94fe5f7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:36.667904 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763d309-40b8-4ea5-bba4-0d93f9603f71 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:36.673980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e7901-84dc-42eb-b971-3b655ea043d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:36.675170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e7901-84dc-42eb-b971-3b655ea043d6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:36.675601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e7901-84dc-42eb-b971-3b655ea043d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:36.676043 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e7901-84dc-42eb-b971-3b655ea043d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:36.690881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e7901-84dc-42eb-b971-3b655ea043d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:36.692335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e7901-84dc-42eb-b971-3b655ea043d6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:36.707270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23597d-4af4-40f3-9bc7-d5b8844f2f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:36.707928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23597d-4af4-40f3-9bc7-d5b8844f2f60 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:36.708201 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23597d-4af4-40f3-9bc7-d5b8844f2f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:36.708493 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23597d-4af4-40f3-9bc7-d5b8844f2f60 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:36.709216 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23597d-4af4-40f3-9bc7-d5b8844f2f60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:36.709514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23597d-4af4-40f3-9bc7-d5b8844f2f60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:36.710897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23597d-4af4-40f3-9bc7-d5b8844f2f60 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:36.711685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-518e7901-84dc-42eb-b971-3b655ea043d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:36.711685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:36.711685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:36.711685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:36.711685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:36.711685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:36.711685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:36.711685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:36.711685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:36.711685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:36.711685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:36.711685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:36.711685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:36.711685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:36.711685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:36.713028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:36.715207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:36.715207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:36.715207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:36.715207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:36.715207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 246/517] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:36.715207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e7901-84dc-42eb-b971-3b655ea043d6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:36.733342 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 272/518] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:36.734820 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23597d-4af4-40f3-9bc7-d5b8844f2f60 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:36.835648 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e7901-84dc-42eb-b971-3b655ea043d6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:36.866581 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23597d-4af4-40f3-9bc7-d5b8844f2f60 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:36.875877 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c621f3b-15c7-4906-bd4e-926c363df90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:36.877313 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c621f3b-15c7-4906-bd4e-926c363df90c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:36.877725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c621f3b-15c7-4906-bd4e-926c363df90c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:36.878170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c621f3b-15c7-4906-bd4e-926c363df90c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:36.890817 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c621f3b-15c7-4906-bd4e-926c363df90c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:36.893503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c621f3b-15c7-4906-bd4e-926c363df90c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:36.908858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af79065-2277-44ad-b1bb-10e7b2cd345c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:36.909383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af79065-2277-44ad-b1bb-10e7b2cd345c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:36.909795 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af79065-2277-44ad-b1bb-10e7b2cd345c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:36.910187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af79065-2277-44ad-b1bb-10e7b2cd345c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:36.920703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5c621f3b-15c7-4906-bd4e-926c363df90c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:36.920703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:36.920703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:36.920703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:36.920703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:36.920703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:36.920703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:36.920703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:36.920703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:36.920703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:36.920703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:36.920703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:36.920703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:36.920703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:36.920703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:36.921552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:36.922362 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:36.922362 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:36.922362 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:36.922362 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:36.922665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 247/519] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:36.923765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c621f3b-15c7-4906-bd4e-926c363df90c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:36.990827 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af79065-2277-44ad-b1bb-10e7b2cd345c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:36.992298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af79065-2277-44ad-b1bb-10e7b2cd345c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:37.056976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c621f3b-15c7-4906-bd4e-926c363df90c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:37.092331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d81a5b-6f94-4356-96c0-fc270c5e521d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:37.093282 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d81a5b-6f94-4356-96c0-fc270c5e521d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:37.093705 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d81a5b-6f94-4356-96c0-fc270c5e521d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:37.094119 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d81a5b-6f94-4356-96c0-fc270c5e521d None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:37.095611 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d81a5b-6f94-4356-96c0-fc270c5e521d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:37.096111 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d81a5b-6f94-4356-96c0-fc270c5e521d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:37.097741 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d81a5b-6f94-4356-96c0-fc270c5e521d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:37.110502 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 248/520] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:37.111544 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d81a5b-6f94-4356-96c0-fc270c5e521d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:37.136107 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 273/521] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:37.137385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af79065-2277-44ad-b1bb-10e7b2cd345c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:37.257788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d81a5b-6f94-4356-96c0-fc270c5e521d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:37.278267 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af79065-2277-44ad-b1bb-10e7b2cd345c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:37.302562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019c5cb-c824-4712-bff3-27f8a93fc506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:37.303812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019c5cb-c824-4712-bff3-27f8a93fc506 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:37.304241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019c5cb-c824-4712-bff3-27f8a93fc506 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:37.304722 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019c5cb-c824-4712-bff3-27f8a93fc506 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:37.315007 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019c5cb-c824-4712-bff3-27f8a93fc506 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:37.316368 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019c5cb-c824-4712-bff3-27f8a93fc506 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:37.330295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6c63c-446f-4298-9bb8-0c4358368b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:37.330959 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6c63c-446f-4298-9bb8-0c4358368b8e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:37.331232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6c63c-446f-4298-9bb8-0c4358368b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:37.331500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6c63c-446f-4298-9bb8-0c4358368b8e None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:37.340158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6c63c-446f-4298-9bb8-0c4358368b8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:37.340158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6c63c-446f-4298-9bb8-0c4358368b8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:37.340158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6c63c-446f-4298-9bb8-0c4358368b8e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:37.341143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b019c5cb-c824-4712-bff3-27f8a93fc506 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:37.341143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:37.341143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:37.341143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:37.341143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:37.341143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:37.341143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:37.341143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:37.341143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:37.341143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:37.341143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:37.341143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:37.341143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:29:37.341143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:29:37.341143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:37.342432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:37.343294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:29:37.343294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:29:37.343294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:29:37.343294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:29:37.343294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:29:37.343294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:29:37.343294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:37.343294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:37.343294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 249/522] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:37.343294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019c5cb-c824-4712-bff3-27f8a93fc506 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:37.361081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 274/523] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:37.361081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6c63c-446f-4298-9bb8-0c4358368b8e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:37.502636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019c5cb-c824-4712-bff3-27f8a93fc506 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:37.507889 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6c63c-446f-4298-9bb8-0c4358368b8e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:37.553879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b7864-b20e-4f74-b550-7c970383d832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:37.555027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b7864-b20e-4f74-b550-7c970383d832 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:37.555460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b7864-b20e-4f74-b550-7c970383d832 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:37.555950 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b7864-b20e-4f74-b550-7c970383d832 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:37.556343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103d89b-976b-437d-ac0b-824a5c145656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:37.557257 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103d89b-976b-437d-ac0b-824a5c145656 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:37.557617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103d89b-976b-437d-ac0b-824a5c145656 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:37.557986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103d89b-976b-437d-ac0b-824a5c145656 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:37.567410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b7864-b20e-4f74-b550-7c970383d832 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:37.569314 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b7864-b20e-4f74-b550-7c970383d832 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:37.571996 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103d89b-976b-437d-ac0b-824a5c145656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:37.574385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103d89b-976b-437d-ac0b-824a5c145656 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:37.590878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-196b7864-b20e-4f74-b550-7c970383d832 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 17:29:37.590878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:37.590878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:37.590878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:37.590878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:37.590878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:37.590878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:37.590878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:37.590878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:37.590878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:37.590878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:37.590878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:37.590878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:29:37.590878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:29:37.590878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:29:37.590878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:37.591934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:37.592855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:37.592855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:37.592855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:29:37.592855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:29:37.592855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:29:37.592855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:29:37.592855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:29:37.592855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:29:37.592855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 17:29:37.592855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:37.601010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 250/524] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:37.601010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b7864-b20e-4f74-b550-7c970383d832 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:37.606444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-8103d89b-976b-437d-ac0b-824a5c145656 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:37.606444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:37.606444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:37.606444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:37.606444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:37.606444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:37.606444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:37.606444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:37.606444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:37.606444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:37.606444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:37.606444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:37.606444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:37.606444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:37.606444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:37.607461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:37.608252 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:37.608252 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:37.608252 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:37.608252 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:37.608252 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 275/525] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:37.608989 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103d89b-976b-437d-ac0b-824a5c145656 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:37.725823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b7864-b20e-4f74-b550-7c970383d832 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:37.771539 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103d89b-976b-437d-ac0b-824a5c145656 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:37.777605 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb977a5e-b4de-4062-a959-ca1c19e290b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:37.778501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb977a5e-b4de-4062-a959-ca1c19e290b5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:37.778974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb977a5e-b4de-4062-a959-ca1c19e290b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:37.779452 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb977a5e-b4de-4062-a959-ca1c19e290b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:37.780479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb977a5e-b4de-4062-a959-ca1c19e290b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:37.781404 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb977a5e-b4de-4062-a959-ca1c19e290b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:37.784832 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb977a5e-b4de-4062-a959-ca1c19e290b5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:37.809980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 251/526] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:29:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:37.811180 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb977a5e-b4de-4062-a959-ca1c19e290b5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:37.820097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800257f-db31-4c68-b921-4450b31b3267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:37.821584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800257f-db31-4c68-b921-4450b31b3267 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:37.822030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800257f-db31-4c68-b921-4450b31b3267 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:37.822472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800257f-db31-4c68-b921-4450b31b3267 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:37.834611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800257f-db31-4c68-b921-4450b31b3267 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:37.837114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800257f-db31-4c68-b921-4450b31b3267 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:37.863241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-5800257f-db31-4c68-b921-4450b31b3267 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:37.863241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:37.863241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:37.863241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:37.863241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:37.863241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:37.863241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:37.863241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:37.863241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:37.863241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:37.863241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:37.863241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:37.863241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:29:37.863241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:29:37.863241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:37.864122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:37.864969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:29:37.864969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:29:37.864969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:29:37.864969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:29:37.864969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:29:37.864969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:29:37.864969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:37.864969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:37.865822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 276/527] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:37.867136 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800257f-db31-4c68-b921-4450b31b3267 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:37.936941 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb977a5e-b4de-4062-a959-ca1c19e290b5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:37.989577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e0e88-68af-4251-bdc6-0476ef90c599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:37.990250 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e0e88-68af-4251-bdc6-0476ef90c599 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:37.990532 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e0e88-68af-4251-bdc6-0476ef90c599 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:37.990803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e0e88-68af-4251-bdc6-0476ef90c599 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:37.991650 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e0e88-68af-4251-bdc6-0476ef90c599 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:37.992123 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e0e88-68af-4251-bdc6-0476ef90c599 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:37.993580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e0e88-68af-4251-bdc6-0476ef90c599 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:38.026730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 252/528] 10.222.0.81 () {56 vars in 1139 bytes} [Wed May 4 17:29:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:38.027615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e0e88-68af-4251-bdc6-0476ef90c599 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:38.044028 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800257f-db31-4c68-b921-4450b31b3267 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:38.090276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bf18d-ba81-412e-aa78-e32ad4b36980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:38.091609 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf18d-ba81-412e-aa78-e32ad4b36980 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:38.092106 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf18d-ba81-412e-aa78-e32ad4b36980 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:38.093142 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf18d-ba81-412e-aa78-e32ad4b36980 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:38.095030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bf18d-ba81-412e-aa78-e32ad4b36980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:38.095834 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bf18d-ba81-412e-aa78-e32ad4b36980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:38.098794 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bf18d-ba81-412e-aa78-e32ad4b36980 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:38.120086 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 277/529] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:38.121659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bf18d-ba81-412e-aa78-e32ad4b36980 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:38.187467 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e0e88-68af-4251-bdc6-0476ef90c599 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:38.258585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fa73b-2bf4-42d6-818c-77de27a545b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:38.260458 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fa73b-2bf4-42d6-818c-77de27a545b5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:38.261788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fa73b-2bf4-42d6-818c-77de27a545b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:38.262908 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fa73b-2bf4-42d6-818c-77de27a545b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:38.265908 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897fa73b-2bf4-42d6-818c-77de27a545b5 None admin] RBAC: Adding query filter params (role.id=61d7286cc614424e9d7b8514b201ee21, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=ec8e2eb70a5d4dd1b3a9bec2bd0a78a9) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:38.267034 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897fa73b-2bf4-42d6-818c-77de27a545b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:38.271638 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897fa73b-2bf4-42d6-818c-77de27a545b5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:38.273770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bf18d-ba81-412e-aa78-e32ad4b36980 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:38.280491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 253/530] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:29:38 2022] GET /identity/v3/role_assignments?user.id=ec8e2eb70a5d4dd1b3a9bec2bd0a78a9&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=61d7286cc614424e9d7b8514b201ee21 => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:38.281614 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fa73b-2bf4-42d6-818c-77de27a545b5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:38.334806 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a134e-0d55-43be-937a-034377df2963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:38.335412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a134e-0d55-43be-937a-034377df2963 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:38.335790 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a134e-0d55-43be-937a-034377df2963 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:38.336180 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a134e-0d55-43be-937a-034377df2963 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:38.337166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a134e-0d55-43be-937a-034377df2963 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:38.337661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a134e-0d55-43be-937a-034377df2963 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:38.339289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a134e-0d55-43be-937a-034377df2963 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:38.368623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 278/531] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:38.369859 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a134e-0d55-43be-937a-034377df2963 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:38.412958 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fa73b-2bf4-42d6-818c-77de27a545b5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:38.450643 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6dac7-d088-483f-83d5-87152a717dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:38.451635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6dac7-d088-483f-83d5-87152a717dcf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:38.452049 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6dac7-d088-483f-83d5-87152a717dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:38.452524 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6dac7-d088-483f-83d5-87152a717dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:38.486676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a134e-0d55-43be-937a-034377df2963 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:38.524297 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4645cd3-7643-4f0c-a9c7-dc19e9b84d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:38.525269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4645cd3-7643-4f0c-a9c7-dc19e9b84d09 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:38.525645 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4645cd3-7643-4f0c-a9c7-dc19e9b84d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:38.526017 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4645cd3-7643-4f0c-a9c7-dc19e9b84d09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:38.526713 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6dac7-d088-483f-83d5-87152a717dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:38.528465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6dac7-d088-483f-83d5-87152a717dcf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:38.534215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4645cd3-7643-4f0c-a9c7-dc19e9b84d09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:38.535975 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4645cd3-7643-4f0c-a9c7-dc19e9b84d09 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:38.551286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d4645cd3-7643-4f0c-a9c7-dc19e9b84d09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:38.551286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:38.551286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:38.551286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:38.551286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:38.551286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:38.551286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:38.551286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:38.551286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:38.551286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:38.551286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:38.551286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:38.551286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:29:38.551286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:29:38.551286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:38.552185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:38.553026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:29:38.553026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:29:38.553026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:29:38.553026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:29:38.553026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:29:38.553026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:29:38.553026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:38.553026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:38.555582 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 279/532] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:38.556718 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4645cd3-7643-4f0c-a9c7-dc19e9b84d09 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:38.676778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 254/533] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:38.678519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6dac7-d088-483f-83d5-87152a717dcf None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:38.682012 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4645cd3-7643-4f0c-a9c7-dc19e9b84d09 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:38.722807 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d17939-60ad-4c91-bfda-76d4987c7613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:38.724387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d17939-60ad-4c91-bfda-76d4987c7613 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:38.725256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d17939-60ad-4c91-bfda-76d4987c7613 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:38.726040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d17939-60ad-4c91-bfda-76d4987c7613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:38.727850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d17939-60ad-4c91-bfda-76d4987c7613 None admin] RBAC: Adding query filter params (role.id=61d7286cc614424e9d7b8514b201ee21, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=d4a073d8f47a485cbb22db01530f3b37) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:38.728705 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d17939-60ad-4c91-bfda-76d4987c7613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:38.731763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d17939-60ad-4c91-bfda-76d4987c7613 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:38.742936 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 280/534] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:29:38 2022] GET /identity/v3/role_assignments?user.id=d4a073d8f47a485cbb22db01530f3b37&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=61d7286cc614424e9d7b8514b201ee21 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:38.744921 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d17939-60ad-4c91-bfda-76d4987c7613 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:38.856694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6dac7-d088-483f-83d5-87152a717dcf None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:38.912091 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d17939-60ad-4c91-bfda-76d4987c7613 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:38.923892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6e6f6-b297-463f-90b6-5539ec1c4e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:38.925413 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6e6f6-b297-463f-90b6-5539ec1c4e77 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:38.926120 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6e6f6-b297-463f-90b6-5539ec1c4e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:38.926816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6e6f6-b297-463f-90b6-5539ec1c4e77 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:38.928475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6e6f6-b297-463f-90b6-5539ec1c4e77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:38.929189 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6e6f6-b297-463f-90b6-5539ec1c4e77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:38.932037 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6e6f6-b297-463f-90b6-5539ec1c4e77 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:38.952049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83935e-4fa9-467a-b813-1d1f6f5442a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:38.953097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83935e-4fa9-467a-b813-1d1f6f5442a7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:38.954388 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83935e-4fa9-467a-b813-1d1f6f5442a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:38.954388 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83935e-4fa9-467a-b813-1d1f6f5442a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:38.956713 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 255/535] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:38.959106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d434be-02b5-4743-87b8-40cb2a4cc264 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:38.959610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d434be-02b5-4743-87b8-40cb2a4cc264 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:38.960090 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d434be-02b5-4743-87b8-40cb2a4cc264 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:38.966858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 256/536] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:38.966858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d434be-02b5-4743-87b8-40cb2a4cc264 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:38.978418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83935e-4fa9-467a-b813-1d1f6f5442a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:38.981682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83935e-4fa9-467a-b813-1d1f6f5442a7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:39.002126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-2a83935e-4fa9-467a-b813-1d1f6f5442a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:39.002126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:39.002126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:39.002126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:39.002126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:39.002126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:39.002126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:39.002126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:39.002126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:39.002126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:39.002126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:39.002126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:39.002126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:39.002126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:39.002126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:39.003014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:39.004532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:39.004532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:39.004532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:39.004532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:39.004532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 281/537] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:39.005490 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379d110-8dd0-4542-8741-6956af638fb0 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:39.005490 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379d110-8dd0-4542-8741-6956af638fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:39.005490 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379d110-8dd0-4542-8741-6956af638fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:39.023349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e379d110-8dd0-4542-8741-6956af638fb0 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:39.024501 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e379d110-8dd0-4542-8741-6956af638fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:39.106908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 282/538] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:39.109137 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379d110-8dd0-4542-8741-6956af638fb0 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:39.155066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d434be-02b5-4743-87b8-40cb2a4cc264 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:39.212814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a75b4d-f1ec-47bc-94d3-a7a881bf33d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:39.218137 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a75b4d-f1ec-47bc-94d3-a7a881bf33d9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:39.218946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a75b4d-f1ec-47bc-94d3-a7a881bf33d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:39.220970 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a75b4d-f1ec-47bc-94d3-a7a881bf33d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:39.222728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a75b4d-f1ec-47bc-94d3-a7a881bf33d9 None admin] RBAC: Adding query filter params (role.id=61d7286cc614424e9d7b8514b201ee21, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=4f22b09c1ffc4006a4b47ba882c55f80) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:39.223717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a75b4d-f1ec-47bc-94d3-a7a881bf33d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:39.227491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a75b4d-f1ec-47bc-94d3-a7a881bf33d9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:39.241070 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 257/539] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:29:38 2022] GET /identity/v3/role_assignments?user.id=4f22b09c1ffc4006a4b47ba882c55f80&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=61d7286cc614424e9d7b8514b201ee21 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:39.243024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a75b4d-f1ec-47bc-94d3-a7a881bf33d9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:39.246616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379d110-8dd0-4542-8741-6956af638fb0 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:39.345962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06eda6-5016-4073-ade3-7810d98fff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:39.347140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06eda6-5016-4073-ade3-7810d98fff6a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:39.347597 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06eda6-5016-4073-ade3-7810d98fff6a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:39.348048 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06eda6-5016-4073-ade3-7810d98fff6a None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:39.349365 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06eda6-5016-4073-ade3-7810d98fff6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:39.349892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06eda6-5016-4073-ade3-7810d98fff6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:39.352545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06eda6-5016-4073-ade3-7810d98fff6a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:39.365976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a75b4d-f1ec-47bc-94d3-a7a881bf33d9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:39.395123 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 283/540] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:39.402066 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06eda6-5016-4073-ade3-7810d98fff6a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:39.404576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc13fa7-6e2a-4756-b348-9b134d7fde62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:39.405389 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc13fa7-6e2a-4756-b348-9b134d7fde62 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:39.405673 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc13fa7-6e2a-4756-b348-9b134d7fde62 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:39.405950 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc13fa7-6e2a-4756-b348-9b134d7fde62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:39.418010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc13fa7-6e2a-4756-b348-9b134d7fde62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:39.426799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5dc13fa7-6e2a-4756-b348-9b134d7fde62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:39.426799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:39.426799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:39.426799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:39.426799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:39.426799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:39.426799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:39.426799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:39.426799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:39.426799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:39.426799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:39.426799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:39.426799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:39.426799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:39.426799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:39.426799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:39.427754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:39.427754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:39.427754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:39.427754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:39.427754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:39.427754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:39.427754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:39.427754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:39.427754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:39.427754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:39.427754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:39.427754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:39.427754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:39.427754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:39.427754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:39.427754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:39.428552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:39.428552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:39.428552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:39.428552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:39.428552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:39.428552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:39.428552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:39.428552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:39.428552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:39.428552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:39.428552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:39.428552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:39.428552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 258/541] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:39.434551 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc13fa7-6e2a-4756-b348-9b134d7fde62 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:39.543512 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc13fa7-6e2a-4756-b348-9b134d7fde62 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:39.578587 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d077de0-d60b-4f6e-a03b-79b0bf9a657a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:39.585749 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d077de0-d60b-4f6e-a03b-79b0bf9a657a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:39.585749 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d077de0-d60b-4f6e-a03b-79b0bf9a657a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:39.585749 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d077de0-d60b-4f6e-a03b-79b0bf9a657a None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:39.585749 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d077de0-d60b-4f6e-a03b-79b0bf9a657a None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:39.585749 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d077de0-d60b-4f6e-a03b-79b0bf9a657a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:39.585749 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d077de0-d60b-4f6e-a03b-79b0bf9a657a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:39.591379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 259/542] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:29:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:39.601807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d077de0-d60b-4f6e-a03b-79b0bf9a657a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:39.623754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06eda6-5016-4073-ade3-7810d98fff6a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:39.683222 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63283363-e12a-4dc2-a64d-c8520ebf80d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:39.685552 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63283363-e12a-4dc2-a64d-c8520ebf80d1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:39.686802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63283363-e12a-4dc2-a64d-c8520ebf80d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:39.687084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63283363-e12a-4dc2-a64d-c8520ebf80d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:39.698267 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63283363-e12a-4dc2-a64d-c8520ebf80d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:39.699897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63283363-e12a-4dc2-a64d-c8520ebf80d1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:39.732287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-63283363-e12a-4dc2-a64d-c8520ebf80d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:39.732287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:39.732287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:39.732287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:39.732287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:39.732287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:39.732287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:39.732287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:39.732287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:39.732287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:39.732287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:39.732287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:39.732287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:29:39.732287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:29:39.732287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:39.734431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:39.736674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:29:39.736674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:29:39.736674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:29:39.736674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:29:39.736674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:29:39.736674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:29:39.736674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:39.736674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:39.736674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 284/543] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:39.749414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63283363-e12a-4dc2-a64d-c8520ebf80d1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:39.756535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d077de0-d60b-4f6e-a03b-79b0bf9a657a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:39.810253 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cfd9e-57a9-43f9-b044-70cf195683b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:39.811429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cfd9e-57a9-43f9-b044-70cf195683b1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:39.811865 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cfd9e-57a9-43f9-b044-70cf195683b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:39.812299 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cfd9e-57a9-43f9-b044-70cf195683b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:39.843050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cfd9e-57a9-43f9-b044-70cf195683b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:39.854203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cfd9e-57a9-43f9-b044-70cf195683b1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:39.880121 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63283363-e12a-4dc2-a64d-c8520ebf80d1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:39.897085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4f0cfd9e-57a9-43f9-b044-70cf195683b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:39.897085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:39.897085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:39.897085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:39.897085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:39.897085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:39.897085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:39.897085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:39.897085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:39.897085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:39.897085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:39.897085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:39.897085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:39.897085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:39.897085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:39.898301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:39.899191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:39.899191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:39.899191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:39.899191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:39.899191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 260/544] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:29:39.903949 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cfd9e-57a9-43f9-b044-70cf195683b1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:39.919544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21c33b-5eea-403d-9855-057a44a41ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:39.920587 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21c33b-5eea-403d-9855-057a44a41ddb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:39.921076 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21c33b-5eea-403d-9855-057a44a41ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:39.921545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21c33b-5eea-403d-9855-057a44a41ddb None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:39.922758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21c33b-5eea-403d-9855-057a44a41ddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:39.923381 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21c33b-5eea-403d-9855-057a44a41ddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:39.925070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21c33b-5eea-403d-9855-057a44a41ddb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:39.937555 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 285/545] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:29:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:39.943963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21c33b-5eea-403d-9855-057a44a41ddb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:40.054815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21c33b-5eea-403d-9855-057a44a41ddb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:40.089874 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395625f-c4ae-45cc-bd6f-6f9641a75bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:40.090910 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395625f-c4ae-45cc-bd6f-6f9641a75bab None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:40.091381 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395625f-c4ae-45cc-bd6f-6f9641a75bab None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:40.091839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395625f-c4ae-45cc-bd6f-6f9641a75bab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:40.092896 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395625f-c4ae-45cc-bd6f-6f9641a75bab None admin] RBAC: Adding query filter params (role.id=61d7286cc614424e9d7b8514b201ee21, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=96f0feac2b384b509bc9f75b92b4df95) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:40.093399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395625f-c4ae-45cc-bd6f-6f9641a75bab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:40.095161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395625f-c4ae-45cc-bd6f-6f9641a75bab None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:40.101557 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 286/546] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:29:39 2022] GET /identity/v3/role_assignments?user.id=96f0feac2b384b509bc9f75b92b4df95&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=61d7286cc614424e9d7b8514b201ee21 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:40.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cfd9e-57a9-43f9-b044-70cf195683b1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:40.221834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa1f55-e81b-4501-b29f-f7020caa0309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:40.222841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa1f55-e81b-4501-b29f-f7020caa0309 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:40.223270 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa1f55-e81b-4501-b29f-f7020caa0309 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:40.223700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa1f55-e81b-4501-b29f-f7020caa0309 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:40.225008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa1f55-e81b-4501-b29f-f7020caa0309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:40.225358 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa1f55-e81b-4501-b29f-f7020caa0309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:40.227641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa1f55-e81b-4501-b29f-f7020caa0309 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:40.248978 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 261/547] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:40.254702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395625f-c4ae-45cc-bd6f-6f9641a75bab None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:40.428777 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395625f-c4ae-45cc-bd6f-6f9641a75bab None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:40.463801 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1be18-6a6a-44c3-86c5-faf0db23c296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:40.464636 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1be18-6a6a-44c3-86c5-faf0db23c296 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:40.464916 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1be18-6a6a-44c3-86c5-faf0db23c296 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:40.465192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1be18-6a6a-44c3-86c5-faf0db23c296 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:40.473895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1be18-6a6a-44c3-86c5-faf0db23c296 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:40.475352 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1be18-6a6a-44c3-86c5-faf0db23c296 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:40.496857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-45b1be18-6a6a-44c3-86c5-faf0db23c296 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 17:29:40.496857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:40.496857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:40.496857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:40.496857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:40.496857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:40.496857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:40.496857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:40.496857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:40.496857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:40.496857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:40.496857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:40.496857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:29:40.496857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:29:40.496857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:29:40.496857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:40.497765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:40.499276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:40.499276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:40.499276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:29:40.499276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:29:40.499276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:29:40.499276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:29:40.499276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:29:40.499276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:29:40.499276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 17:29:40.499276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:40.499276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 287/548] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:29:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:40.510039 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa1f55-e81b-4501-b29f-f7020caa0309 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:40.664293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa1f55-e81b-4501-b29f-f7020caa0309 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:40.708512 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff5a80-b3df-4dec-9b07-98f3be818f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:40.709166 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff5a80-b3df-4dec-9b07-98f3be818f07 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:40.709449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff5a80-b3df-4dec-9b07-98f3be818f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:40.709721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff5a80-b3df-4dec-9b07-98f3be818f07 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:40.710571 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff5a80-b3df-4dec-9b07-98f3be818f07 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:40.710878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff5a80-b3df-4dec-9b07-98f3be818f07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:40.712293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff5a80-b3df-4dec-9b07-98f3be818f07 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:40.738926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 262/549] 10.222.0.81 () {56 vars in 1135 bytes} [Wed May 4 17:29:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:40.744298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1be18-6a6a-44c3-86c5-faf0db23c296 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:40.875684 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1be18-6a6a-44c3-86c5-faf0db23c296 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:40.915451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef464298-b15e-4a9c-86b0-cea13a3c918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:40.916104 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef464298-b15e-4a9c-86b0-cea13a3c918c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:40.916379 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef464298-b15e-4a9c-86b0-cea13a3c918c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:40.916677 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef464298-b15e-4a9c-86b0-cea13a3c918c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:40.986899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef464298-b15e-4a9c-86b0-cea13a3c918c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:40.988288 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef464298-b15e-4a9c-86b0-cea13a3c918c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:41.090671 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 288/550] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:41.096774 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff5a80-b3df-4dec-9b07-98f3be818f07 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:41.224414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff5a80-b3df-4dec-9b07-98f3be818f07 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:41.271557 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9264b9d-c996-4624-b5f1-2cd4339ace59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:41.272277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9264b9d-c996-4624-b5f1-2cd4339ace59 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:41.272594 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9264b9d-c996-4624-b5f1-2cd4339ace59 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:41.273037 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9264b9d-c996-4624-b5f1-2cd4339ace59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:41.290344 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9264b9d-c996-4624-b5f1-2cd4339ace59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:41.291822 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9264b9d-c996-4624-b5f1-2cd4339ace59 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:41.313933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c9264b9d-c996-4624-b5f1-2cd4339ace59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:41.313933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:41.313933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:41.313933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:41.313933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:41.313933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:41.313933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:41.313933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:41.313933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:41.313933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:41.313933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:41.313933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:41.313933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:41.313933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:41.313933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:41.316086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:41.318248 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:41.318248 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:41.318248 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:41.318248 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:41.318248 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 263/551] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:41.326572 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef464298-b15e-4a9c-86b0-cea13a3c918c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:41.455620 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a91278-81e7-4a07-a6a7-72e338b71b61 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:41.455946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a91278-81e7-4a07-a6a7-72e338b71b61 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:41.456187 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a91278-81e7-4a07-a6a7-72e338b71b61 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:41.457889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 264/552] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:29:41.470554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f79b4-89c9-43ac-b2fe-d29a01c8008d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:41.471748 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f79b4-89c9-43ac-b2fe-d29a01c8008d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:41.472389 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f79b4-89c9-43ac-b2fe-d29a01c8008d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:41.474452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef464298-b15e-4a9c-86b0-cea13a3c918c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:41.504609 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e98f79b4-89c9-43ac-b2fe-d29a01c8008d None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:41.505799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e98f79b4-89c9-43ac-b2fe-d29a01c8008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:41.541467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6ddc0-340e-412a-9432-baea2608aec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:41.542048 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6ddc0-340e-412a-9432-baea2608aec3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:41.542320 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6ddc0-340e-412a-9432-baea2608aec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:41.542590 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6ddc0-340e-412a-9432-baea2608aec3 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:41.543352 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6ddc0-340e-412a-9432-baea2608aec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:41.543650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6ddc0-340e-412a-9432-baea2608aec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:41.545036 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6ddc0-340e-412a-9432-baea2608aec3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:41.566201 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 289/553] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:41.571769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6ddc0-340e-412a-9432-baea2608aec3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:41.658743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 265/554] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:29:41.682058 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f79b4-89c9-43ac-b2fe-d29a01c8008d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:41.758720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6ddc0-340e-412a-9432-baea2608aec3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:41.826973 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3acbd-fd8d-429e-a83f-5ad54093067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:41.829782 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3acbd-fd8d-429e-a83f-5ad54093067f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:41.832243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3acbd-fd8d-429e-a83f-5ad54093067f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:41.832760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3acbd-fd8d-429e-a83f-5ad54093067f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:41.840994 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3acbd-fd8d-429e-a83f-5ad54093067f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:41.843422 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3acbd-fd8d-429e-a83f-5ad54093067f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:41.860569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-4bb3acbd-fd8d-429e-a83f-5ad54093067f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:41.860569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:41.860569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:41.860569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:41.860569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:41.860569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:41.860569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:41.860569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:41.860569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:41.860569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:41.860569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:41.860569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:41.860569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:29:41.860569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:29:41.860569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:41.861723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:41.863332 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:29:41.863332 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:29:41.863332 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:29:41.863332 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:29:41.863332 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:29:41.863332 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:29:41.863332 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:41.863332 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:41.868193 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 290/555] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:41.873823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3acbd-fd8d-429e-a83f-5ad54093067f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:41.888564 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f79b4-89c9-43ac-b2fe-d29a01c8008d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:41.942512 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01748fea-ab0b-4490-8733-969d5663dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:41.943673 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01748fea-ab0b-4490-8733-969d5663dee1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:41.944153 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01748fea-ab0b-4490-8733-969d5663dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:41.944839 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01748fea-ab0b-4490-8733-969d5663dee1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:41.956866 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01748fea-ab0b-4490-8733-969d5663dee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:41.966256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-01748fea-ab0b-4490-8733-969d5663dee1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:41.966256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:41.966256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:41.966256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:41.966256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:41.966256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:41.966256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:41.966256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:41.966256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:41.966256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:41.966256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:41.966256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:41.966256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:41.966256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:41.966256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:41.966256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:41.967142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:41.967142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:41.967142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:41.967142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:41.967142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:41.967142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:41.967142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:41.967142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:41.967142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:41.967142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:41.967142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:41.967142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:41.967142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:41.967142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:41.967142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:41.967142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:41.967900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:41.967900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:41.967900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:41.967900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:41.967900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:41.967900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:41.967900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:41.967900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:41.967900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:41.967900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:41.967900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:41.967900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:41.975795 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 266/556] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:29:41.975795 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e511f6f-9db3-4bc3-a764-73d6aa8079fb None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:41.975795 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e511f6f-9db3-4bc3-a764-73d6aa8079fb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:41.975795 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e511f6f-9db3-4bc3-a764-73d6aa8079fb None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:41.978240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 267/557] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:41.979375 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e511f6f-9db3-4bc3-a764-73d6aa8079fb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:42.051649 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3acbd-fd8d-429e-a83f-5ad54093067f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:42.087083 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edd8f9-1bd0-497a-8943-9cff9e3e8867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:42.087973 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edd8f9-1bd0-497a-8943-9cff9e3e8867 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:42.088399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edd8f9-1bd0-497a-8943-9cff9e3e8867 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:42.088857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edd8f9-1bd0-497a-8943-9cff9e3e8867 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:42.089813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edd8f9-1bd0-497a-8943-9cff9e3e8867 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:42.090267 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edd8f9-1bd0-497a-8943-9cff9e3e8867 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:42.091877 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edd8f9-1bd0-497a-8943-9cff9e3e8867 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:42.093461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e511f6f-9db3-4bc3-a764-73d6aa8079fb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:42.110885 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 291/558] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:29:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:42.112542 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49779e1-0edc-49cd-a2f3-336eefb7bc03 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:42.112978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49779e1-0edc-49cd-a2f3-336eefb7bc03 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:42.113399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49779e1-0edc-49cd-a2f3-336eefb7bc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:42.130624 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f49779e1-0edc-49cd-a2f3-336eefb7bc03 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:42.131444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8558cbb-3f48-439e-b3eb-01e6d4c943d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:42.132260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f49779e1-0edc-49cd-a2f3-336eefb7bc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:42.132739 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8558cbb-3f48-439e-b3eb-01e6d4c943d7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:42.133027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8558cbb-3f48-439e-b3eb-01e6d4c943d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:42.133361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8558cbb-3f48-439e-b3eb-01e6d4c943d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:42.134168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8558cbb-3f48-439e-b3eb-01e6d4c943d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:42.134483 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8558cbb-3f48-439e-b3eb-01e6d4c943d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:42.135892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8558cbb-3f48-439e-b3eb-01e6d4c943d7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:42.149828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 268/559] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:29:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:42.150799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8558cbb-3f48-439e-b3eb-01e6d4c943d7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:42.216462 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 292/560] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:42.217808 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49779e1-0edc-49cd-a2f3-336eefb7bc03 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:42.261076 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8558cbb-3f48-439e-b3eb-01e6d4c943d7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:42.296011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce632ee8-98ac-4686-88ac-b40fb6e99f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:42.297226 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce632ee8-98ac-4686-88ac-b40fb6e99f8f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:42.297657 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce632ee8-98ac-4686-88ac-b40fb6e99f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:42.297960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce632ee8-98ac-4686-88ac-b40fb6e99f8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:42.298931 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce632ee8-98ac-4686-88ac-b40fb6e99f8f None admin] RBAC: Adding query filter params (role.id=61d7286cc614424e9d7b8514b201ee21, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=382e84e110754effa5ffec950f7c1598) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:42.299420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce632ee8-98ac-4686-88ac-b40fb6e99f8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:42.300721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce632ee8-98ac-4686-88ac-b40fb6e99f8f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:42.313318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 269/561] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:29:42 2022] GET /identity/v3/role_assignments?user.id=382e84e110754effa5ffec950f7c1598&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=61d7286cc614424e9d7b8514b201ee21 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:42.313318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae608467-222c-41d0-baa4-352068a4672e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:42.313318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae608467-222c-41d0-baa4-352068a4672e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:42.313318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae608467-222c-41d0-baa4-352068a4672e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:42.313318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 270/562] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:42.313318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae608467-222c-41d0-baa4-352068a4672e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:42.347383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49779e1-0edc-49cd-a2f3-336eefb7bc03 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:42.396196 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bea0d-2e15-4923-aca5-cf67bf526674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:42.397633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bea0d-2e15-4923-aca5-cf67bf526674 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:42.398080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bea0d-2e15-4923-aca5-cf67bf526674 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:42.398526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bea0d-2e15-4923-aca5-cf67bf526674 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:42.416568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bea0d-2e15-4923-aca5-cf67bf526674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:42.418920 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bea0d-2e15-4923-aca5-cf67bf526674 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:42.437520 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae608467-222c-41d0-baa4-352068a4672e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:42.444626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-212bea0d-2e15-4923-aca5-cf67bf526674 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:42.444626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:42.444626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:42.444626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:42.444626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:42.444626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:42.444626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:42.444626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:42.444626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:42.444626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:42.444626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:42.444626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:42.444626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:42.444626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:42.444626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:42.446041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:42.447060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:42.447060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:42.447060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:42.447060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:42.451343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 293/563] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:42.453449 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e67059-d57b-42ae-a626-700d6bad5d16 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:42.453738 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e67059-d57b-42ae-a626-700d6bad5d16 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:42.454017 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e67059-d57b-42ae-a626-700d6bad5d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:42.477982 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-05e67059-d57b-42ae-a626-700d6bad5d16 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:42.479468 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-05e67059-d57b-42ae-a626-700d6bad5d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:42.482560 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9eaf7-ee5c-4227-8bf3-09abbd185553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:42.483698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9eaf7-ee5c-4227-8bf3-09abbd185553 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:42.484164 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9eaf7-ee5c-4227-8bf3-09abbd185553 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:42.485264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9eaf7-ee5c-4227-8bf3-09abbd185553 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:42.497564 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9eaf7-ee5c-4227-8bf3-09abbd185553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:42.506857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-8ec9eaf7-ee5c-4227-8bf3-09abbd185553 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:42.506857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:42.506857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:42.506857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:42.506857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:42.506857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:42.506857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:42.506857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:42.506857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:42.506857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:42.506857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:42.506857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:42.506857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:42.506857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:42.506857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:42.506857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:42.507808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:42.507808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:42.507808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:42.507808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:42.507808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:42.507808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:42.507808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:42.507808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:42.507808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:42.507808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:42.507808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:42.507808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:42.507808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:42.507808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:42.507808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:42.507808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:42.508639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:42.508639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:42.508639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:42.508639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:42.508639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:42.508639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:42.508639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:42.508639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:42.508639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:42.508639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:42.508639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:42.508639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:42.511604 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 271/564] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:42.512780 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9eaf7-ee5c-4227-8bf3-09abbd185553 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:42.577809 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 294/565] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:42.578862 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e67059-d57b-42ae-a626-700d6bad5d16 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:42.694550 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9eaf7-ee5c-4227-8bf3-09abbd185553 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:42.736739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e67059-d57b-42ae-a626-700d6bad5d16 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:42.737635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36a9ba-2bb8-4f89-afff-c6aa6fe851eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:42.738676 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36a9ba-2bb8-4f89-afff-c6aa6fe851eb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:42.739135 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36a9ba-2bb8-4f89-afff-c6aa6fe851eb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:42.740390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36a9ba-2bb8-4f89-afff-c6aa6fe851eb None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:42.741342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36a9ba-2bb8-4f89-afff-c6aa6fe851eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:42.741800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36a9ba-2bb8-4f89-afff-c6aa6fe851eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:42.743331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36a9ba-2bb8-4f89-afff-c6aa6fe851eb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:42.759108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 272/566] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:42.760178 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36a9ba-2bb8-4f89-afff-c6aa6fe851eb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:42.786457 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fe686-7ccb-4ba4-b9c1-909d9970b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:42.787130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fe686-7ccb-4ba4-b9c1-909d9970b377 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:42.787573 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fe686-7ccb-4ba4-b9c1-909d9970b377 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:42.788020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fe686-7ccb-4ba4-b9c1-909d9970b377 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:42.789448 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fe686-7ccb-4ba4-b9c1-909d9970b377 None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:42.789959 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fe686-7ccb-4ba4-b9c1-909d9970b377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:42.791986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fe686-7ccb-4ba4-b9c1-909d9970b377 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:42.804132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 295/567] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:29:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:42.806181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fe686-7ccb-4ba4-b9c1-909d9970b377 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:42.886406 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36a9ba-2bb8-4f89-afff-c6aa6fe851eb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:42.927098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2444390-eefc-48f3-a939-7392b43cea06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:42.928168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2444390-eefc-48f3-a939-7392b43cea06 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:42.928625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2444390-eefc-48f3-a939-7392b43cea06 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:42.929085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2444390-eefc-48f3-a939-7392b43cea06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:42.941218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2444390-eefc-48f3-a939-7392b43cea06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:42.942937 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fe686-7ccb-4ba4-b9c1-909d9970b377 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:42.949660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d2444390-eefc-48f3-a939-7392b43cea06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:42.949660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:42.949660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:42.949660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:42.949660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:42.949660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:42.949660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:42.949660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:42.949660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:42.949660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:42.949660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:42.949660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:42.949660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:42.949660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:42.949660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:42.949660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:42.950820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:42.950820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:42.950820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:42.950820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:42.950820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:42.950820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:42.950820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:42.950820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:42.950820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:42.950820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:42.950820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:42.950820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:42.950820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:42.950820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:42.950820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:42.950820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:42.951628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:42.951628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:42.951628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:42.951628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:42.951628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:42.951628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:42.951628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:42.951628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:42.951628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:42.951628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:42.951628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:42.951628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:42.954395 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 273/568] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:42.955431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2444390-eefc-48f3-a939-7392b43cea06 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:42.991031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c3e23-cb6b-4de7-ab4a-3cd6b853042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:42.992176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c3e23-cb6b-4de7-ab4a-3cd6b853042b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:42.992584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c3e23-cb6b-4de7-ab4a-3cd6b853042b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:42.992932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c3e23-cb6b-4de7-ab4a-3cd6b853042b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:43.003381 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c3e23-cb6b-4de7-ab4a-3cd6b853042b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:43.005601 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c3e23-cb6b-4de7-ab4a-3cd6b853042b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:43.025382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-9f0c3e23-cb6b-4de7-ab4a-3cd6b853042b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 17:29:43.025382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:43.025382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:43.025382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:43.025382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:43.025382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:43.025382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:43.025382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:43.025382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:43.025382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:43.025382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:43.025382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:43.025382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:29:43.025382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:29:43.025382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:29:43.025382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:43.026393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:43.027360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:43.027360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:43.027360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:29:43.027360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:29:43.027360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:29:43.027360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:29:43.027360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:29:43.027360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:29:43.027360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 17:29:43.027360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:43.032214 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 296/569] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:43.033220 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c3e23-cb6b-4de7-ab4a-3cd6b853042b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:43.075416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2444390-eefc-48f3-a939-7392b43cea06 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:43.114341 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a659cf-735a-418e-aeae-4ae4c8a3a82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:43.115139 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a659cf-735a-418e-aeae-4ae4c8a3a82b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:43.115424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a659cf-735a-418e-aeae-4ae4c8a3a82b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:43.115696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a659cf-735a-418e-aeae-4ae4c8a3a82b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:43.127966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a659cf-735a-418e-aeae-4ae4c8a3a82b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:43.129465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a659cf-735a-418e-aeae-4ae4c8a3a82b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:43.147498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e2a659cf-735a-418e-aeae-4ae4c8a3a82b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:43.147498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:43.147498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:43.147498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:43.147498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:43.147498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:43.147498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:43.147498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:43.147498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:43.147498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:43.147498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:43.147498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:43.147498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:43.147498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:43.147498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:43.148917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:43.150629 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:43.150629 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:43.150629 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:43.150629 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:43.150629 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 274/570] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:43.150629 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a659cf-735a-418e-aeae-4ae4c8a3a82b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:43.156821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c3e23-cb6b-4de7-ab4a-3cd6b853042b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:43.190832 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ee4c4-a39b-4842-868e-95b80607f4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:43.191501 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ee4c4-a39b-4842-868e-95b80607f4ad None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:43.191776 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ee4c4-a39b-4842-868e-95b80607f4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:43.192044 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ee4c4-a39b-4842-868e-95b80607f4ad None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:43.192820 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ee4c4-a39b-4842-868e-95b80607f4ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:43.193114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ee4c4-a39b-4842-868e-95b80607f4ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:43.194476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ee4c4-a39b-4842-868e-95b80607f4ad None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:43.209034 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 297/571] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:29:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:43.209034 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44941bda-fcf6-4d7c-9ea0-79e1f58005d0 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:43.209034 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44941bda-fcf6-4d7c-9ea0-79e1f58005d0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:43.209034 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44941bda-fcf6-4d7c-9ea0-79e1f58005d0 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:43.209550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 298/572] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:43.212588 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44941bda-fcf6-4d7c-9ea0-79e1f58005d0 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:43.256518 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a659cf-735a-418e-aeae-4ae4c8a3a82b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:43.291302 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ed64c-c7cc-487a-b89c-ac055e0c00b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:43.291972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ed64c-c7cc-487a-b89c-ac055e0c00b1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:43.292260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ed64c-c7cc-487a-b89c-ac055e0c00b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:43.292674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ed64c-c7cc-487a-b89c-ac055e0c00b1 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:43.293525 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ed64c-c7cc-487a-b89c-ac055e0c00b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:43.293839 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ed64c-c7cc-487a-b89c-ac055e0c00b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:43.295288 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ed64c-c7cc-487a-b89c-ac055e0c00b1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:43.313358 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 275/573] 10.222.0.81 () {56 vars in 1137 bytes} [Wed May 4 17:29:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:43.314206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ed64c-c7cc-487a-b89c-ac055e0c00b1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:43.315999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44941bda-fcf6-4d7c-9ea0-79e1f58005d0 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:43.361060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356a4bf-5b0f-42e0-9b7d-4216debb3ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:43.361726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356a4bf-5b0f-42e0-9b7d-4216debb3ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:43.362004 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356a4bf-5b0f-42e0-9b7d-4216debb3ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:43.362273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356a4bf-5b0f-42e0-9b7d-4216debb3ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:43.362992 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356a4bf-5b0f-42e0-9b7d-4216debb3ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:43.363291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356a4bf-5b0f-42e0-9b7d-4216debb3ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:43.364679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356a4bf-5b0f-42e0-9b7d-4216debb3ca6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:43.381664 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 299/574] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:43.381664 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba4301-8581-458f-9796-c03997e0a8e5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:43.381664 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba4301-8581-458f-9796-c03997e0a8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:43.381664 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba4301-8581-458f-9796-c03997e0a8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:43.395669 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-01ba4301-8581-458f-9796-c03997e0a8e5 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:43.396931 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-01ba4301-8581-458f-9796-c03997e0a8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:43.427761 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ed64c-c7cc-487a-b89c-ac055e0c00b1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:43.463394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3965da-3085-4ce0-a944-dceb834524da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:43.464111 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3965da-3085-4ce0-a944-dceb834524da None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:43.464510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3965da-3085-4ce0-a944-dceb834524da None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:43.464799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3965da-3085-4ce0-a944-dceb834524da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:43.476470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 300/575] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:43.476470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba4301-8581-458f-9796-c03997e0a8e5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:43.486898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3965da-3085-4ce0-a944-dceb834524da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:43.488407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3965da-3085-4ce0-a944-dceb834524da None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:43.508112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-aa3965da-3085-4ce0-a944-dceb834524da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:43.508112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:43.508112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:43.508112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:43.508112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:43.508112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:43.508112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:43.508112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:43.508112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:43.508112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:43.508112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:43.508112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:43.508112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:43.508112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:43.508112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:43.509273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:43.510128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:43.510128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:43.510128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:43.510128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:43.510128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 276/576] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:43.510128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3965da-3085-4ce0-a944-dceb834524da None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:43.574028 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba4301-8581-458f-9796-c03997e0a8e5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:43.611716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3965da-3085-4ce0-a944-dceb834524da None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:43.616348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e9891-7a16-4651-ae84-c7092ceb18f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:43.617162 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e9891-7a16-4651-ae84-c7092ceb18f8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:43.617434 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e9891-7a16-4651-ae84-c7092ceb18f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:43.617704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e9891-7a16-4651-ae84-c7092ceb18f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:43.629535 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e9891-7a16-4651-ae84-c7092ceb18f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:43.630993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e9891-7a16-4651-ae84-c7092ceb18f8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:43.647768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05278ec8-c0f1-4bbf-bd25-5cb36aacf2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:43.648580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05278ec8-c0f1-4bbf-bd25-5cb36aacf2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:43.648881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05278ec8-c0f1-4bbf-bd25-5cb36aacf2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:43.649167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05278ec8-c0f1-4bbf-bd25-5cb36aacf2b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:43.651358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f16e9891-7a16-4651-ae84-c7092ceb18f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:43.651358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:43.651358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:43.651358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:43.651358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:43.651358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:43.651358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:43.651358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:43.651358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:43.651358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:43.651358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:43.651358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:43.651358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:43.651358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:43.651358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:43.653472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:43.657213 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:43.657213 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:43.657213 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:43.657213 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:43.657213 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 301/577] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:43.658203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e9891-7a16-4651-ae84-c7092ceb18f8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:43.665237 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05278ec8-c0f1-4bbf-bd25-5cb36aacf2b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:43.666800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05278ec8-c0f1-4bbf-bd25-5cb36aacf2b2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:43.681693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-05278ec8-c0f1-4bbf-bd25-5cb36aacf2b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:29:43.681693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:43.681693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:43.681693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:43.681693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:43.681693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:43.681693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:43.681693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:43.681693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:43.681693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:43.681693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:43.681693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:43.681693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:29:43.681693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:29:43.681693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:29:43.681693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:43.682843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:43.684020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:43.684020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:43.684020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:29:43.684020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:29:43.684020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:29:43.684020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:29:43.684020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:29:43.684020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:29:43.684020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:29:43.684020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:43.684786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 277/578] 10.222.0.81 () {56 vars in 1093 bytes} [Wed May 4 17:29:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:43.685502 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05278ec8-c0f1-4bbf-bd25-5cb36aacf2b2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:43.777390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e9891-7a16-4651-ae84-c7092ceb18f8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:43.819655 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624935d-7b69-474c-98e2-3276ef96dc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:43.820484 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624935d-7b69-474c-98e2-3276ef96dc25 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:43.820762 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624935d-7b69-474c-98e2-3276ef96dc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:43.821031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624935d-7b69-474c-98e2-3276ef96dc25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:43.832510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624935d-7b69-474c-98e2-3276ef96dc25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:43.840412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7624935d-7b69-474c-98e2-3276ef96dc25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:43.840412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:43.840412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:43.840412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:43.840412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:43.840412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:43.840412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:43.840412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:43.840412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:43.840412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:43.840412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:43.840412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:43.840412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:43.840412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:43.840412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:43.840412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:43.841421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:43.841421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:43.841421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:43.841421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:43.841421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:43.841421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:43.841421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:43.841421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:43.841421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:43.841421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:43.841421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:43.841421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:43.841421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:43.841421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:43.841421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:43.841421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:43.842241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:43.842241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:43.842241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:43.842241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:43.842241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:43.842241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:43.842241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:43.842241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:43.842241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:43.842241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:43.842241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:43.842241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:43.842241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 302/579] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:43.842995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624935d-7b69-474c-98e2-3276ef96dc25 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:43.958744 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05278ec8-c0f1-4bbf-bd25-5cb36aacf2b2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:43.964955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624935d-7b69-474c-98e2-3276ef96dc25 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:44.013242 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b820f-a51f-4074-87b7-248dfd6a157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:44.014384 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b820f-a51f-4074-87b7-248dfd6a157d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:44.014849 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b820f-a51f-4074-87b7-248dfd6a157d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:44.015162 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fea84-fe6e-443f-9d28-2646ad167508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:44.015633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b820f-a51f-4074-87b7-248dfd6a157d None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:44.016287 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fea84-fe6e-443f-9d28-2646ad167508 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:44.016771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fea84-fe6e-443f-9d28-2646ad167508 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:44.017147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b820f-a51f-4074-87b7-248dfd6a157d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:44.017305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fea84-fe6e-443f-9d28-2646ad167508 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:44.017643 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b820f-a51f-4074-87b7-248dfd6a157d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:44.018455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fea84-fe6e-443f-9d28-2646ad167508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:44.018972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fea84-fe6e-443f-9d28-2646ad167508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:44.020010 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b820f-a51f-4074-87b7-248dfd6a157d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:44.021330 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fea84-fe6e-443f-9d28-2646ad167508 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:44.043100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 303/580] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:44.043100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b820f-a51f-4074-87b7-248dfd6a157d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:44.043392 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 278/581] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:44.044386 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fea84-fe6e-443f-9d28-2646ad167508 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:44.190075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b820f-a51f-4074-87b7-248dfd6a157d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:44.194037 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fea84-fe6e-443f-9d28-2646ad167508 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:44.235718 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c427fc-b441-4342-8230-40e030660626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:44.236392 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c427fc-b441-4342-8230-40e030660626 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:44.236696 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c427fc-b441-4342-8230-40e030660626 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:44.236975 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c427fc-b441-4342-8230-40e030660626 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:44.237822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c427fc-b441-4342-8230-40e030660626 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:44.238194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c427fc-b441-4342-8230-40e030660626 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:44.239561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c427fc-b441-4342-8230-40e030660626 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:44.240525 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c728e0c-90dd-4dee-80cb-1b8d7d74b27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:44.241427 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c728e0c-90dd-4dee-80cb-1b8d7d74b27d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:44.241848 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c728e0c-90dd-4dee-80cb-1b8d7d74b27d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:44.242316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c728e0c-90dd-4dee-80cb-1b8d7d74b27d None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:44.243526 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c728e0c-90dd-4dee-80cb-1b8d7d74b27d None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:44.243886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c728e0c-90dd-4dee-80cb-1b8d7d74b27d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:44.245423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c728e0c-90dd-4dee-80cb-1b8d7d74b27d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:44.255885 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 279/582] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:29:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:44.257417 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c728e0c-90dd-4dee-80cb-1b8d7d74b27d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:44.272031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 304/583] 10.222.0.81 () {56 vars in 1133 bytes} [Wed May 4 17:29:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:44.272031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c427fc-b441-4342-8230-40e030660626 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:44.423319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c728e0c-90dd-4dee-80cb-1b8d7d74b27d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:44.434717 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c427fc-b441-4342-8230-40e030660626 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:44.468780 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed5be4-b606-4372-9d85-740cf69f7b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:44.470295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed5be4-b606-4372-9d85-740cf69f7b03 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:44.470774 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed5be4-b606-4372-9d85-740cf69f7b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:44.471239 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed5be4-b606-4372-9d85-740cf69f7b03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:44.479581 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179213c-41fa-445b-9543-f3bbb03d46ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:44.480841 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179213c-41fa-445b-9543-f3bbb03d46ac None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:44.481243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179213c-41fa-445b-9543-f3bbb03d46ac None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:44.481694 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179213c-41fa-445b-9543-f3bbb03d46ac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:44.482330 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed5be4-b606-4372-9d85-740cf69f7b03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:44.485879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed5be4-b606-4372-9d85-740cf69f7b03 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:44.494319 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179213c-41fa-445b-9543-f3bbb03d46ac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:44.496848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179213c-41fa-445b-9543-f3bbb03d46ac None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:44.509762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-00ed5be4-b606-4372-9d85-740cf69f7b03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:44.509762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:44.509762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:44.509762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:44.509762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:44.509762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:44.509762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:44.509762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:44.509762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:44.509762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:44.509762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:44.509762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:44.509762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:29:44.509762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:29:44.509762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:44.510760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:44.511787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:29:44.511787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:29:44.511787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:29:44.511787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:29:44.511787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:29:44.511787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:29:44.511787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:44.511787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:44.517579 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 280/584] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:44.517579 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed5be4-b606-4372-9d85-740cf69f7b03 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:44.521387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7179213c-41fa-445b-9543-f3bbb03d46ac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 17:29:44.521387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:44.521387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:44.521387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:44.521387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:44.521387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:44.521387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:44.521387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:44.521387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:44.521387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:44.521387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:44.521387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:44.521387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:29:44.521387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:29:44.521387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:29:44.521387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:44.522404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:44.523328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:44.523328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:44.523328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:29:44.523328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:29:44.523328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:29:44.523328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:29:44.523328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:29:44.523328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:29:44.523328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 17:29:44.523328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:44.528791 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 305/585] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:44.529922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179213c-41fa-445b-9543-f3bbb03d46ac None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:44.667944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed5be4-b606-4372-9d85-740cf69f7b03 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:44.676928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179213c-41fa-445b-9543-f3bbb03d46ac None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:44.714764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e09b6-3734-46ca-9b78-6851790c1638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:44.715555 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e09b6-3734-46ca-9b78-6851790c1638 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:44.715843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e09b6-3734-46ca-9b78-6851790c1638 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:44.716129 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e09b6-3734-46ca-9b78-6851790c1638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:44.721529 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193e409-4d50-4538-9a65-c8bef958f5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:44.722312 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193e409-4d50-4538-9a65-c8bef958f5cc None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:44.722589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193e409-4d50-4538-9a65-c8bef958f5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:44.722862 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193e409-4d50-4538-9a65-c8bef958f5cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:44.726741 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e09b6-3734-46ca-9b78-6851790c1638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:44.728187 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e09b6-3734-46ca-9b78-6851790c1638 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:44.733075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193e409-4d50-4538-9a65-c8bef958f5cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:44.734691 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193e409-4d50-4538-9a65-c8bef958f5cc None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:44.746147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-790e09b6-3734-46ca-9b78-6851790c1638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:44.746147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:44.746147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:44.746147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:44.746147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:44.746147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:44.746147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:44.746147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:44.746147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:44.746147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:44.746147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:44.746147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:44.746147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:44.746147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:44.746147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:44.747854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:44.750146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:44.750146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:44.750146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:44.750146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:44.750146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 281/586] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:44.750146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e09b6-3734-46ca-9b78-6851790c1638 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:44.752687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-1193e409-4d50-4538-9a65-c8bef958f5cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:44.752687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:44.752687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:44.752687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:44.752687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:44.752687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:44.752687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:44.752687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:44.752687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:44.752687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:44.752687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:44.752687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:44.752687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:44.752687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:44.752687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:44.755735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:44.757610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:44.757610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:44.757610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:44.757610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:44.757610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 306/587] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:44.757610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193e409-4d50-4538-9a65-c8bef958f5cc None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:44.868652 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193e409-4d50-4538-9a65-c8bef958f5cc None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:44.869341 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e09b6-3734-46ca-9b78-6851790c1638 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:44.919517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec9167-14d3-4a30-aeac-ebc2e804db46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:44.919806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f94f4b-1df6-4c5d-949d-254d8397e279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:44.920227 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec9167-14d3-4a30-aeac-ebc2e804db46 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:44.920419 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f94f4b-1df6-4c5d-949d-254d8397e279 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:44.920659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec9167-14d3-4a30-aeac-ebc2e804db46 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:44.920956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f94f4b-1df6-4c5d-949d-254d8397e279 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:44.921120 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec9167-14d3-4a30-aeac-ebc2e804db46 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:44.921482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f94f4b-1df6-4c5d-949d-254d8397e279 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:44.922229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec9167-14d3-4a30-aeac-ebc2e804db46 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:44.922623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec9167-14d3-4a30-aeac-ebc2e804db46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:44.922783 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f94f4b-1df6-4c5d-949d-254d8397e279 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:44.923138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f94f4b-1df6-4c5d-949d-254d8397e279 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:44.924256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec9167-14d3-4a30-aeac-ebc2e804db46 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:44.924888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f94f4b-1df6-4c5d-949d-254d8397e279 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:44.938819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 282/588] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:44.940684 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf4413-d9ff-4cbc-9a40-20b60196574b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:44.941110 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf4413-d9ff-4cbc-9a40-20b60196574b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:44.941590 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf4413-d9ff-4cbc-9a40-20b60196574b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:44.944078 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 307/589] 10.222.0.81 () {56 vars in 1137 bytes} [Wed May 4 17:29:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:44.944760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 283/590] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:44.944970 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec9167-14d3-4a30-aeac-ebc2e804db46 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:44.946121 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf4413-d9ff-4cbc-9a40-20b60196574b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:45.059134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec9167-14d3-4a30-aeac-ebc2e804db46 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:45.079965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf4413-d9ff-4cbc-9a40-20b60196574b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:45.109920 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a4b18-3231-449d-9fe8-ccbd5fcd9660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:45.110842 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a4b18-3231-449d-9fe8-ccbd5fcd9660 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:45.111259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a4b18-3231-449d-9fe8-ccbd5fcd9660 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:45.111709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a4b18-3231-449d-9fe8-ccbd5fcd9660 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:45.112971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a4b18-3231-449d-9fe8-ccbd5fcd9660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:45.113478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a4b18-3231-449d-9fe8-ccbd5fcd9660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:45.115787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a4b18-3231-449d-9fe8-ccbd5fcd9660 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:45.130065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe924ee7-61e5-45cd-8a39-4e5ac2a4d08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:45.131100 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe924ee7-61e5-45cd-8a39-4e5ac2a4d08a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:45.131536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe924ee7-61e5-45cd-8a39-4e5ac2a4d08a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:45.131973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe924ee7-61e5-45cd-8a39-4e5ac2a4d08a None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:45.133209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe924ee7-61e5-45cd-8a39-4e5ac2a4d08a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:45.133714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe924ee7-61e5-45cd-8a39-4e5ac2a4d08a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:45.133998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 308/591] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:45.135243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a4b18-3231-449d-9fe8-ccbd5fcd9660 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:45.136166 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe924ee7-61e5-45cd-8a39-4e5ac2a4d08a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:45.151235 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 284/592] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:45.152768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01daee2-6d2d-48c2-9547-116637f8fbb5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:45.153081 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01daee2-6d2d-48c2-9547-116637f8fbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:45.153342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01daee2-6d2d-48c2-9547-116637f8fbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:45.170142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b01daee2-6d2d-48c2-9547-116637f8fbb5 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:45.171271 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b01daee2-6d2d-48c2-9547-116637f8fbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:45.240286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 285/593] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:45.241709 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01daee2-6d2d-48c2-9547-116637f8fbb5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:45.242029 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a4b18-3231-449d-9fe8-ccbd5fcd9660 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:45.277445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac88056-c15e-434b-a5c6-2745ef3ad4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:45.278445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac88056-c15e-434b-a5c6-2745ef3ad4c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:45.278733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac88056-c15e-434b-a5c6-2745ef3ad4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:45.279011 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac88056-c15e-434b-a5c6-2745ef3ad4c3 None admin] PATH_INFO: `/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/ec8e2eb70a5d4dd1b3a9bec2bd0a78a9/roles/61d7286cc614424e9d7b8514b201ee21` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:45.295722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac88056-c15e-434b-a5c6-2745ef3ad4c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=544a56c4b97e43aea9fbb003d80af8dc, user_id=ec8e2eb70a5d4dd1b3a9bec2bd0a78a9, role_id=61d7286cc614424e9d7b8514b201ee21)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:45.298143 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac88056-c15e-434b-a5c6-2745ef3ad4c3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:45.357178 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01daee2-6d2d-48c2-9547-116637f8fbb5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:45.365515 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 309/594] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:29:45 2022] PUT /identity/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/ec8e2eb70a5d4dd1b3a9bec2bd0a78a9/roles/61d7286cc614424e9d7b8514b201ee21 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:29:45.366571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac88056-c15e-434b-a5c6-2745ef3ad4c3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:45.399402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d94e8b-c991-46a4-a3f4-c0359cd08646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:45.400697 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d94e8b-c991-46a4-a3f4-c0359cd08646 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:45.400883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d94e8b-c991-46a4-a3f4-c0359cd08646 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:45.401117 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d94e8b-c991-46a4-a3f4-c0359cd08646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:45.413556 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d94e8b-c991-46a4-a3f4-c0359cd08646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:45.415040 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d94e8b-c991-46a4-a3f4-c0359cd08646 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:45.434809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-49d94e8b-c991-46a4-a3f4-c0359cd08646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:45.434809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:45.434809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:45.434809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:45.434809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:45.434809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:45.434809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:45.434809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:45.434809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:45.434809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:45.434809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:45.434809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:45.434809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:45.434809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:45.434809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:45.435871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:45.438401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:45.438401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:45.438401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:45.438401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:45.441801 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 286/595] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:45.442488 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d94e8b-c991-46a4-a3f4-c0359cd08646 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:45.521269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac88056-c15e-434b-a5c6-2745ef3ad4c3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:45.549876 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d94e8b-c991-46a4-a3f4-c0359cd08646 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:45.577208 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec127228-2b79-48c5-96e3-0adf044f83d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:45.581516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127228-2b79-48c5-96e3-0adf044f83d8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:45.581516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127228-2b79-48c5-96e3-0adf044f83d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:45.581516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127228-2b79-48c5-96e3-0adf044f83d8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:45.586208 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ca1b4-0ffe-4857-b04e-755fb4ac6eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:45.587019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ca1b4-0ffe-4857-b04e-755fb4ac6eac None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:45.587302 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ca1b4-0ffe-4857-b04e-755fb4ac6eac None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:45.587575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ca1b4-0ffe-4857-b04e-755fb4ac6eac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:45.592038 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec127228-2b79-48c5-96e3-0adf044f83d8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:45.595194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec127228-2b79-48c5-96e3-0adf044f83d8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:45.595596 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ca1b4-0ffe-4857-b04e-755fb4ac6eac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:45.597099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ca1b4-0ffe-4857-b04e-755fb4ac6eac None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:45.613009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0e1ca1b4-0ffe-4857-b04e-755fb4ac6eac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:45.613009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:45.613009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:45.613009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:45.613009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:45.613009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:45.613009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:45.613009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:45.613009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:45.613009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:45.613009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:45.613009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:45.613009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:29:45.613009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:29:45.613009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:45.613974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:45.615291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:29:45.615291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:29:45.615291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:29:45.615291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:29:45.615291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:29:45.615291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:29:45.615291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:45.615291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:45.615291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 287/596] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:45.616322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ca1b4-0ffe-4857-b04e-755fb4ac6eac None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:45.624756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ec127228-2b79-48c5-96e3-0adf044f83d8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 17:29:45.624756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:45.624756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:45.624756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:45.624756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:45.624756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:45.624756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:45.624756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:45.624756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:45.624756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:45.624756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:45.624756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:45.624756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:29:45.624756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:29:45.624756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:29:45.624756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:45.626133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:45.628155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:45.628155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:45.628155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:29:45.628155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:29:45.628155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:29:45.628155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:29:45.628155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:29:45.628155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:29:45.628155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 17:29:45.628155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:45.628155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 310/597] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:45.628774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec127228-2b79-48c5-96e3-0adf044f83d8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:45.759095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec127228-2b79-48c5-96e3-0adf044f83d8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:45.772467 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ca1b4-0ffe-4857-b04e-755fb4ac6eac None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:45.793843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131c165-2db1-4c2b-9042-e10e55620775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:45.794586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131c165-2db1-4c2b-9042-e10e55620775 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:45.794865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131c165-2db1-4c2b-9042-e10e55620775 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:45.795134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131c165-2db1-4c2b-9042-e10e55620775 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:45.795860 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131c165-2db1-4c2b-9042-e10e55620775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:45.796164 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131c165-2db1-4c2b-9042-e10e55620775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:45.797833 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131c165-2db1-4c2b-9042-e10e55620775 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:45.809995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 311/598] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:45.810610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131c165-2db1-4c2b-9042-e10e55620775 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:45.822879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47b37b-6ad7-480b-bd61-d0e74b4fb734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:45.823859 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47b37b-6ad7-480b-bd61-d0e74b4fb734 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:45.824151 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47b37b-6ad7-480b-bd61-d0e74b4fb734 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:45.824472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47b37b-6ad7-480b-bd61-d0e74b4fb734 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:45.836918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47b37b-6ad7-480b-bd61-d0e74b4fb734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:45.845379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4b47b37b-6ad7-480b-bd61-d0e74b4fb734 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:45.845379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:45.845379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:45.845379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:45.845379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:45.845379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:45.845379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:45.845379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:45.845379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:45.845379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:45.845379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:45.845379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:45.845379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:45.845379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:45.845379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:45.845379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:45.846540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:45.846540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:45.846540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:45.846540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:45.846540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:45.846540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:45.846540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:45.846540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:45.846540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:45.846540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:45.846540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:45.846540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:45.846540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:45.846540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:45.846540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:45.846540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:45.847371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:45.847371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:45.847371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:45.847371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:45.847371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:45.847371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:45.847371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:45.847371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:45.847371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:45.847371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:45.847371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:45.847371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:45.847371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 288/599] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:45.848069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47b37b-6ad7-480b-bd61-d0e74b4fb734 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:45.927045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131c165-2db1-4c2b-9042-e10e55620775 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:45.961710 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcfdd1-ec30-413b-aa93-9a234cecfb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:45.962438 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcfdd1-ec30-413b-aa93-9a234cecfb36 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:45.962697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcfdd1-ec30-413b-aa93-9a234cecfb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:45.962910 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcfdd1-ec30-413b-aa93-9a234cecfb36 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:45.963705 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcfdd1-ec30-413b-aa93-9a234cecfb36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:45.964012 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcfdd1-ec30-413b-aa93-9a234cecfb36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:45.965273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47b37b-6ad7-480b-bd61-d0e74b4fb734 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:45.965534 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcfdd1-ec30-413b-aa93-9a234cecfb36 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:45.982344 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 312/600] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:29:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:45.983273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcfdd1-ec30-413b-aa93-9a234cecfb36 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:46.019746 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f6805-b686-4a26-be0b-f9ca1142caf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:46.020497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f6805-b686-4a26-be0b-f9ca1142caf7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:46.020783 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f6805-b686-4a26-be0b-f9ca1142caf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:46.021132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f6805-b686-4a26-be0b-f9ca1142caf7 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:46.021997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f6805-b686-4a26-be0b-f9ca1142caf7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:46.022727 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f6805-b686-4a26-be0b-f9ca1142caf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:46.024204 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f6805-b686-4a26-be0b-f9ca1142caf7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:46.051728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 289/601] 10.222.0.81 () {56 vars in 1139 bytes} [Wed May 4 17:29:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:46.052974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f6805-b686-4a26-be0b-f9ca1142caf7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:46.133464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcfdd1-ec30-413b-aa93-9a234cecfb36 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:46.159945 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f6805-b686-4a26-be0b-f9ca1142caf7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:46.177010 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae4ec0-f4d0-4a70-8d1c-0967581c5426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:46.178246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae4ec0-f4d0-4a70-8d1c-0967581c5426 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:46.178661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae4ec0-f4d0-4a70-8d1c-0967581c5426 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:46.179065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae4ec0-f4d0-4a70-8d1c-0967581c5426 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:46.187757 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae4ec0-f4d0-4a70-8d1c-0967581c5426 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:46.189617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae4ec0-f4d0-4a70-8d1c-0967581c5426 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:46.202228 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed38474-b0c6-4904-92d9-6db623d648a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:46.203238 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed38474-b0c6-4904-92d9-6db623d648a7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:46.203698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed38474-b0c6-4904-92d9-6db623d648a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:46.204116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed38474-b0c6-4904-92d9-6db623d648a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:46.205331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed38474-b0c6-4904-92d9-6db623d648a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:46.205559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-c9ae4ec0-f4d0-4a70-8d1c-0967581c5426 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:46.205559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:46.205559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:46.205559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:46.205559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:46.205559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:46.205559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:46.205559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:46.205559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:46.205559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:46.205559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:46.205559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:46.205559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:29:46.205559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:29:46.205559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:46.206374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:46.207230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:29:46.207230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:29:46.207230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:29:46.207230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:29:46.207230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:29:46.207230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:29:46.207230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:46.207230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:46.207735 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed38474-b0c6-4904-92d9-6db623d648a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:46.208015 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed38474-b0c6-4904-92d9-6db623d648a7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:46.209528 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 313/602] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:46.210464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae4ec0-f4d0-4a70-8d1c-0967581c5426 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:46.225776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 290/603] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:29:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:46.227398 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed38474-b0c6-4904-92d9-6db623d648a7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:46.345369 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae4ec0-f4d0-4a70-8d1c-0967581c5426 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:46.382584 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed38474-b0c6-4904-92d9-6db623d648a7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:46.395487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832a23c-507b-41fe-adae-4bf4df090cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:46.396386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832a23c-507b-41fe-adae-4bf4df090cb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:46.396697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832a23c-507b-41fe-adae-4bf4df090cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:46.396986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832a23c-507b-41fe-adae-4bf4df090cb8 None admin] PATH_INFO: `/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/d4a073d8f47a485cbb22db01530f3b37/roles/61d7286cc614424e9d7b8514b201ee21` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:46.415260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832a23c-507b-41fe-adae-4bf4df090cb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=544a56c4b97e43aea9fbb003d80af8dc, user_id=d4a073d8f47a485cbb22db01530f3b37, role_id=61d7286cc614424e9d7b8514b201ee21)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:46.416770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832a23c-507b-41fe-adae-4bf4df090cb8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:46.424526 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ff156-8bc5-4003-9509-1fb9486b7d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:46.425404 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff156-8bc5-4003-9509-1fb9486b7d58 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:46.425692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff156-8bc5-4003-9509-1fb9486b7d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:46.425964 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff156-8bc5-4003-9509-1fb9486b7d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:46.437587 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ff156-8bc5-4003-9509-1fb9486b7d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:46.439051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ff156-8bc5-4003-9509-1fb9486b7d58 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:46.456788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a01ff156-8bc5-4003-9509-1fb9486b7d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:46.456788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:46.456788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:46.456788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:46.456788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:46.456788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:46.456788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:46.456788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:46.456788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:46.456788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:46.456788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:46.456788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:46.456788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:46.456788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:46.456788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:46.458485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:46.460404 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:46.460404 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:46.460404 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:46.460404 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:46.460404 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 291/604] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:46.460404 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ff156-8bc5-4003-9509-1fb9486b7d58 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:46.501769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 314/605] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:29:46 2022] PUT /identity/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/d4a073d8f47a485cbb22db01530f3b37/roles/61d7286cc614424e9d7b8514b201ee21 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:29:46.514052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832a23c-507b-41fe-adae-4bf4df090cb8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:46.613043 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ff156-8bc5-4003-9509-1fb9486b7d58 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:46.653021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832a23c-507b-41fe-adae-4bf4df090cb8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:46.671519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9d64e-b885-45b6-8160-3bc16eba4622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:46.672404 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9d64e-b885-45b6-8160-3bc16eba4622 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:46.672928 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9d64e-b885-45b6-8160-3bc16eba4622 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:46.673396 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9d64e-b885-45b6-8160-3bc16eba4622 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:46.674870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9d64e-b885-45b6-8160-3bc16eba4622 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:46.675383 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9d64e-b885-45b6-8160-3bc16eba4622 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:46.678000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9d64e-b885-45b6-8160-3bc16eba4622 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:46.696052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844be9e0-e691-4918-b9d4-0d82e31fb1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:46.697164 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844be9e0-e691-4918-b9d4-0d82e31fb1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:46.697620 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844be9e0-e691-4918-b9d4-0d82e31fb1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:46.698057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844be9e0-e691-4918-b9d4-0d82e31fb1b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:46.700128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 292/606] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:29:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:46.701603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9d64e-b885-45b6-8160-3bc16eba4622 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:46.710468 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844be9e0-e691-4918-b9d4-0d82e31fb1b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:46.712264 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844be9e0-e691-4918-b9d4-0d82e31fb1b0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:46.732821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-844be9e0-e691-4918-b9d4-0d82e31fb1b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:46.732821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:46.732821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:46.732821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:46.732821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:46.732821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:46.732821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:46.732821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:46.732821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:46.732821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:46.732821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:46.732821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:46.732821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:46.732821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:46.732821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:46.734604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:46.735703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:46.735703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:46.735703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:46.735703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:46.737685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 315/607] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:46.738707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844be9e0-e691-4918-b9d4-0d82e31fb1b0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:46.863157 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9d64e-b885-45b6-8160-3bc16eba4622 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:46.865092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844be9e0-e691-4918-b9d4-0d82e31fb1b0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:46.917182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2db7b-0de6-4b15-8ebf-6cf8dda5ce8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:46.918252 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2db7b-0de6-4b15-8ebf-6cf8dda5ce8b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:46.918732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2db7b-0de6-4b15-8ebf-6cf8dda5ce8b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:46.919218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2db7b-0de6-4b15-8ebf-6cf8dda5ce8b None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:46.920503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2db7b-0de6-4b15-8ebf-6cf8dda5ce8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:46.921036 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2db7b-0de6-4b15-8ebf-6cf8dda5ce8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:46.924016 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2db7b-0de6-4b15-8ebf-6cf8dda5ce8b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:46.931136 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd8009-ac4e-4215-8952-4fb9f641441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:46.933394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd8009-ac4e-4215-8952-4fb9f641441f None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:46.933394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd8009-ac4e-4215-8952-4fb9f641441f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:46.934144 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd8009-ac4e-4215-8952-4fb9f641441f None admin] PATH_INFO: `/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/4f22b09c1ffc4006a4b47ba882c55f80/roles/61d7286cc614424e9d7b8514b201ee21` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:46.948318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 293/608] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:46.954203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2db7b-0de6-4b15-8ebf-6cf8dda5ce8b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:46.966806 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd8009-ac4e-4215-8952-4fb9f641441f None admin] RBAC: Authorizing `identity:create_grant(project_id=544a56c4b97e43aea9fbb003d80af8dc, user_id=4f22b09c1ffc4006a4b47ba882c55f80, role_id=61d7286cc614424e9d7b8514b201ee21)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:46.970032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd8009-ac4e-4215-8952-4fb9f641441f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:47.068323 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2db7b-0de6-4b15-8ebf-6cf8dda5ce8b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:47.106571 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd98ac-11ee-475a-9dea-648f8f231d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:47.110965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd98ac-11ee-475a-9dea-648f8f231d80 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:47.110965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd98ac-11ee-475a-9dea-648f8f231d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:47.110965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd98ac-11ee-475a-9dea-648f8f231d80 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:47.110965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd98ac-11ee-475a-9dea-648f8f231d80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:47.110965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd98ac-11ee-475a-9dea-648f8f231d80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:47.110965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd98ac-11ee-475a-9dea-648f8f231d80 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:47.112145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 316/609] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:29:46 2022] PUT /identity/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/4f22b09c1ffc4006a4b47ba882c55f80/roles/61d7286cc614424e9d7b8514b201ee21 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:29:47.118182 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd8009-ac4e-4215-8952-4fb9f641441f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:47.130096 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 294/610] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:47.131278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd98ac-11ee-475a-9dea-648f8f231d80 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:47.244474 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd98ac-11ee-475a-9dea-648f8f231d80 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:47.275159 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08824e-6826-496a-89f5-d6cc8c040450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:47.275965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08824e-6826-496a-89f5-d6cc8c040450 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:47.276276 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08824e-6826-496a-89f5-d6cc8c040450 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:47.276695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08824e-6826-496a-89f5-d6cc8c040450 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:47.287136 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08824e-6826-496a-89f5-d6cc8c040450 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:47.288844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08824e-6826-496a-89f5-d6cc8c040450 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:47.307010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5a08824e-6826-496a-89f5-d6cc8c040450 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 17:29:47.307010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:47.307010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:47.307010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:47.307010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:47.307010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:47.307010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:47.307010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:47.307010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:47.307010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:47.307010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:47.307010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:47.307010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:29:47.307010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:29:47.307010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:29:47.307010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:47.308880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:47.310690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:47.310690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:47.310690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:29:47.310690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:29:47.310690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:29:47.310690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:29:47.310690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:29:47.310690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:29:47.310690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 17:29:47.310690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:47.312507 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 295/611] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:29:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:47.314702 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08824e-6826-496a-89f5-d6cc8c040450 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:47.408734 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd8009-ac4e-4215-8952-4fb9f641441f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:47.429353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08824e-6826-496a-89f5-d6cc8c040450 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:47.465908 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfb3a7-c17a-4755-aa2d-065fcf9c3243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:47.466602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfb3a7-c17a-4755-aa2d-065fcf9c3243 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:47.466891 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfb3a7-c17a-4755-aa2d-065fcf9c3243 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:47.467169 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfb3a7-c17a-4755-aa2d-065fcf9c3243 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:47.468092 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfb3a7-c17a-4755-aa2d-065fcf9c3243 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:47.468406 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfb3a7-c17a-4755-aa2d-065fcf9c3243 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:47.470336 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfb3a7-c17a-4755-aa2d-065fcf9c3243 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:47.485262 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0f111-085f-40b1-b79c-e9b5ccb442d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:47.486082 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0f111-085f-40b1-b79c-e9b5ccb442d1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:47.486387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0f111-085f-40b1-b79c-e9b5ccb442d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:47.486619 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0f111-085f-40b1-b79c-e9b5ccb442d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:47.490884 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 296/612] 10.222.0.81 () {56 vars in 1135 bytes} [Wed May 4 17:29:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:47.497304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfb3a7-c17a-4755-aa2d-065fcf9c3243 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:47.505442 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0f111-085f-40b1-b79c-e9b5ccb442d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:47.506907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0f111-085f-40b1-b79c-e9b5ccb442d1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:47.530015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-c8d0f111-085f-40b1-b79c-e9b5ccb442d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:47.530015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:47.530015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:47.530015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:47.530015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:47.530015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:47.530015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:47.530015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:47.530015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:47.530015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:47.530015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:47.530015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:47.530015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:29:47.530015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:29:47.530015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:47.532084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:47.533896 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:29:47.533896 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:29:47.533896 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:29:47.533896 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:29:47.533896 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:29:47.533896 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:29:47.533896 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:47.533896 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:47.538571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 317/613] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:47.547606 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0f111-085f-40b1-b79c-e9b5ccb442d1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:47.608260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfb3a7-c17a-4755-aa2d-065fcf9c3243 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:47.646549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb02d9-19e8-4b33-98ba-c675720c7904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:47.647395 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb02d9-19e8-4b33-98ba-c675720c7904 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:47.647679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb02d9-19e8-4b33-98ba-c675720c7904 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:47.647954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb02d9-19e8-4b33-98ba-c675720c7904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:47.659886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb02d9-19e8-4b33-98ba-c675720c7904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:47.661288 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb02d9-19e8-4b33-98ba-c675720c7904 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:47.679829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e8cb02d9-19e8-4b33-98ba-c675720c7904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:47.679829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:47.679829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:47.679829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:47.679829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:47.679829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:47.679829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:47.679829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:47.679829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:47.679829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:47.679829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:47.679829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:47.679829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:47.679829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:47.679829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:47.681558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:47.683249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:47.683249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:47.683249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:47.683249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:47.683249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 297/614] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:47.690722 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb02d9-19e8-4b33-98ba-c675720c7904 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:47.747692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0f111-085f-40b1-b79c-e9b5ccb442d1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:47.802439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb02d9-19e8-4b33-98ba-c675720c7904 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:47.808401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aaaafa-a7df-49a2-95bc-5d3e378caca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:47.809802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaaafa-a7df-49a2-95bc-5d3e378caca0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:47.810462 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaaafa-a7df-49a2-95bc-5d3e378caca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:47.811780 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaaafa-a7df-49a2-95bc-5d3e378caca0 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:47.814022 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aaaafa-a7df-49a2-95bc-5d3e378caca0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:47.815217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aaaafa-a7df-49a2-95bc-5d3e378caca0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:47.819352 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aaaafa-a7df-49a2-95bc-5d3e378caca0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:47.835641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 318/615] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:29:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:47.841858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aaaafa-a7df-49a2-95bc-5d3e378caca0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:47.864585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4aa0d3-05ae-44c4-963d-59a088b0db39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:47.865626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4aa0d3-05ae-44c4-963d-59a088b0db39 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:47.867240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4aa0d3-05ae-44c4-963d-59a088b0db39 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:47.867647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4aa0d3-05ae-44c4-963d-59a088b0db39 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:47.868992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4aa0d3-05ae-44c4-963d-59a088b0db39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:47.870416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4aa0d3-05ae-44c4-963d-59a088b0db39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:47.872611 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4aa0d3-05ae-44c4-963d-59a088b0db39 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:47.901856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 298/616] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:47.903379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e303ba-c1ad-4424-a367-15208d622b0c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:47.908806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e303ba-c1ad-4424-a367-15208d622b0c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:47.909218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e303ba-c1ad-4424-a367-15208d622b0c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:47.911061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 299/617] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:47.911923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e303ba-c1ad-4424-a367-15208d622b0c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:47.980107 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aaaafa-a7df-49a2-95bc-5d3e378caca0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:48.023145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e023f42-514c-4ed6-9145-9f7c8c2b93b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:48.024109 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e303ba-c1ad-4424-a367-15208d622b0c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:48.024390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e023f42-514c-4ed6-9145-9f7c8c2b93b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:48.024634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e023f42-514c-4ed6-9145-9f7c8c2b93b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:48.024840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e023f42-514c-4ed6-9145-9f7c8c2b93b7 None admin] PATH_INFO: `/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/96f0feac2b384b509bc9f75b92b4df95/roles/61d7286cc614424e9d7b8514b201ee21` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:48.045675 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e023f42-514c-4ed6-9145-9f7c8c2b93b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=544a56c4b97e43aea9fbb003d80af8dc, user_id=96f0feac2b384b509bc9f75b92b4df95, role_id=61d7286cc614424e9d7b8514b201ee21)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:48.047940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e023f42-514c-4ed6-9145-9f7c8c2b93b7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:48.057949 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9b411-b41d-4c5b-9284-a8222df2832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:48.058734 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b411-b41d-4c5b-9284-a8222df2832d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:48.059018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b411-b41d-4c5b-9284-a8222df2832d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:48.059294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b411-b41d-4c5b-9284-a8222df2832d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:48.066839 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9b411-b41d-4c5b-9284-a8222df2832d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:48.068334 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9b411-b41d-4c5b-9284-a8222df2832d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:48.082536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-86c9b411-b41d-4c5b-9284-a8222df2832d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:48.082536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:48.082536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:48.082536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:48.082536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:48.082536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:48.082536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:48.082536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:48.082536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:48.082536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:48.082536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:48.082536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:48.082536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:29:48.082536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:29:48.082536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:48.083430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:48.084309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:29:48.084309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:29:48.084309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:29:48.084309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:29:48.084309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:29:48.084309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:29:48.084309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:48.084309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:48.084309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 300/618] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:48.088569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f24ca-da88-4ba0-b426-f33908bd56b5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:48.088569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f24ca-da88-4ba0-b426-f33908bd56b5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:48.088569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f24ca-da88-4ba0-b426-f33908bd56b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:48.105103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-dd0f24ca-da88-4ba0-b426-f33908bd56b5 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:48.106531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dd0f24ca-da88-4ba0-b426-f33908bd56b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:48.129147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 319/619] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:29:47 2022] PUT /identity/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/96f0feac2b384b509bc9f75b92b4df95/roles/61d7286cc614424e9d7b8514b201ee21 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:29:48.130418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e023f42-514c-4ed6-9145-9f7c8c2b93b7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:48.240871 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e023f42-514c-4ed6-9145-9f7c8c2b93b7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:48.256458 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 301/620] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:48.289356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c51a22-f03e-4598-afba-436e401e4410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:48.290409 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c51a22-f03e-4598-afba-436e401e4410 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:48.290890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c51a22-f03e-4598-afba-436e401e4410 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:48.291411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c51a22-f03e-4598-afba-436e401e4410 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:48.292499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c51a22-f03e-4598-afba-436e401e4410 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:48.293023 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c51a22-f03e-4598-afba-436e401e4410 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:48.294715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c51a22-f03e-4598-afba-436e401e4410 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:48.308678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 320/621] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:29:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:48.315020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f24ca-da88-4ba0-b426-f33908bd56b5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:48.316338 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c51a22-f03e-4598-afba-436e401e4410 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:48.431987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c51a22-f03e-4598-afba-436e401e4410 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:48.471945 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb9588-782c-4eda-87f7-f3acd7811bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:48.473151 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb9588-782c-4eda-87f7-f3acd7811bd3 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:48.473576 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb9588-782c-4eda-87f7-f3acd7811bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:48.474006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb9588-782c-4eda-87f7-f3acd7811bd3 None admin] PATH_INFO: `/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/382e84e110754effa5ffec950f7c1598/roles/61d7286cc614424e9d7b8514b201ee21` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:48.491042 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb9588-782c-4eda-87f7-f3acd7811bd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=544a56c4b97e43aea9fbb003d80af8dc, user_id=382e84e110754effa5ffec950f7c1598, role_id=61d7286cc614424e9d7b8514b201ee21)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:48.492798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb9588-782c-4eda-87f7-f3acd7811bd3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:48.547876 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f24ca-da88-4ba0-b426-f33908bd56b5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:48.573156 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 321/622] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:29:48 2022] PUT /identity/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/382e84e110754effa5ffec950f7c1598/roles/61d7286cc614424e9d7b8514b201ee21 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:29:48.584688 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a957a-378c-4636-83dd-6128a36951a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:48.585575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a957a-378c-4636-83dd-6128a36951a0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:48.585855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a957a-378c-4636-83dd-6128a36951a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:48.586179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a957a-378c-4636-83dd-6128a36951a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:48.598934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a957a-378c-4636-83dd-6128a36951a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:48.607085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4b4a957a-378c-4636-83dd-6128a36951a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:48.607085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:48.607085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:48.607085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:48.607085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:48.607085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:48.607085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:48.607085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:48.607085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:48.607085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:48.607085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:48.607085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:48.607085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:48.607085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:48.607085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:48.607085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:48.610625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:48.610625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:48.610625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:48.610625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:48.610625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:48.610625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:48.610625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:48.610625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:48.610625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:48.610625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:48.610625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:48.610625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:48.610625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:48.610625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:48.610625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:48.610625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:48.611455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:48.611455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:48.611455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:48.611455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:48.611455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:48.611455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:48.611455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:48.611455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:48.611455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:48.611455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:48.611455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:48.611455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:48.611455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 302/623] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:48.617225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb9588-782c-4eda-87f7-f3acd7811bd3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:48.725995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb9588-782c-4eda-87f7-f3acd7811bd3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:48.764282 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e007f-3776-4738-bfa1-578223128fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:48.765593 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e007f-3776-4738-bfa1-578223128fcd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:48.766071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e007f-3776-4738-bfa1-578223128fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:48.766482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e007f-3776-4738-bfa1-578223128fcd None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:48.767244 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e007f-3776-4738-bfa1-578223128fcd None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:48.767553 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e007f-3776-4738-bfa1-578223128fcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:48.768962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e007f-3776-4738-bfa1-578223128fcd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:48.778307 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 322/624] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:29:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:48.786328 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a957a-378c-4636-83dd-6128a36951a0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:48.982599 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a957a-378c-4636-83dd-6128a36951a0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:49.026437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66120b60-78ae-4189-9278-eb6ece76cc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:49.027640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66120b60-78ae-4189-9278-eb6ece76cc2c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:49.028171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66120b60-78ae-4189-9278-eb6ece76cc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:49.028701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66120b60-78ae-4189-9278-eb6ece76cc2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:49.040540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66120b60-78ae-4189-9278-eb6ece76cc2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:49.042635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66120b60-78ae-4189-9278-eb6ece76cc2c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:49.062899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-66120b60-78ae-4189-9278-eb6ece76cc2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:49.062899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:49.062899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:49.062899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:49.062899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:49.062899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:49.062899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:49.062899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:49.062899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:49.062899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:49.062899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:49.062899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:49.062899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:49.062899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:49.062899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:49.063838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:49.064709 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:49.064709 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:49.064709 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:49.064709 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:49.066992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 303/625] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:49.076300 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e007f-3776-4738-bfa1-578223128fcd None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:49.194711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e007f-3776-4738-bfa1-578223128fcd None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:49.240035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1e3af-4026-4107-907f-973eb1623c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:49.240741 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1e3af-4026-4107-907f-973eb1623c08 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:49.241021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1e3af-4026-4107-907f-973eb1623c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:49.241291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1e3af-4026-4107-907f-973eb1623c08 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:49.242020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1e3af-4026-4107-907f-973eb1623c08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:49.242319 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1e3af-4026-4107-907f-973eb1623c08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:49.243703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1e3af-4026-4107-907f-973eb1623c08 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:49.261585 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 323/626] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:49.269518 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66120b60-78ae-4189-9278-eb6ece76cc2c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:49.399231 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66120b60-78ae-4189-9278-eb6ece76cc2c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:49.438414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcaaa5-e84b-4797-b326-9faf9a4a6230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:49.439752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcaaa5-e84b-4797-b326-9faf9a4a6230 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:49.445076 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcaaa5-e84b-4797-b326-9faf9a4a6230 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:49.445572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcaaa5-e84b-4797-b326-9faf9a4a6230 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:49.461837 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcaaa5-e84b-4797-b326-9faf9a4a6230 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:49.464544 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcaaa5-e84b-4797-b326-9faf9a4a6230 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:49.501195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-8bfcaaa5-e84b-4797-b326-9faf9a4a6230 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 17:29:49.501195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:49.501195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:49.501195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:49.501195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:49.501195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:49.501195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:49.501195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:49.501195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:49.501195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:49.501195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:49.501195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:49.501195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:29:49.501195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:29:49.501195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:29:49.501195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:49.502182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:49.503075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:49.503075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:49.503075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:29:49.503075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:29:49.503075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:29:49.503075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:29:49.503075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:29:49.503075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:29:49.503075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 17:29:49.503075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:49.503742 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 304/627] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:49.512253 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1e3af-4026-4107-907f-973eb1623c08 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:49.664690 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1e3af-4026-4107-907f-973eb1623c08 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:49.713184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426809d-d0b8-4c9f-addd-bdc54c414069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:49.713870 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426809d-d0b8-4c9f-addd-bdc54c414069 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:49.714149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426809d-d0b8-4c9f-addd-bdc54c414069 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:49.714420 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426809d-d0b8-4c9f-addd-bdc54c414069 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:49.715269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426809d-d0b8-4c9f-addd-bdc54c414069 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:49.715576 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426809d-d0b8-4c9f-addd-bdc54c414069 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:49.717055 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426809d-d0b8-4c9f-addd-bdc54c414069 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:49.742934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 324/628] 10.222.0.81 () {56 vars in 1137 bytes} [Wed May 4 17:29:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:49.750901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcaaa5-e84b-4797-b326-9faf9a4a6230 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:49.995292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcaaa5-e84b-4797-b326-9faf9a4a6230 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:50.062392 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447b9c4-104d-4fcd-a829-b432eadb6e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:50.063484 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447b9c4-104d-4fcd-a829-b432eadb6e42 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:50.063974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447b9c4-104d-4fcd-a829-b432eadb6e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:50.064477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447b9c4-104d-4fcd-a829-b432eadb6e42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:50.192696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447b9c4-104d-4fcd-a829-b432eadb6e42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:50.195513 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447b9c4-104d-4fcd-a829-b432eadb6e42 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:50.386710 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 305/629] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:50.396300 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426809d-d0b8-4c9f-addd-bdc54c414069 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:50.588536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ff805-8481-4069-b78e-1967c477ad6d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:50.589148 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ff805-8481-4069-b78e-1967c477ad6d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:50.593492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ff805-8481-4069-b78e-1967c477ad6d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:50.593492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 306/630] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:50.598560 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bd99e-6de0-4dc8-a9a2-355b3f1affa5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:50.599021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bd99e-6de0-4dc8-a9a2-355b3f1affa5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:50.599420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bd99e-6de0-4dc8-a9a2-355b3f1affa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:50.641729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-412bd99e-6de0-4dc8-a9a2-355b3f1affa5 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:50.643441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-412bd99e-6de0-4dc8-a9a2-355b3f1affa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:50.647928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426809d-d0b8-4c9f-addd-bdc54c414069 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:50.715897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afc6c8-3b58-4e7d-abe2-584cea41f050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:50.717315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afc6c8-3b58-4e7d-abe2-584cea41f050 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:50.718220 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afc6c8-3b58-4e7d-abe2-584cea41f050 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:50.718707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afc6c8-3b58-4e7d-abe2-584cea41f050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:50.754601 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afc6c8-3b58-4e7d-abe2-584cea41f050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:50.757381 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afc6c8-3b58-4e7d-abe2-584cea41f050 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:50.791567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 307/631] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:50.793466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f1afc6c8-3b58-4e7d-abe2-584cea41f050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:50.793466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:50.793466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:50.793466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:50.793466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:50.793466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:50.793466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:50.793466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:50.793466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:50.793466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:50.793466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:50.793466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:50.793466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:50.793466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:50.793466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:50.794641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:50.795522 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:50.795522 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:50.795522 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:50.795522 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:50.795869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581b355-a545-4bc5-bf95-40bf7c372bbe None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:50.795869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581b355-a545-4bc5-bf95-40bf7c372bbe None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:50.795869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581b355-a545-4bc5-bf95-40bf7c372bbe None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:50.796185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 325/632] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:50.802864 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 308/633] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:50.806351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afc6c8-3b58-4e7d-abe2-584cea41f050 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:50.811114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f7406-fc5e-46f0-9d2c-b85de71d7c38 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:50.812107 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f7406-fc5e-46f0-9d2c-b85de71d7c38 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:50.812593 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f7406-fc5e-46f0-9d2c-b85de71d7c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:50.841452 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e70f7406-fc5e-46f0-9d2c-b85de71d7c38 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:50.843411 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e70f7406-fc5e-46f0-9d2c-b85de71d7c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:50.988787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 309/634] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 17:29:50.990314 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f7406-fc5e-46f0-9d2c-b85de71d7c38 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:50.997173 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afc6c8-3b58-4e7d-abe2-584cea41f050 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:51.071288 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44cd36-a0c8-4b48-8bbf-426cf7b6aba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:51.072164 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44cd36-a0c8-4b48-8bbf-426cf7b6aba3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:51.072647 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44cd36-a0c8-4b48-8bbf-426cf7b6aba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:51.073111 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44cd36-a0c8-4b48-8bbf-426cf7b6aba3 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:51.074435 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44cd36-a0c8-4b48-8bbf-426cf7b6aba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:51.074956 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44cd36-a0c8-4b48-8bbf-426cf7b6aba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:51.077995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44cd36-a0c8-4b48-8bbf-426cf7b6aba3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:51.100171 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 326/635] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:51.100171 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44cd36-a0c8-4b48-8bbf-426cf7b6aba3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:51.209445 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f7406-fc5e-46f0-9d2c-b85de71d7c38 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:51.213669 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44cd36-a0c8-4b48-8bbf-426cf7b6aba3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:51.249023 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ea59c-6ee4-4971-a143-0acffa9131a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:51.250673 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ea59c-6ee4-4971-a143-0acffa9131a3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:51.251150 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ea59c-6ee4-4971-a143-0acffa9131a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:51.251614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ea59c-6ee4-4971-a143-0acffa9131a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:51.262758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ea59c-6ee4-4971-a143-0acffa9131a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:51.270569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7a476-2832-446c-aee1-a2d9f6139eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:51.271897 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7a476-2832-446c-aee1-a2d9f6139eec None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:51.272392 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7a476-2832-446c-aee1-a2d9f6139eec None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:51.272903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7a476-2832-446c-aee1-a2d9f6139eec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:51.273322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-314ea59c-6ee4-4971-a143-0acffa9131a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:51.273322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:51.273322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:51.273322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:51.273322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:51.273322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:51.273322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:51.273322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:51.273322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:51.273322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:51.273322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:51.273322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:51.273322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:51.273322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:51.273322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:51.273322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:51.274194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:51.274194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:51.274194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:51.274194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:51.274194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:51.274194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:51.274194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:51.274194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:51.274194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:51.274194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:51.274194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:51.274194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:51.274194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:51.274194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:51.274194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:51.274194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:51.275020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:51.275020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:51.275020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:51.275020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:51.275020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:51.275020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:51.275020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:51.275020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:51.275020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:51.275020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:51.275020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:51.275020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:51.277953 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 327/636] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:51.278979 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ea59c-6ee4-4971-a143-0acffa9131a3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:51.303116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7a476-2832-446c-aee1-a2d9f6139eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:51.318808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c1d7a476-2832-446c-aee1-a2d9f6139eec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:51.318808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:51.318808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:51.318808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:51.318808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:51.318808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:51.318808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:51.318808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:51.318808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:51.318808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:51.318808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:51.318808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:51.318808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:51.318808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:51.318808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:51.318808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:51.319809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:51.319809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:51.319809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:51.319809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:51.319809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:51.319809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:51.319809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:51.319809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:51.319809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:51.319809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:51.319809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:51.319809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:51.319809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:51.319809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:51.319809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:51.319809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:51.320665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:51.320665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:51.320665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:51.320665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:51.320665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:51.320665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:51.320665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:51.320665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:51.320665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:51.320665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:51.320665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:51.320665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:51.321800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 310/637] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:51.322877 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7a476-2832-446c-aee1-a2d9f6139eec None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:51.390650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ea59c-6ee4-4971-a143-0acffa9131a3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:51.426907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247d4c6-45b2-4595-8521-f8a14cd53d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:51.428582 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247d4c6-45b2-4595-8521-f8a14cd53d52 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:51.429068 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247d4c6-45b2-4595-8521-f8a14cd53d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:51.429553 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247d4c6-45b2-4595-8521-f8a14cd53d52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:51.438570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247d4c6-45b2-4595-8521-f8a14cd53d52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:51.440384 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247d4c6-45b2-4595-8521-f8a14cd53d52 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:51.465169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7247d4c6-45b2-4595-8521-f8a14cd53d52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:51.465169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:51.465169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:51.465169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:51.465169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:51.465169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:51.465169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:51.465169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:51.465169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:51.465169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:51.465169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:51.465169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:51.465169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:29:51.465169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:29:51.465169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:51.466954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:51.470092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:29:51.470092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:29:51.470092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:29:51.470092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:29:51.470092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:29:51.470092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:29:51.470092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:51.470092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:51.470092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 328/638] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:51.470092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247d4c6-45b2-4595-8521-f8a14cd53d52 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:51.503435 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7a476-2832-446c-aee1-a2d9f6139eec None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:51.560835 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10de3a-63df-4b96-a537-77cab91b4b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:51.562644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10de3a-63df-4b96-a537-77cab91b4b00 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:51.563394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10de3a-63df-4b96-a537-77cab91b4b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:51.564161 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10de3a-63df-4b96-a537-77cab91b4b00 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:51.565920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10de3a-63df-4b96-a537-77cab91b4b00 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:51.566711 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10de3a-63df-4b96-a537-77cab91b4b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:51.569802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10de3a-63df-4b96-a537-77cab91b4b00 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:51.579361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247d4c6-45b2-4595-8521-f8a14cd53d52 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:51.584866 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 311/639] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:29:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:51.587738 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8d0a6-deb3-42b8-ac30-42ba4c25aa35 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:51.588260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8d0a6-deb3-42b8-ac30-42ba4c25aa35 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:51.588789 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8d0a6-deb3-42b8-ac30-42ba4c25aa35 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:51.591431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 312/640] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:51.593293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8d0a6-deb3-42b8-ac30-42ba4c25aa35 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:51.623673 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc90a07-53ad-4219-83d9-273b99a12b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:51.624606 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90a07-53ad-4219-83d9-273b99a12b1c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:51.624891 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90a07-53ad-4219-83d9-273b99a12b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:51.625431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90a07-53ad-4219-83d9-273b99a12b1c None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:51.626192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc90a07-53ad-4219-83d9-273b99a12b1c None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:51.626482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc90a07-53ad-4219-83d9-273b99a12b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:51.628172 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc90a07-53ad-4219-83d9-273b99a12b1c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:51.641846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 329/641] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:29:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:51.642773 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc90a07-53ad-4219-83d9-273b99a12b1c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:51.726939 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8d0a6-deb3-42b8-ac30-42ba4c25aa35 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:51.761299 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc90a07-53ad-4219-83d9-273b99a12b1c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:51.770894 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004a762-2c76-411a-934b-eac664f2dcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:51.771148 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004a762-2c76-411a-934b-eac664f2dcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:51.771481 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004a762-2c76-411a-934b-eac664f2dcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:51.771635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004a762-2c76-411a-934b-eac664f2dcf5 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:51.772422 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004a762-2c76-411a-934b-eac664f2dcf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:51.772753 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004a762-2c76-411a-934b-eac664f2dcf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:51.774176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004a762-2c76-411a-934b-eac664f2dcf5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:51.791956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 313/642] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:29:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:51.791956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587cad0-59db-426f-bd9c-888e4361bc7b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:51.791956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587cad0-59db-426f-bd9c-888e4361bc7b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:51.791956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587cad0-59db-426f-bd9c-888e4361bc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:51.807840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deed616-6857-4e96-91d6-9224dfa7c5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:51.808531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9587cad0-59db-426f-bd9c-888e4361bc7b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:51.809001 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deed616-6857-4e96-91d6-9224dfa7c5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:51.809417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deed616-6857-4e96-91d6-9224dfa7c5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:51.809765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9587cad0-59db-426f-bd9c-888e4361bc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:51.809947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deed616-6857-4e96-91d6-9224dfa7c5e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:51.824829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deed616-6857-4e96-91d6-9224dfa7c5e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:51.826328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deed616-6857-4e96-91d6-9224dfa7c5e0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:51.845016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-0deed616-6857-4e96-91d6-9224dfa7c5e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:51.845016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:51.845016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:51.845016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:51.845016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:51.845016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:51.845016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:51.845016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:51.845016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:51.845016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:51.845016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:51.845016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:51.845016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:51.845016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:51.845016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:51.846204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:51.847918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:51.847918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:51.847918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:51.847918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:51.847918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 330/643] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:51.847918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deed616-6857-4e96-91d6-9224dfa7c5e0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:51.894390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 314/644] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:51.895258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587cad0-59db-426f-bd9c-888e4361bc7b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:51.992403 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deed616-6857-4e96-91d6-9224dfa7c5e0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:52.019066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587cad0-59db-426f-bd9c-888e4361bc7b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:52.045104 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53519a-462f-421f-b9f6-d1f2e3b61c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:52.046774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53519a-462f-421f-b9f6-d1f2e3b61c27 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:52.047245 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53519a-462f-421f-b9f6-d1f2e3b61c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:52.047681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53519a-462f-421f-b9f6-d1f2e3b61c27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:52.068019 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53519a-462f-421f-b9f6-d1f2e3b61c27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:52.070369 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53519a-462f-421f-b9f6-d1f2e3b61c27 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:52.075613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d820a-958f-4317-8bb3-9855c84c0972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:52.076695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d820a-958f-4317-8bb3-9855c84c0972 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:52.077715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d820a-958f-4317-8bb3-9855c84c0972 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:52.078188 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d820a-958f-4317-8bb3-9855c84c0972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:52.079700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d820a-958f-4317-8bb3-9855c84c0972 None admin] RBAC: Adding query filter params (role.id=61d7286cc614424e9d7b8514b201ee21, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=ec8e2eb70a5d4dd1b3a9bec2bd0a78a9) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:52.080225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d820a-958f-4317-8bb3-9855c84c0972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:52.082572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d820a-958f-4317-8bb3-9855c84c0972 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:52.101448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 315/645] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:29:51 2022] GET /identity/v3/role_assignments?user.id=ec8e2eb70a5d4dd1b3a9bec2bd0a78a9&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=61d7286cc614424e9d7b8514b201ee21 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:52.101448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d820a-958f-4317-8bb3-9855c84c0972 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:52.101736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-6e53519a-462f-421f-b9f6-d1f2e3b61c27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:52.101736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:52.101736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:52.101736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:52.101736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:52.101736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:52.101736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:52.101736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:52.101736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:52.101736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:52.101736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:52.101736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:52.101736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:52.101736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:52.101736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:52.102550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:52.103484 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:52.103484 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:52.103484 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:52.103484 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:52.103484 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 331/646] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:52.103484 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53519a-462f-421f-b9f6-d1f2e3b61c27 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:52.219757 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d820a-958f-4317-8bb3-9855c84c0972 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:52.245445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53519a-462f-421f-b9f6-d1f2e3b61c27 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:52.260138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691174c-6730-48da-a949-5c9889875c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:52.260859 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691174c-6730-48da-a949-5c9889875c55 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:52.261180 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691174c-6730-48da-a949-5c9889875c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:52.261427 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691174c-6730-48da-a949-5c9889875c55 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:52.262189 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691174c-6730-48da-a949-5c9889875c55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:52.262502 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691174c-6730-48da-a949-5c9889875c55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:52.263926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691174c-6730-48da-a949-5c9889875c55 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:52.277277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 316/647] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:52.278084 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691174c-6730-48da-a949-5c9889875c55 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:52.294298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8badb-29c6-4164-8e4d-cbe12f66e3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:52.295144 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8badb-29c6-4164-8e4d-cbe12f66e3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:52.295425 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8badb-29c6-4164-8e4d-cbe12f66e3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:52.296265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8badb-29c6-4164-8e4d-cbe12f66e3f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:52.308014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8badb-29c6-4164-8e4d-cbe12f66e3f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:52.316901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-04e8badb-29c6-4164-8e4d-cbe12f66e3f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:52.316901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:52.316901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:52.316901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:52.316901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:52.316901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:52.316901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:52.316901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:52.316901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:52.316901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:52.316901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:52.316901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:52.316901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:52.316901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:52.316901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:52.316901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:52.317906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:52.317906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:52.317906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:52.317906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:52.317906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:52.317906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:52.317906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:52.317906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:52.317906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:52.317906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:52.317906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:52.317906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:52.317906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:52.317906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:52.317906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:52.317906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:52.318711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:52.318711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:52.318711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:52.318711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:52.318711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:52.318711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:52.318711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:52.318711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:52.318711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:52.318711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:52.318711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:52.318711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:52.318711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 332/648] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:52.319392 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd054e2-3834-436c-8a85-ad0df7fc17e5 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:52.319658 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd054e2-3834-436c-8a85-ad0df7fc17e5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:52.319936 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd054e2-3834-436c-8a85-ad0df7fc17e5 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:52.325256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 333/649] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:52.325256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd054e2-3834-436c-8a85-ad0df7fc17e5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:52.402982 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691174c-6730-48da-a949-5c9889875c55 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:52.440746 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd054e2-3834-436c-8a85-ad0df7fc17e5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:52.446766 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b43cf6-e89c-4a2d-b7fe-07df5df2b30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:52.448114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b43cf6-e89c-4a2d-b7fe-07df5df2b30c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:52.448648 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b43cf6-e89c-4a2d-b7fe-07df5df2b30c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:52.449127 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b43cf6-e89c-4a2d-b7fe-07df5df2b30c None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:52.450437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b43cf6-e89c-4a2d-b7fe-07df5df2b30c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:52.451277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b43cf6-e89c-4a2d-b7fe-07df5df2b30c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:52.454706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b43cf6-e89c-4a2d-b7fe-07df5df2b30c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:52.479927 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 317/650] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:52.479927 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b43cf6-e89c-4a2d-b7fe-07df5df2b30c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:52.482132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcb1e9-ccbf-412a-acd4-fcac5adb37bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:52.483100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcb1e9-ccbf-412a-acd4-fcac5adb37bd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:52.483374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcb1e9-ccbf-412a-acd4-fcac5adb37bd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:52.483654 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcb1e9-ccbf-412a-acd4-fcac5adb37bd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:52.492839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efcb1e9-ccbf-412a-acd4-fcac5adb37bd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:52.494546 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efcb1e9-ccbf-412a-acd4-fcac5adb37bd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:52.511125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-4efcb1e9-ccbf-412a-acd4-fcac5adb37bd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 17:29:52.511125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:52.511125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:52.511125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:52.511125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:52.511125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:52.511125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:52.511125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:52.511125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:52.511125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:52.511125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:52.511125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:52.511125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:29:52.511125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:29:52.511125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:29:52.511125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:52.512147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:52.513114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:52.513114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:52.513114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:29:52.513114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:29:52.513114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:29:52.513114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:29:52.513114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:29:52.513114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:29:52.513114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 17:29:52.513114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:52.513114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 334/651] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:52.514885 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36e241-0f3e-493b-911a-d7d4499374c7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:52.514885 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36e241-0f3e-493b-911a-d7d4499374c7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:52.515065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36e241-0f3e-493b-911a-d7d4499374c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:52.532030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9d36e241-0f3e-493b-911a-d7d4499374c7 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:52.533171 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9d36e241-0f3e-493b-911a-d7d4499374c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:52.598734 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b43cf6-e89c-4a2d-b7fe-07df5df2b30c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:52.601528 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 335/652] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:52.602224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36e241-0f3e-493b-911a-d7d4499374c7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:52.651060 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b65f59-5324-4c0a-8892-484af1aee13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:52.651739 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b65f59-5324-4c0a-8892-484af1aee13f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:52.652022 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b65f59-5324-4c0a-8892-484af1aee13f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:52.652296 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b65f59-5324-4c0a-8892-484af1aee13f None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:52.653141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b65f59-5324-4c0a-8892-484af1aee13f None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:52.653455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b65f59-5324-4c0a-8892-484af1aee13f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:52.654830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b65f59-5324-4c0a-8892-484af1aee13f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:52.668834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 318/653] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:29:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:52.668834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b65f59-5324-4c0a-8892-484af1aee13f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:52.715109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36e241-0f3e-493b-911a-d7d4499374c7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:52.753468 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0b2b8-97a5-4a3c-9dd8-93da416c1791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:52.754248 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0b2b8-97a5-4a3c-9dd8-93da416c1791 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:52.754529 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0b2b8-97a5-4a3c-9dd8-93da416c1791 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:52.754801 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0b2b8-97a5-4a3c-9dd8-93da416c1791 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:52.762310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0b2b8-97a5-4a3c-9dd8-93da416c1791 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:52.763748 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0b2b8-97a5-4a3c-9dd8-93da416c1791 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:52.779756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b65f59-5324-4c0a-8892-484af1aee13f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:52.789199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-9ed0b2b8-97a5-4a3c-9dd8-93da416c1791 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:29:52.789199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:52.789199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:52.789199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:52.789199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:52.789199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:52.789199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:52.789199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:52.789199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:52.789199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:52.789199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:52.789199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:52.789199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:29:52.789199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:29:52.789199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:29:52.789199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:52.790195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:52.791109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:52.791109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:52.791109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:29:52.791109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:29:52.791109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:29:52.791109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:29:52.791109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:29:52.791109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:29:52.791109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:29:52.791109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:52.792755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 336/654] 10.222.0.81 () {56 vars in 1093 bytes} [Wed May 4 17:29:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:52.793857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0b2b8-97a5-4a3c-9dd8-93da416c1791 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:52.818325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61dbe1-e731-47d6-86eb-7f2f9d3cd350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:52.819146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61dbe1-e731-47d6-86eb-7f2f9d3cd350 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:52.819278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61dbe1-e731-47d6-86eb-7f2f9d3cd350 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:52.819547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61dbe1-e731-47d6-86eb-7f2f9d3cd350 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:52.820395 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61dbe1-e731-47d6-86eb-7f2f9d3cd350 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:52.820726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61dbe1-e731-47d6-86eb-7f2f9d3cd350 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:52.822151 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61dbe1-e731-47d6-86eb-7f2f9d3cd350 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:52.839806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 319/655] 10.222.0.81 () {56 vars in 1137 bytes} [Wed May 4 17:29:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:52.841424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61dbe1-e731-47d6-86eb-7f2f9d3cd350 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:52.904418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0b2b8-97a5-4a3c-9dd8-93da416c1791 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:52.947053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96910cd5-6a10-4b30-a345-47b29bcccb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:52.947841 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96910cd5-6a10-4b30-a345-47b29bcccb34 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:52.948121 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96910cd5-6a10-4b30-a345-47b29bcccb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:52.948395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96910cd5-6a10-4b30-a345-47b29bcccb34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:52.956599 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61dbe1-e731-47d6-86eb-7f2f9d3cd350 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:52.958800 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96910cd5-6a10-4b30-a345-47b29bcccb34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:52.966487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-96910cd5-6a10-4b30-a345-47b29bcccb34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:52.966487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:52.966487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:52.966487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:52.966487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:52.966487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:52.966487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:52.966487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:52.966487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:52.966487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:52.966487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:52.966487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:52.966487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:52.966487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:52.966487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:52.966487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:52.967514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:52.967514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:52.967514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:52.967514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:52.967514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:52.967514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:52.967514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:52.967514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:52.967514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:52.967514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:52.967514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:52.967514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:52.967514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:52.967514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:52.967514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:52.967514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:52.968351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:52.968351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:52.968351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:52.968351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:52.968351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:52.968351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:52.968351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:52.968351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:52.968351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:52.968351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:52.968351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:29:52.968351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:52.968351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 337/656] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:52.969562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96910cd5-6a10-4b30-a345-47b29bcccb34 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:53.003236 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c0af7-cc84-4af2-9b6e-d924640a5810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:53.003981 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c0af7-cc84-4af2-9b6e-d924640a5810 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:53.004265 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c0af7-cc84-4af2-9b6e-d924640a5810 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:53.004746 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c0af7-cc84-4af2-9b6e-d924640a5810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:53.015152 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c0af7-cc84-4af2-9b6e-d924640a5810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:53.016646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c0af7-cc84-4af2-9b6e-d924640a5810 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:53.036415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-fc1c0af7-cc84-4af2-9b6e-d924640a5810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:53.036415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:53.036415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:53.036415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:53.036415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:53.036415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:53.036415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:53.036415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:53.036415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:53.036415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:53.036415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:53.036415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:53.036415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:53.036415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:53.036415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:53.037399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:53.038292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:53.038292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:53.038292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:53.038292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:53.038292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 320/657] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:53.038575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c0af7-cc84-4af2-9b6e-d924640a5810 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:53.079578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96910cd5-6a10-4b30-a345-47b29bcccb34 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:53.115331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a1dc7-bea2-4732-b76e-b6513cb1ef34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:53.115996 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a1dc7-bea2-4732-b76e-b6513cb1ef34 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:53.116275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a1dc7-bea2-4732-b76e-b6513cb1ef34 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:53.116575 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a1dc7-bea2-4732-b76e-b6513cb1ef34 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:53.117409 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a1dc7-bea2-4732-b76e-b6513cb1ef34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:53.117712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a1dc7-bea2-4732-b76e-b6513cb1ef34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:53.119134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a1dc7-bea2-4732-b76e-b6513cb1ef34 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:53.137979 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 338/658] 10.222.0.81 () {56 vars in 1133 bytes} [Wed May 4 17:29:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:53.140378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a1dc7-bea2-4732-b76e-b6513cb1ef34 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:53.159412 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c0af7-cc84-4af2-9b6e-d924640a5810 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:53.194663 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cdb3b-63b6-48da-b0f9-7b0ccc033ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:53.195311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cdb3b-63b6-48da-b0f9-7b0ccc033ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:53.195607 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cdb3b-63b6-48da-b0f9-7b0ccc033ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:53.195872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cdb3b-63b6-48da-b0f9-7b0ccc033ce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:53.249259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a1dc7-bea2-4732-b76e-b6513cb1ef34 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:53.265554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cdb3b-63b6-48da-b0f9-7b0ccc033ce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:53.267019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cdb3b-63b6-48da-b0f9-7b0ccc033ce0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:53.288158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321fc97-22de-4324-b55b-f90c6332ee8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:53.288861 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321fc97-22de-4324-b55b-f90c6332ee8a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:53.289140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321fc97-22de-4324-b55b-f90c6332ee8a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:53.289421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321fc97-22de-4324-b55b-f90c6332ee8a None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:53.290177 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321fc97-22de-4324-b55b-f90c6332ee8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:53.290485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321fc97-22de-4324-b55b-f90c6332ee8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:53.291894 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321fc97-22de-4324-b55b-f90c6332ee8a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:53.301079 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 339/659] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:29:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:53.301921 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321fc97-22de-4324-b55b-f90c6332ee8a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:53.380595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 321/660] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:53.381661 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cdb3b-63b6-48da-b0f9-7b0ccc033ce0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:53.417849 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321fc97-22de-4324-b55b-f90c6332ee8a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:53.454252 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8e50d-06db-4988-a8a2-6fb89f360efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:53.455718 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8e50d-06db-4988-a8a2-6fb89f360efe None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:53.456226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8e50d-06db-4988-a8a2-6fb89f360efe None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:53.456735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8e50d-06db-4988-a8a2-6fb89f360efe None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:53.457639 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8e50d-06db-4988-a8a2-6fb89f360efe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:53.457992 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8e50d-06db-4988-a8a2-6fb89f360efe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:53.459313 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8e50d-06db-4988-a8a2-6fb89f360efe None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:53.472963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 340/661] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:53.473815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8e50d-06db-4988-a8a2-6fb89f360efe None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:53.498416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cdb3b-63b6-48da-b0f9-7b0ccc033ce0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:53.537944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c6155-0ba0-4d12-b83c-cc29bdfa9d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:53.538689 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c6155-0ba0-4d12-b83c-cc29bdfa9d23 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:53.539036 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c6155-0ba0-4d12-b83c-cc29bdfa9d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:53.539312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c6155-0ba0-4d12-b83c-cc29bdfa9d23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:53.593599 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8e50d-06db-4988-a8a2-6fb89f360efe None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:53.606910 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c6155-0ba0-4d12-b83c-cc29bdfa9d23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:53.608635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c6155-0ba0-4d12-b83c-cc29bdfa9d23 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:53.629524 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b695e5-7c78-41a3-9000-9bf65ce84d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:53.630320 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b695e5-7c78-41a3-9000-9bf65ce84d68 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:53.630597 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b695e5-7c78-41a3-9000-9bf65ce84d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:53.630874 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b695e5-7c78-41a3-9000-9bf65ce84d68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:53.642181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b695e5-7c78-41a3-9000-9bf65ce84d68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:53.643651 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b695e5-7c78-41a3-9000-9bf65ce84d68 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:53.662154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-28b695e5-7c78-41a3-9000-9bf65ce84d68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:53.662154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:53.662154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:53.662154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:53.662154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:53.662154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:53.662154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:53.662154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:53.662154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:53.662154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:53.662154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:53.662154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:53.662154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:53.662154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:53.662154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:53.663073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:53.663957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:53.663957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:53.663957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:53.663957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:53.663957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 341/662] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:53.664229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b695e5-7c78-41a3-9000-9bf65ce84d68 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:53.725047 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 322/663] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:53.725907 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c6155-0ba0-4d12-b83c-cc29bdfa9d23 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:53.778134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b695e5-7c78-41a3-9000-9bf65ce84d68 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:53.814093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e37082-f901-4544-8e31-b2ae4ec12a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:53.815297 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e37082-f901-4544-8e31-b2ae4ec12a15 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:53.815797 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e37082-f901-4544-8e31-b2ae4ec12a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:53.816138 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e37082-f901-4544-8e31-b2ae4ec12a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:53.829514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e37082-f901-4544-8e31-b2ae4ec12a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:53.831660 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e37082-f901-4544-8e31-b2ae4ec12a15 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:53.851071 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c6155-0ba0-4d12-b83c-cc29bdfa9d23 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:53.855037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f5e37082-f901-4544-8e31-b2ae4ec12a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:53.855037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:53.855037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:53.855037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:53.855037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:53.855037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:53.855037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:53.855037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:53.855037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:53.855037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:53.855037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:53.855037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:53.855037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:53.855037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:53.855037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:53.855895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:53.857754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:53.857754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:53.857754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:53.857754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:53.865013 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 342/664] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:53.866303 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e37082-f901-4544-8e31-b2ae4ec12a15 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:53.894615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a793ba-468a-4ee4-9014-b7f8b51fef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:53.895539 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a793ba-468a-4ee4-9014-b7f8b51fef28 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:53.895827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a793ba-468a-4ee4-9014-b7f8b51fef28 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:53.896096 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a793ba-468a-4ee4-9014-b7f8b51fef28 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:53.903559 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a793ba-468a-4ee4-9014-b7f8b51fef28 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:53.906413 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a793ba-468a-4ee4-9014-b7f8b51fef28 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:53.923370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-95a793ba-468a-4ee4-9014-b7f8b51fef28 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 17:29:53.923370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:53.923370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:53.923370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:53.923370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:53.923370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:53.923370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:53.923370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:53.923370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:53.923370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:53.923370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:53.923370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:53.923370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:29:53.923370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:29:53.923370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:29:53.923370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:53.924376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:53.925489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:53.925489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:53.925489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:29:53.925489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:29:53.925489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:29:53.925489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:29:53.925489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:29:53.925489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:29:53.925489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 17:29:53.925489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:53.928999 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 323/665] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:29:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:53.929827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a793ba-468a-4ee4-9014-b7f8b51fef28 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:53.985390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e37082-f901-4544-8e31-b2ae4ec12a15 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:54.022651 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fd36c-1170-4bf4-a9e1-6592960b6dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:54.023941 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fd36c-1170-4bf4-a9e1-6592960b6dea None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:54.024706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fd36c-1170-4bf4-a9e1-6592960b6dea None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:54.025132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fd36c-1170-4bf4-a9e1-6592960b6dea None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:54.026217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fd36c-1170-4bf4-a9e1-6592960b6dea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:54.026956 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fd36c-1170-4bf4-a9e1-6592960b6dea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:54.028521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fd36c-1170-4bf4-a9e1-6592960b6dea None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:54.042034 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a793ba-468a-4ee4-9014-b7f8b51fef28 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:54.044265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 343/666] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:54.046835 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fd36c-1170-4bf4-a9e1-6592960b6dea None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:54.080268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96c561-da3f-4336-ad59-e8329aad2213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:54.081103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96c561-da3f-4336-ad59-e8329aad2213 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:54.081393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96c561-da3f-4336-ad59-e8329aad2213 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:54.081742 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96c561-da3f-4336-ad59-e8329aad2213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:54.094034 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96c561-da3f-4336-ad59-e8329aad2213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:54.095539 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96c561-da3f-4336-ad59-e8329aad2213 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:54.119805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-8f96c561-da3f-4336-ad59-e8329aad2213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:54.119805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:54.119805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:54.119805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:54.119805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:54.119805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:54.119805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:54.119805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:54.119805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:54.119805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:54.119805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:54.119805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:54.119805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:54.119805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:54.119805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:54.120955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:54.121827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:54.121827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:54.121827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:54.121827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:54.121827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 324/667] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:54.122104 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96c561-da3f-4336-ad59-e8329aad2213 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:54.174512 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fd36c-1170-4bf4-a9e1-6592960b6dea None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:54.212087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23c3c0-8603-4b6f-af8b-bf3ae60db123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:54.212778 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23c3c0-8603-4b6f-af8b-bf3ae60db123 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:54.213057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23c3c0-8603-4b6f-af8b-bf3ae60db123 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:54.213320 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23c3c0-8603-4b6f-af8b-bf3ae60db123 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:54.214040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23c3c0-8603-4b6f-af8b-bf3ae60db123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:54.214335 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23c3c0-8603-4b6f-af8b-bf3ae60db123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:54.215692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23c3c0-8603-4b6f-af8b-bf3ae60db123 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:54.233321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 344/668] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:54.233321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23c3c0-8603-4b6f-af8b-bf3ae60db123 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:54.261933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96c561-da3f-4336-ad59-e8329aad2213 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:54.300255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145f19d-1f66-4c30-a57e-38a3ddc3aff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:54.301029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145f19d-1f66-4c30-a57e-38a3ddc3aff4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:54.301318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145f19d-1f66-4c30-a57e-38a3ddc3aff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:54.301599 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145f19d-1f66-4c30-a57e-38a3ddc3aff4 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:54.302455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145f19d-1f66-4c30-a57e-38a3ddc3aff4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:54.302772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145f19d-1f66-4c30-a57e-38a3ddc3aff4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:54.304944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145f19d-1f66-4c30-a57e-38a3ddc3aff4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:54.329859 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 325/669] 10.222.0.81 () {56 vars in 1139 bytes} [Wed May 4 17:29:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:54.329859 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145f19d-1f66-4c30-a57e-38a3ddc3aff4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:54.348527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23c3c0-8603-4b6f-af8b-bf3ae60db123 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:54.394987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381aa76-7014-4fff-9d12-c58fdb9cfc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:54.395719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381aa76-7014-4fff-9d12-c58fdb9cfc1c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:54.396502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381aa76-7014-4fff-9d12-c58fdb9cfc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:54.396502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381aa76-7014-4fff-9d12-c58fdb9cfc1c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:54.404144 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381aa76-7014-4fff-9d12-c58fdb9cfc1c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:54.406459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381aa76-7014-4fff-9d12-c58fdb9cfc1c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:54.422018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-6381aa76-7014-4fff-9d12-c58fdb9cfc1c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 17:29:54.422018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:54.422018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:54.422018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:54.422018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:54.422018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:54.422018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:54.422018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:54.422018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:54.422018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:54.422018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:54.422018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:54.422018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:29:54.422018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:29:54.422018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:29:54.422018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:54.422993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:54.429053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:54.429053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:54.429053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:29:54.429053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:29:54.429053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:29:54.429053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:29:54.429053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:29:54.429053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:29:54.429053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 17:29:54.429053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:54.429053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 345/670] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:29:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:54.429053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381aa76-7014-4fff-9d12-c58fdb9cfc1c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:54.455819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145f19d-1f66-4c30-a57e-38a3ddc3aff4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:54.492916 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6eac9d-ab46-411e-9734-795233de748e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:54.493577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6eac9d-ab46-411e-9734-795233de748e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:54.493880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6eac9d-ab46-411e-9734-795233de748e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:54.494134 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6eac9d-ab46-411e-9734-795233de748e None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:54.494853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6eac9d-ab46-411e-9734-795233de748e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:54.495157 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6eac9d-ab46-411e-9734-795233de748e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:54.496701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6eac9d-ab46-411e-9734-795233de748e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:54.513626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 326/671] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:54.513626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6eac9d-ab46-411e-9734-795233de748e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:54.541755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381aa76-7014-4fff-9d12-c58fdb9cfc1c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:54.575532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682faf8-8ea1-4cc3-9aa8-511140875308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:54.576323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682faf8-8ea1-4cc3-9aa8-511140875308 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:54.577205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682faf8-8ea1-4cc3-9aa8-511140875308 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:54.577481 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682faf8-8ea1-4cc3-9aa8-511140875308 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:54.584423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682faf8-8ea1-4cc3-9aa8-511140875308 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:54.587808 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682faf8-8ea1-4cc3-9aa8-511140875308 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:54.600278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-b682faf8-8ea1-4cc3-9aa8-511140875308 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:54.600278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:54.600278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:54.600278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:54.600278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:54.600278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:54.600278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:54.600278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:54.600278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:54.600278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:54.600278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:54.600278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:54.600278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:29:54.600278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:29:54.600278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:54.601240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:54.607084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:29:54.607084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:29:54.607084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:29:54.607084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:29:54.607084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:29:54.607084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:29:54.607084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:54.607084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:54.607084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 346/672] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:54.607084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682faf8-8ea1-4cc3-9aa8-511140875308 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:54.626953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6eac9d-ab46-411e-9734-795233de748e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:54.660354 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d73131-eeae-4576-ba62-9ddb9b7818a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:54.660959 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d73131-eeae-4576-ba62-9ddb9b7818a1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:54.661245 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d73131-eeae-4576-ba62-9ddb9b7818a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:54.661522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d73131-eeae-4576-ba62-9ddb9b7818a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:54.705186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682faf8-8ea1-4cc3-9aa8-511140875308 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:54.741147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d73131-eeae-4576-ba62-9ddb9b7818a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:54.742633 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d73131-eeae-4576-ba62-9ddb9b7818a1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:54.744711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cf943-7233-43f6-8b15-86b5e740ebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:54.745383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cf943-7233-43f6-8b15-86b5e740ebab None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:54.745657 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cf943-7233-43f6-8b15-86b5e740ebab None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:54.745935 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cf943-7233-43f6-8b15-86b5e740ebab None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:54.746777 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cf943-7233-43f6-8b15-86b5e740ebab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:54.747081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cf943-7233-43f6-8b15-86b5e740ebab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:54.748543 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cf943-7233-43f6-8b15-86b5e740ebab None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:54.766680 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 347/673] 10.222.0.81 () {56 vars in 1135 bytes} [Wed May 4 17:29:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:54.767518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cf943-7233-43f6-8b15-86b5e740ebab None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:54.849933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 327/674] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:54.851374 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61329a-45a5-414f-aa6a-992b0a82bc3b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:54.851935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61329a-45a5-414f-aa6a-992b0a82bc3b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:54.851935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61329a-45a5-414f-aa6a-992b0a82bc3b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:54.855889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 328/675] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:54.855889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61329a-45a5-414f-aa6a-992b0a82bc3b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:54.868820 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cf943-7233-43f6-8b15-86b5e740ebab None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:54.903755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b5eb5-d351-46ae-8fbe-f574f2ca290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:54.904682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b5eb5-d351-46ae-8fbe-f574f2ca290a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:54.905579 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b5eb5-d351-46ae-8fbe-f574f2ca290a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:54.905810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b5eb5-d351-46ae-8fbe-f574f2ca290a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:54.912833 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b5eb5-d351-46ae-8fbe-f574f2ca290a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:54.914242 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b5eb5-d351-46ae-8fbe-f574f2ca290a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:54.928273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-fd9b5eb5-d351-46ae-8fbe-f574f2ca290a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:54.928273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:54.928273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:54.928273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:54.928273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:54.928273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:54.928273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:54.928273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:54.928273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:54.928273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:54.928273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:54.928273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:54.928273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:29:54.928273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:29:54.928273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:54.929317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:54.930170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:29:54.930170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:29:54.930170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:29:54.930170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:29:54.930170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:29:54.930170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:29:54.930170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:54.930170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:54.930170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 348/676] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:54.931138 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b5eb5-d351-46ae-8fbe-f574f2ca290a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:54.959389 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61329a-45a5-414f-aa6a-992b0a82bc3b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:54.992820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a351a9-0538-4763-ae01-964112f68527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:54.993477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a351a9-0538-4763-ae01-964112f68527 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:54.993763 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a351a9-0538-4763-ae01-964112f68527 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:54.994038 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a351a9-0538-4763-ae01-964112f68527 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:54.994831 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a351a9-0538-4763-ae01-964112f68527 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:54.995141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a351a9-0538-4763-ae01-964112f68527 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:54.996947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a351a9-0538-4763-ae01-964112f68527 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:55.009387 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 329/677] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:29:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:55.010241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a351a9-0538-4763-ae01-964112f68527 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:55.031432 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b5eb5-d351-46ae-8fbe-f574f2ca290a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:55.065921 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272e6ba-b87d-4479-b70e-f89847caea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:55.066571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272e6ba-b87d-4479-b70e-f89847caea17 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:55.066851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272e6ba-b87d-4479-b70e-f89847caea17 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:55.067123 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272e6ba-b87d-4479-b70e-f89847caea17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:55.107110 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a351a9-0538-4763-ae01-964112f68527 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:55.133519 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272e6ba-b87d-4479-b70e-f89847caea17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:55.134978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272e6ba-b87d-4479-b70e-f89847caea17 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:55.140570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94383722-0cf5-4dec-9740-aab8c6312630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:55.141370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94383722-0cf5-4dec-9740-aab8c6312630 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:55.141651 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94383722-0cf5-4dec-9740-aab8c6312630 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:55.141924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94383722-0cf5-4dec-9740-aab8c6312630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:55.153270 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94383722-0cf5-4dec-9740-aab8c6312630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:55.154760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94383722-0cf5-4dec-9740-aab8c6312630 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:55.172402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-94383722-0cf5-4dec-9740-aab8c6312630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:55.172402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:55.172402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:55.172402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:55.172402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:55.172402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:55.172402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:55.172402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:55.172402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:55.172402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:55.172402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:55.172402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:55.172402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:55.172402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:55.172402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:55.173439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:55.174338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:55.174338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:55.174338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:55.174338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:55.174338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 330/678] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:55.175127 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23db14-cc1f-4e36-82cb-edc59017e652 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:55.175127 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23db14-cc1f-4e36-82cb-edc59017e652 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:55.175406 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23db14-cc1f-4e36-82cb-edc59017e652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:55.192359 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4c23db14-cc1f-4e36-82cb-edc59017e652 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:55.193595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4c23db14-cc1f-4e36-82cb-edc59017e652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:55.235284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 349/679] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:29:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:29:55.236144 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272e6ba-b87d-4479-b70e-f89847caea17 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:55.260198 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 331/680] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:55.261089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23db14-cc1f-4e36-82cb-edc59017e652 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:55.337820 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272e6ba-b87d-4479-b70e-f89847caea17 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:55.361337 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23db14-cc1f-4e36-82cb-edc59017e652 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:55.371899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d73fdd-b978-444e-be18-8eea00f60522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:55.372601 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d73fdd-b978-444e-be18-8eea00f60522 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:55.372879 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d73fdd-b978-444e-be18-8eea00f60522 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:55.373154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d73fdd-b978-444e-be18-8eea00f60522 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:55.374659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d73fdd-b978-444e-be18-8eea00f60522 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:55.375222 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d73fdd-b978-444e-be18-8eea00f60522 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:55.376675 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d73fdd-b978-444e-be18-8eea00f60522 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:55.389716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 350/681] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:29:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:55.390574 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d73fdd-b978-444e-be18-8eea00f60522 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:55.400145 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8888621-4bb8-4983-b99f-1f8093fcf2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:55.400836 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8888621-4bb8-4983-b99f-1f8093fcf2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:55.401123 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8888621-4bb8-4983-b99f-1f8093fcf2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:55.401403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8888621-4bb8-4983-b99f-1f8093fcf2f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:55.402246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8888621-4bb8-4983-b99f-1f8093fcf2f1 None admin] RBAC: Adding query filter params (role.id=61d7286cc614424e9d7b8514b201ee21, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=4f22b09c1ffc4006a4b47ba882c55f80) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:55.402562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8888621-4bb8-4983-b99f-1f8093fcf2f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:55.403993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8888621-4bb8-4983-b99f-1f8093fcf2f1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:55.410532 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 332/682] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:29:55 2022] GET /identity/v3/role_assignments?user.id=4f22b09c1ffc4006a4b47ba882c55f80&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=61d7286cc614424e9d7b8514b201ee21 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:55.411340 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8888621-4bb8-4983-b99f-1f8093fcf2f1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:55.505335 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d73fdd-b978-444e-be18-8eea00f60522 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:55.531476 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8888621-4bb8-4983-b99f-1f8093fcf2f1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:55.542140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781ab47-f044-4169-95f0-1f69521dcd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:55.542950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781ab47-f044-4169-95f0-1f69521dcd9c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:55.543097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781ab47-f044-4169-95f0-1f69521dcd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:55.543349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781ab47-f044-4169-95f0-1f69521dcd9c None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:55.544092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781ab47-f044-4169-95f0-1f69521dcd9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:55.544394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781ab47-f044-4169-95f0-1f69521dcd9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:55.546391 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781ab47-f044-4169-95f0-1f69521dcd9c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:55.559578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 351/683] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:55.560948 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781ab47-f044-4169-95f0-1f69521dcd9c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:55.578326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03033a-c6d0-4a09-9e3a-c83b07032360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:55.579139 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03033a-c6d0-4a09-9e3a-c83b07032360 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:55.579426 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03033a-c6d0-4a09-9e3a-c83b07032360 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:55.579700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03033a-c6d0-4a09-9e3a-c83b07032360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:55.591885 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03033a-c6d0-4a09-9e3a-c83b07032360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:55.599654 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03033a-c6d0-4a09-9e3a-c83b07032360 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:55.613847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ba03033a-c6d0-4a09-9e3a-c83b07032360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:55.613847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:55.613847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:55.613847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:55.613847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:55.613847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:55.613847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:55.613847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:55.613847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:55.613847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:55.613847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:55.613847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:55.613847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:55.613847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:55.613847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:55.614776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:55.615666 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:55.615666 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:55.615666 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:55.615666 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:55.615666 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 333/684] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:55.615953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03033a-c6d0-4a09-9e3a-c83b07032360 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:55.671888 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781ab47-f044-4169-95f0-1f69521dcd9c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:55.708037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11518f2-dc4c-4ed1-abc8-0ba55f4b7589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:55.708945 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11518f2-dc4c-4ed1-abc8-0ba55f4b7589 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:55.709202 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11518f2-dc4c-4ed1-abc8-0ba55f4b7589 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:55.709478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11518f2-dc4c-4ed1-abc8-0ba55f4b7589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:55.721038 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11518f2-dc4c-4ed1-abc8-0ba55f4b7589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:55.722507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11518f2-dc4c-4ed1-abc8-0ba55f4b7589 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:55.733208 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03033a-c6d0-4a09-9e3a-c83b07032360 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:55.740478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-b11518f2-dc4c-4ed1-abc8-0ba55f4b7589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:55.740478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:55.740478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:55.740478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:55.740478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:55.740478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:55.740478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:55.740478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:55.740478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:55.740478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:55.740478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:55.740478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:55.740478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:55.740478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:55.740478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:55.741586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:55.742769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:55.742769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:55.742769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:55.742769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:55.743178 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 352/685] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:55.744760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11518f2-dc4c-4ed1-abc8-0ba55f4b7589 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:55.783644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771dbe5-b6f7-4fc1-b24b-bee42117d1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:55.784581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771dbe5-b6f7-4fc1-b24b-bee42117d1dd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:55.784977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771dbe5-b6f7-4fc1-b24b-bee42117d1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:55.785335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771dbe5-b6f7-4fc1-b24b-bee42117d1dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:55.786635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771dbe5-b6f7-4fc1-b24b-bee42117d1dd None admin] RBAC: Adding query filter params (role.id=61d7286cc614424e9d7b8514b201ee21, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=d4a073d8f47a485cbb22db01530f3b37) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:55.787081 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771dbe5-b6f7-4fc1-b24b-bee42117d1dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:55.788546 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771dbe5-b6f7-4fc1-b24b-bee42117d1dd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:55.804849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 334/686] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:29:55 2022] GET /identity/v3/role_assignments?user.id=d4a073d8f47a485cbb22db01530f3b37&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=61d7286cc614424e9d7b8514b201ee21 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:55.804849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771dbe5-b6f7-4fc1-b24b-bee42117d1dd None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:55.877852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11518f2-dc4c-4ed1-abc8-0ba55f4b7589 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:55.916919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfabb08-5591-46af-a91a-1636bda59294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:55.917758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfabb08-5591-46af-a91a-1636bda59294 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:55.918039 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfabb08-5591-46af-a91a-1636bda59294 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:55.918314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfabb08-5591-46af-a91a-1636bda59294 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:55.926341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfabb08-5591-46af-a91a-1636bda59294 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:55.927822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfabb08-5591-46af-a91a-1636bda59294 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:55.937725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771dbe5-b6f7-4fc1-b24b-bee42117d1dd None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:55.944688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3bfabb08-5591-46af-a91a-1636bda59294 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:55.944688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:55.944688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:55.944688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:55.944688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:55.944688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:55.944688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:55.944688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:55.944688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:55.944688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:55.944688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:55.944688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:55.944688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:29:55.944688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:29:55.944688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:55.945611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:55.946474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:29:55.946474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:29:55.946474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:29:55.946474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:29:55.946474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:29:55.946474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:29:55.946474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:55.946474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:55.950774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 353/687] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:55.952617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfabb08-5591-46af-a91a-1636bda59294 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:55.976387 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eafc79-b63d-4e9f-a5fa-8be8e3383509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:55.977124 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eafc79-b63d-4e9f-a5fa-8be8e3383509 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:55.977458 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eafc79-b63d-4e9f-a5fa-8be8e3383509 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:55.977735 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eafc79-b63d-4e9f-a5fa-8be8e3383509 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:55.978502 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eafc79-b63d-4e9f-a5fa-8be8e3383509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:55.978800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eafc79-b63d-4e9f-a5fa-8be8e3383509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:55.980276 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eafc79-b63d-4e9f-a5fa-8be8e3383509 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:56.000093 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 335/688] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:56.001181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eafc79-b63d-4e9f-a5fa-8be8e3383509 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:56.070531 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfabb08-5591-46af-a91a-1636bda59294 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:56.120073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b0dfb-8b8c-4887-ac19-ec397bcb2e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:56.120792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b0dfb-8b8c-4887-ac19-ec397bcb2e8a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:56.121072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b0dfb-8b8c-4887-ac19-ec397bcb2e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:56.121347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b0dfb-8b8c-4887-ac19-ec397bcb2e8a None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:56.122083 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b0dfb-8b8c-4887-ac19-ec397bcb2e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:56.122389 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b0dfb-8b8c-4887-ac19-ec397bcb2e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:56.123810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b0dfb-8b8c-4887-ac19-ec397bcb2e8a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:56.139302 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 354/689] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:56.141432 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b0dfb-8b8c-4887-ac19-ec397bcb2e8a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:56.141586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eafc79-b63d-4e9f-a5fa-8be8e3383509 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:56.189976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0057308-241a-45be-9a44-8600b3ee661a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:56.191501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0057308-241a-45be-9a44-8600b3ee661a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:56.191941 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0057308-241a-45be-9a44-8600b3ee661a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:56.192464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0057308-241a-45be-9a44-8600b3ee661a None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:56.193961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0057308-241a-45be-9a44-8600b3ee661a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:56.194432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0057308-241a-45be-9a44-8600b3ee661a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:56.196546 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0057308-241a-45be-9a44-8600b3ee661a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:56.212964 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 336/690] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:29:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:56.214309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0057308-241a-45be-9a44-8600b3ee661a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:56.257215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b0dfb-8b8c-4887-ac19-ec397bcb2e8a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:56.303231 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38c144-af94-4b59-92e0-9427ec8fabe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:56.304344 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38c144-af94-4b59-92e0-9427ec8fabe7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:56.304810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38c144-af94-4b59-92e0-9427ec8fabe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:56.305824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38c144-af94-4b59-92e0-9427ec8fabe7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:56.316187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38c144-af94-4b59-92e0-9427ec8fabe7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:56.317950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38c144-af94-4b59-92e0-9427ec8fabe7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:56.343528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0057308-241a-45be-9a44-8600b3ee661a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:56.343858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-cd38c144-af94-4b59-92e0-9427ec8fabe7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:56.343858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:56.343858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:56.343858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:56.343858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:56.343858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:56.343858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:56.343858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:56.343858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:56.343858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:56.343858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:56.343858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:56.343858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:29:56.343858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:29:56.343858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:56.344908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:56.345908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:29:56.345908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:29:56.345908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:29:56.345908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:29:56.345908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:29:56.345908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:29:56.345908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:29:56.345908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:56.348987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 355/691] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:56.349987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38c144-af94-4b59-92e0-9427ec8fabe7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:56.404081 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be25706-377c-4bb5-9cca-53f6fcf4458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:56.404772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be25706-377c-4bb5-9cca-53f6fcf4458c None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:56.405058 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be25706-377c-4bb5-9cca-53f6fcf4458c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:56.405399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be25706-377c-4bb5-9cca-53f6fcf4458c None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:56.406124 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be25706-377c-4bb5-9cca-53f6fcf4458c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:56.407616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be25706-377c-4bb5-9cca-53f6fcf4458c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:56.466224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38c144-af94-4b59-92e0-9427ec8fabe7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:56.503572 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d061924-fe03-4f8f-ae7f-d1ec0bb75518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:56.504547 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d061924-fe03-4f8f-ae7f-d1ec0bb75518 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:56.504960 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d061924-fe03-4f8f-ae7f-d1ec0bb75518 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:56.505360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d061924-fe03-4f8f-ae7f-d1ec0bb75518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:56.506348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d061924-fe03-4f8f-ae7f-d1ec0bb75518 None admin] RBAC: Adding query filter params (role.id=61d7286cc614424e9d7b8514b201ee21, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=96f0feac2b384b509bc9f75b92b4df95) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:56.506800 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d061924-fe03-4f8f-ae7f-d1ec0bb75518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:56.508483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d061924-fe03-4f8f-ae7f-d1ec0bb75518 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:56.508857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 337/692] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:29:56 2022] POST /identity/v3/users => generated 254 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:29:56.510079 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be25706-377c-4bb5-9cca-53f6fcf4458c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:56.516616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 356/693] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:29:56 2022] GET /identity/v3/role_assignments?user.id=96f0feac2b384b509bc9f75b92b4df95&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=61d7286cc614424e9d7b8514b201ee21 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:56.679450 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be25706-377c-4bb5-9cca-53f6fcf4458c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:56.731257 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a6a7c-9731-4314-9aca-856194194c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:56.731945 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6a7c-9731-4314-9aca-856194194c51 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:56.732232 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6a7c-9731-4314-9aca-856194194c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:56.733055 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6a7c-9731-4314-9aca-856194194c51 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:56.733895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a6a7c-9731-4314-9aca-856194194c51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:56.734210 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a6a7c-9731-4314-9aca-856194194c51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:56.735702 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a6a7c-9731-4314-9aca-856194194c51 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:56.753578 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 338/694] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:29:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:56.759724 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d061924-fe03-4f8f-ae7f-d1ec0bb75518 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:56.892121 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d061924-fe03-4f8f-ae7f-d1ec0bb75518 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:56.933361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b5474-f0b2-48bc-b837-35639dd81bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:56.934401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b5474-f0b2-48bc-b837-35639dd81bcd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:56.934898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b5474-f0b2-48bc-b837-35639dd81bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:56.935365 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b5474-f0b2-48bc-b837-35639dd81bcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:56.937082 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b5474-f0b2-48bc-b837-35639dd81bcd None admin] RBAC: Adding query filter params (role.id=61d7286cc614424e9d7b8514b201ee21, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=382e84e110754effa5ffec950f7c1598) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:56.937627 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b5474-f0b2-48bc-b837-35639dd81bcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:56.940012 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b5474-f0b2-48bc-b837-35639dd81bcd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:56.948781 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 357/695] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:29:56 2022] GET /identity/v3/role_assignments?user.id=382e84e110754effa5ffec950f7c1598&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=61d7286cc614424e9d7b8514b201ee21 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:57.951721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb3a79-dbb9-44e0-b251-9c5110bf7ef0 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:57.952304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb3a79-dbb9-44e0-b251-9c5110bf7ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:57.952561 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb3a79-dbb9-44e0-b251-9c5110bf7ef0 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:57.954177 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 339/696] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:57.959773 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf63b73-bce0-4189-a695-16e8388d9333 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:57.960266 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf63b73-bce0-4189-a695-16e8388d9333 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:57.960369 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf63b73-bce0-4189-a695-16e8388d9333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:57.979893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-fdf63b73-bce0-4189-a695-16e8388d9333 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:57.981131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fdf63b73-bce0-4189-a695-16e8388d9333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:58.053176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 358/697] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:58.074612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb3a79-dbb9-44e0-b251-9c5110bf7ef0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:58.186667 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb3a79-dbb9-44e0-b251-9c5110bf7ef0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:58.223110 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff561b7-59f9-41e1-9493-4571949d7a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:58.223843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff561b7-59f9-41e1-9493-4571949d7a22 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:58.224122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff561b7-59f9-41e1-9493-4571949d7a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:58.224397 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff561b7-59f9-41e1-9493-4571949d7a22 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:58.225240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff561b7-59f9-41e1-9493-4571949d7a22 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:58.227649 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff561b7-59f9-41e1-9493-4571949d7a22 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:58.242809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9ff561b7-59f9-41e1-9493-4571949d7a22 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:29:58.242809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:58.242809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:29:58.242809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:29:58.242809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:29:58.242809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:29:58.242809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:29:58.242809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:29:58.242809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:29:58.242809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:58.242809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:29:58.242809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:58.242809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:58.242809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:58.242809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:58.242809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:58.243825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:58.243825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:58.243825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:58.243825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:58.243825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:58.243825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:58.243825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:58.243825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:29:58.243825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:29:58.243825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:29:58.243825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:29:58.243825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:58.243825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:58.243825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:58.243825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:58.243825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:58.244701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:58.244701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:58.244701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:58.244701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:58.244701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:58.244701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:58.244701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:58.244701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:58.244701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:58.244701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:58.244701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:58.244701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:29:58.244701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:29:58.244701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:29:58.244701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:58.244701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 340/698] 10.222.0.81 () {56 vars in 1129 bytes} [Wed May 4 17:29:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:58.252091 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf63b73-bce0-4189-a695-16e8388d9333 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:58.362769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf63b73-bce0-4189-a695-16e8388d9333 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:58.397818 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807f2e5-4ae8-4523-8eda-48b0e53f6031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:58.398484 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807f2e5-4ae8-4523-8eda-48b0e53f6031 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:58.398759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807f2e5-4ae8-4523-8eda-48b0e53f6031 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:58.399031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807f2e5-4ae8-4523-8eda-48b0e53f6031 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:58.399745 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807f2e5-4ae8-4523-8eda-48b0e53f6031 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:58.400044 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807f2e5-4ae8-4523-8eda-48b0e53f6031 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:58.401434 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807f2e5-4ae8-4523-8eda-48b0e53f6031 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:58.407121 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 359/699] 10.222.0.81 () {56 vars in 1124 bytes} [Wed May 4 17:29:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:58.413358 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff561b7-59f9-41e1-9493-4571949d7a22 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:58.588781 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff561b7-59f9-41e1-9493-4571949d7a22 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:58.638103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c410ce3-72a1-4018-ba91-70344309f570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:58.639342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c410ce3-72a1-4018-ba91-70344309f570 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:58.639766 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c410ce3-72a1-4018-ba91-70344309f570 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:58.640043 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c410ce3-72a1-4018-ba91-70344309f570 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:58.640822 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c410ce3-72a1-4018-ba91-70344309f570 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:58.641127 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c410ce3-72a1-4018-ba91-70344309f570 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:58.642521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c410ce3-72a1-4018-ba91-70344309f570 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:58.653580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 341/700] 10.222.0.81 () {56 vars in 1124 bytes} [Wed May 4 17:29:58 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:58.674109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4c428-02af-4eba-9801-7dca045fcbf6 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:58.674435 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4c428-02af-4eba-9801-7dca045fcbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:58.674689 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4c428-02af-4eba-9801-7dca045fcbf6 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:58.676511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 360/701] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:58.681797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca5d32-fd8b-4695-93a6-41e1aeefb0c8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:58.682093 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca5d32-fd8b-4695-93a6-41e1aeefb0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:58.682349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca5d32-fd8b-4695-93a6-41e1aeefb0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:58.709785 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-74ca5d32-fd8b-4695-93a6-41e1aeefb0c8 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:58.711017 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-74ca5d32-fd8b-4695-93a6-41e1aeefb0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:58.808637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 342/702] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:58.850085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4c428-02af-4eba-9801-7dca045fcbf6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:58.989036 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4c428-02af-4eba-9801-7dca045fcbf6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:59.027005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df4d27-c0b9-40d5-94cc-0fa6d6b7ac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:59.027813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df4d27-c0b9-40d5-94cc-0fa6d6b7ac78 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:59.028088 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df4d27-c0b9-40d5-94cc-0fa6d6b7ac78 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:59.028355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df4d27-c0b9-40d5-94cc-0fa6d6b7ac78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:59.042152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df4d27-c0b9-40d5-94cc-0fa6d6b7ac78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:29:59.050946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-e0df4d27-c0b9-40d5-94cc-0fa6d6b7ac78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:29:59.050946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:59.050946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:59.050946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:59.050946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:59.050946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:59.050946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:59.050946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:59.050946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:59.050946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:59.050946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:59.050946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:59.050946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:29:59.050946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:29:59.050946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:29:59.050946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:29:59.051951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:29:59.051951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:29:59.051951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:29:59.051951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:29:59.051951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:59.051951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:59.051951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:59.051951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:59.051951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:59.051951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:59.051951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:59.051951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:59.051951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:59.051951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:59.051951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:59.051951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:59.052811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:59.052811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:59.052811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:59.052811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:59.052811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:29:59.052811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:29:59.052811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:29:59.052811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:29:59.052811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:29:59.052811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:29:59.052811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:29:59.052811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:59.052811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 361/703] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:29:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:59.058267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca5d32-fd8b-4695-93a6-41e1aeefb0c8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:59.166419 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca5d32-fd8b-4695-93a6-41e1aeefb0c8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:59.206931 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629601d3-64c4-4399-8e0b-11c5eb27e23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:59.208018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629601d3-64c4-4399-8e0b-11c5eb27e23e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:59.208546 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629601d3-64c4-4399-8e0b-11c5eb27e23e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:59.209018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629601d3-64c4-4399-8e0b-11c5eb27e23e None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:59.209989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629601d3-64c4-4399-8e0b-11c5eb27e23e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:59.210515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629601d3-64c4-4399-8e0b-11c5eb27e23e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:59.212100 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629601d3-64c4-4399-8e0b-11c5eb27e23e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:59.222044 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 343/704] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:29:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:29:59.229868 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df4d27-c0b9-40d5-94cc-0fa6d6b7ac78 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:59.383948 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df4d27-c0b9-40d5-94cc-0fa6d6b7ac78 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:59.395886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea626de-6cc9-4e4c-b555-63f4650f943c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:59.396229 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea626de-6cc9-4e4c-b555-63f4650f943c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:59.396777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea626de-6cc9-4e4c-b555-63f4650f943c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:59.398155 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 344/705] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:29:59.403486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8508e-fc23-4825-9f75-b6e229e60974 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:59.403776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8508e-fc23-4825-9f75-b6e229e60974 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:59.404150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8508e-fc23-4825-9f75-b6e229e60974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:59.432361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c84344-5fc0-4331-baa2-604f2bd8cadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:59.433189 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c84344-5fc0-4331-baa2-604f2bd8cadb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:59.433470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c84344-5fc0-4331-baa2-604f2bd8cadb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:59.433743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c84344-5fc0-4331-baa2-604f2bd8cadb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:59.441178 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-84e8508e-fc23-4825-9f75-b6e229e60974 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:59.442373 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-84e8508e-fc23-4825-9f75-b6e229e60974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:59.460035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c84344-5fc0-4331-baa2-604f2bd8cadb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:59.461537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c84344-5fc0-4331-baa2-604f2bd8cadb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:59.485878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-01c84344-5fc0-4331-baa2-604f2bd8cadb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:59.485878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:59.485878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:59.485878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:59.485878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:59.485878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:59.485878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:59.485878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:59.485878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:59.485878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:59.485878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:59.485878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:59.485878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:29:59.485878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:29:59.485878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:59.486851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:59.487715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:29:59.487715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:29:59.487715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:29:59.487715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:29:59.489980 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 362/706] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:29:59.495246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c84344-5fc0-4331-baa2-604f2bd8cadb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:59.576687 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 345/707] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:59.607640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8508e-fc23-4825-9f75-b6e229e60974 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:59.737724 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c84344-5fc0-4331-baa2-604f2bd8cadb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:59.783649 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b07bf-21bd-4efa-85a2-8ce85e9c61a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:59.784615 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b07bf-21bd-4efa-85a2-8ce85e9c61a8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:59.784898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b07bf-21bd-4efa-85a2-8ce85e9c61a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:59.785173 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b07bf-21bd-4efa-85a2-8ce85e9c61a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:59.786389 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b07bf-21bd-4efa-85a2-8ce85e9c61a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:29:59.786699 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b07bf-21bd-4efa-85a2-8ce85e9c61a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:59.788542 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b07bf-21bd-4efa-85a2-8ce85e9c61a8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:59.796619 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8508e-fc23-4825-9f75-b6e229e60974 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:59.804099 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 363/708] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:29:59.805569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aa846-c334-42e4-afea-06b53c41ee68 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:59.805859 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aa846-c334-42e4-afea-06b53c41ee68 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:59.806132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aa846-c334-42e4-afea-06b53c41ee68 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:59.812544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 364/709] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:29:59.813774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aa846-c334-42e4-afea-06b53c41ee68 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:59.857108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef278b1-2972-4014-9416-d5e111a37569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:59.859257 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef278b1-2972-4014-9416-d5e111a37569 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:59.859636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef278b1-2972-4014-9416-d5e111a37569 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:59.859999 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef278b1-2972-4014-9416-d5e111a37569 None admin] PATH_INFO: `/v3/services/network` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:59.860945 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef278b1-2972-4014-9416-d5e111a37569 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:59.862416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef278b1-2972-4014-9416-d5e111a37569 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-bef278b1-2972-4014-9416-d5e111a37569 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:29:59.876364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:29:59.877424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:29:59.877424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:29:59.877424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:29:59.877424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:29:59.877424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:29:59.877424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:29:59.877424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:29:59.877424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:29:59.877424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:29:59.877424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:29:59.877424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:29:59.877424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:29:59.877424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:29:59.877424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:29:59.877424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:29:59.877424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:29:59.878505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:29:59.878505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:29:59.878505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:29:59.878505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:29:59.878505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:29:59.878505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:29:59.878505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:29:59.878505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:29:59.878505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:29:59.878505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:29:59.878505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:29:59.878505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:29:59.878505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:29:59.878505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:29:59.878505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 346/710] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:29:59 2022] GET /identity/v3/services/network => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:29:59.880365 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1705a-04f4-43c1-831f-cd4a037e7013 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:59.880735 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1705a-04f4-43c1-831f-cd4a037e7013 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:59.881080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1705a-04f4-43c1-831f-cd4a037e7013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:59.910095 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a7f1705a-04f4-43c1-831f-cd4a037e7013 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:29:59.911443 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a7f1705a-04f4-43c1-831f-cd4a037e7013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:29:59.948782 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aa846-c334-42e4-afea-06b53c41ee68 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:29:59.985597 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611eee4-2fe6-4e43-a5c4-36496e9d098f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:29:59.986391 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611eee4-2fe6-4e43-a5c4-36496e9d098f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:29:59.986671 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611eee4-2fe6-4e43-a5c4-36496e9d098f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:29:59.986943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611eee4-2fe6-4e43-a5c4-36496e9d098f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:29:59.992745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 347/711] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:29:59.993608 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1705a-04f4-43c1-831f-cd4a037e7013 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:29:59.994465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611eee4-2fe6-4e43-a5c4-36496e9d098f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:29:59.995928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611eee4-2fe6-4e43-a5c4-36496e9d098f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:00.010900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-e611eee4-2fe6-4e43-a5c4-36496e9d098f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:30:00.010900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:00.010900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:00.010900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:00.010900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:00.010900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:00.010900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:00.010900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:00.010900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:00.010900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:00.010900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:00.010900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:00.010900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:30:00.010900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:30:00.010900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:30:00.010900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:00.011952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:00.013198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:00.013198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:00.013198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:30:00.013198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:30:00.013198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:30:00.013198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:30:00.013198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:30:00.013198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:30:00.013198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:30:00.013198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:00.013198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 365/712] 10.222.0.81 () {56 vars in 1093 bytes} [Wed May 4 17:29:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:00.021632 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611eee4-2fe6-4e43-a5c4-36496e9d098f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:00.120578 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1705a-04f4-43c1-831f-cd4a037e7013 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:00.138288 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611eee4-2fe6-4e43-a5c4-36496e9d098f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:00.168199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3e66b-ab45-43e4-8b82-c81509149089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:00.168927 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3e66b-ab45-43e4-8b82-c81509149089 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:00.169207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3e66b-ab45-43e4-8b82-c81509149089 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:00.169479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3e66b-ab45-43e4-8b82-c81509149089 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:00.171053 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3e66b-ab45-43e4-8b82-c81509149089 None admin] RBAC: Adding query filter params (name=network) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:00.171360 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3e66b-ab45-43e4-8b82-c81509149089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:00.172792 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3e66b-ab45-43e4-8b82-c81509149089 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:00.177855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 348/713] 10.222.0.81 () {56 vars in 1112 bytes} [Wed May 4 17:29:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:00.178967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3e66b-ab45-43e4-8b82-c81509149089 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:00.195836 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab1fa0-fc93-45e3-ad05-c45dee9fa906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:00.197162 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab1fa0-fc93-45e3-ad05-c45dee9fa906 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:00.197588 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab1fa0-fc93-45e3-ad05-c45dee9fa906 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:00.197862 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab1fa0-fc93-45e3-ad05-c45dee9fa906 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:00.198887 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab1fa0-fc93-45e3-ad05-c45dee9fa906 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:00.199191 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab1fa0-fc93-45e3-ad05-c45dee9fa906 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:00.204065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab1fa0-fc93-45e3-ad05-c45dee9fa906 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:00.236977 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 366/714] 10.222.0.81 () {56 vars in 1133 bytes} [Wed May 4 17:30:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:00.238456 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab1fa0-fc93-45e3-ad05-c45dee9fa906 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:00.321592 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3e66b-ab45-43e4-8b82-c81509149089 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:00.357534 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004acdd-8d9d-481a-8a9d-ac47ee2e5387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:00.358358 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004acdd-8d9d-481a-8a9d-ac47ee2e5387 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:00.358686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004acdd-8d9d-481a-8a9d-ac47ee2e5387 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:00.358914 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004acdd-8d9d-481a-8a9d-ac47ee2e5387 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:00.362432 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab1fa0-fc93-45e3-ad05-c45dee9fa906 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:00.370543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004acdd-8d9d-481a-8a9d-ac47ee2e5387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:00.379696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-1004acdd-8d9d-481a-8a9d-ac47ee2e5387 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:30:00.379696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:00.379696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:00.379696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:00.379696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:00.379696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:00.379696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:00.379696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:00.379696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:00.379696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:00.379696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:00.379696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:00.379696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:00.379696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:00.379696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:00.379696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:00.380856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:00.380856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:00.380856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:00.380856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:00.380856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:00.380856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:00.380856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:00.380856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:00.380856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:00.380856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:00.380856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:00.380856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:00.380856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:00.380856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:00.380856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:00.380856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:00.381674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:00.381674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:00.381674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:00.381674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:00.381674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:00.381674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:00.381674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:00.381674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:00.381674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:00.381674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:00.381674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:30:00.381674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:00.381674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 349/715] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:30:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:00.382367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004acdd-8d9d-481a-8a9d-ac47ee2e5387 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:00.409340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22944902-8700-4764-bf09-9062c6a7d7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:00.410480 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22944902-8700-4764-bf09-9062c6a7d7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:00.410760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22944902-8700-4764-bf09-9062c6a7d7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:00.411030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22944902-8700-4764-bf09-9062c6a7d7b5 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:00.411742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22944902-8700-4764-bf09-9062c6a7d7b5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:00.412042 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22944902-8700-4764-bf09-9062c6a7d7b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:00.413468 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22944902-8700-4764-bf09-9062c6a7d7b5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:00.419212 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 367/716] 10.222.0.81 () {56 vars in 1112 bytes} [Wed May 4 17:30:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:00.421837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de0c23-6576-484e-9ebd-9e3894debb98 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:00.421837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de0c23-6576-484e-9ebd-9e3894debb98 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:00.422074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de0c23-6576-484e-9ebd-9e3894debb98 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:00.423615 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 368/717] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:00.424261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de0c23-6576-484e-9ebd-9e3894debb98 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:00.509898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004acdd-8d9d-481a-8a9d-ac47ee2e5387 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:00.555008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56332d5e-b4ef-4845-815e-737ab1db7773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:00.556006 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56332d5e-b4ef-4845-815e-737ab1db7773 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:00.556635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56332d5e-b4ef-4845-815e-737ab1db7773 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:00.557235 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56332d5e-b4ef-4845-815e-737ab1db7773 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:00.582905 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de0c23-6576-484e-9ebd-9e3894debb98 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:00.629203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f873bb-7bbb-4056-8b20-cce6921095a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:00.630051 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f873bb-7bbb-4056-8b20-cce6921095a3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:00.630702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f873bb-7bbb-4056-8b20-cce6921095a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:00.630981 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f873bb-7bbb-4056-8b20-cce6921095a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:00.631740 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f873bb-7bbb-4056-8b20-cce6921095a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:00.632041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f873bb-7bbb-4056-8b20-cce6921095a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:00.633517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f873bb-7bbb-4056-8b20-cce6921095a3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:00.643276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 369/718] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:30:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:00.644645 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ed433-7269-4766-9aeb-0dfaf279acb8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:00.644889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56332d5e-b4ef-4845-815e-737ab1db7773 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:00.645019 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ed433-7269-4766-9aeb-0dfaf279acb8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:00.645187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ed433-7269-4766-9aeb-0dfaf279acb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:00.646351 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56332d5e-b4ef-4845-815e-737ab1db7773 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:00.668072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-098ed433-7269-4766-9aeb-0dfaf279acb8 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:00.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-098ed433-7269-4766-9aeb-0dfaf279acb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:00.753184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 370/719] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:30:00.760593 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ed433-7269-4766-9aeb-0dfaf279acb8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:00.773511 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 350/720] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:30:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:30:00.781699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56332d5e-b4ef-4845-815e-737ab1db7773 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:00.897594 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56332d5e-b4ef-4845-815e-737ab1db7773 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:00.903296 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ed433-7269-4766-9aeb-0dfaf279acb8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:00.936134 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78450d9d-38f3-4773-8ac6-cd3ee7226da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:00.936963 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78450d9d-38f3-4773-8ac6-cd3ee7226da3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:00.937245 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78450d9d-38f3-4773-8ac6-cd3ee7226da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:00.937519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78450d9d-38f3-4773-8ac6-cd3ee7226da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:00.944159 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c87f76-17e8-4b56-b51c-a1a33e616156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:00.945085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c87f76-17e8-4b56-b51c-a1a33e616156 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:00.945426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c87f76-17e8-4b56-b51c-a1a33e616156 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:00.945782 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c87f76-17e8-4b56-b51c-a1a33e616156 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:00.948268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78450d9d-38f3-4773-8ac6-cd3ee7226da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:00.949815 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78450d9d-38f3-4773-8ac6-cd3ee7226da3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:00.958258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c87f76-17e8-4b56-b51c-a1a33e616156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:00.959835 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c87f76-17e8-4b56-b51c-a1a33e616156 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:00.968933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-78450d9d-38f3-4773-8ac6-cd3ee7226da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:00.968933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:00.968933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:00.968933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:00.968933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:00.968933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:00.968933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:00.968933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:00.968933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:00.968933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:00.968933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:00.968933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:00.968933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:00.968933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:00.968933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:00.970066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:00.971004 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:00.971004 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:00.971004 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:00.971004 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:00.974846 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 351/721] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:00.975755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78450d9d-38f3-4773-8ac6-cd3ee7226da3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:00.979617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-98c87f76-17e8-4b56-b51c-a1a33e616156 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:00.979617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:00.979617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:00.979617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:00.979617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:00.979617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:00.979617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:00.979617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:00.979617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:00.979617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:00.979617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:00.979617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:00.979617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:00.979617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:00.979617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:00.981679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:00.984394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:00.984394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:00.984394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:00.984394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:00.984394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 371/722] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:00.984394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c87f76-17e8-4b56-b51c-a1a33e616156 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:01.099689 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78450d9d-38f3-4773-8ac6-cd3ee7226da3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:01.104492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c87f76-17e8-4b56-b51c-a1a33e616156 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:01.139566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc4388-b89d-4f62-939f-d6abf9a802a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:01.140569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc4388-b89d-4f62-939f-d6abf9a802a1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:01.140852 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc4388-b89d-4f62-939f-d6abf9a802a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:01.141121 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc4388-b89d-4f62-939f-d6abf9a802a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:01.142261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dff1d-3aa6-463b-9022-8f5a7958a80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:01.143069 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dff1d-3aa6-463b-9022-8f5a7958a80e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:01.143347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dff1d-3aa6-463b-9022-8f5a7958a80e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:01.143617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dff1d-3aa6-463b-9022-8f5a7958a80e None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:01.144345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dff1d-3aa6-463b-9022-8f5a7958a80e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:01.144733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dff1d-3aa6-463b-9022-8f5a7958a80e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:01.146155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dff1d-3aa6-463b-9022-8f5a7958a80e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:01.152655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc4388-b89d-4f62-939f-d6abf9a802a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:01.161800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e0dc4388-b89d-4f62-939f-d6abf9a802a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:30:01.161800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:01.161800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:01.161800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:01.161800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:01.161800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:01.161800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:01.161800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:01.161800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:01.161800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:01.161800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:01.161800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:01.161800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:01.161800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:01.161800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:01.161800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:01.163980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:01.163980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:01.163980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:01.163980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:01.163980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:01.163980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:01.163980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:01.163980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:01.163980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:01.163980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:01.163980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:01.163980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:01.163980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:01.163980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:01.163980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:01.163980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:01.166000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:01.166000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:01.166000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:01.166000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:01.166000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:01.166000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:01.166000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:01.166000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:01.166000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:01.166000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:01.166000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:30:01.166000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:01.167518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 372/723] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:01.167518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dff1d-3aa6-463b-9022-8f5a7958a80e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:01.176468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 352/724] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:30:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:01.176468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc4388-b89d-4f62-939f-d6abf9a802a1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:01.270054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dff1d-3aa6-463b-9022-8f5a7958a80e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:01.282326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc4388-b89d-4f62-939f-d6abf9a802a1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:01.309718 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb13fc8-4f5b-48e2-95bc-f484f9fde361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:01.310577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb13fc8-4f5b-48e2-95bc-f484f9fde361 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:01.310903 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb13fc8-4f5b-48e2-95bc-f484f9fde361 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:01.311177 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb13fc8-4f5b-48e2-95bc-f484f9fde361 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:01.311929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb13fc8-4f5b-48e2-95bc-f484f9fde361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:01.312278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb13fc8-4f5b-48e2-95bc-f484f9fde361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:01.313760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb13fc8-4f5b-48e2-95bc-f484f9fde361 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:01.327201 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8b42a-cc4b-46e8-9127-da385d85ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:01.328214 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8b42a-cc4b-46e8-9127-da385d85ce44 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:01.332540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8b42a-cc4b-46e8-9127-da385d85ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:01.332540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8b42a-cc4b-46e8-9127-da385d85ce44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:01.336540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8b42a-cc4b-46e8-9127-da385d85ce44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:01.337994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8b42a-cc4b-46e8-9127-da385d85ce44 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:01.344206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 373/725] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:01.345234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb13fc8-4f5b-48e2-95bc-f484f9fde361 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:01.356974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4ca8b42a-cc4b-46e8-9127-da385d85ce44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:01.356974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:01.356974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:01.356974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:01.356974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:01.356974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:01.356974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:01.356974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:01.356974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:01.356974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:01.356974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:01.356974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:01.356974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:30:01.356974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:30:01.356974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:01.359707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:01.361838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:30:01.361838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:30:01.361838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:30:01.361838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:30:01.361838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:30:01.361838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:30:01.361838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:01.361838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:01.361838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 353/726] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:01.361838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8b42a-cc4b-46e8-9127-da385d85ce44 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:01.459961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb13fc8-4f5b-48e2-95bc-f484f9fde361 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:01.476803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8b42a-cc4b-46e8-9127-da385d85ce44 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:01.496527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8120898-4f93-4acf-8024-6f1188dee957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:01.497191 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8120898-4f93-4acf-8024-6f1188dee957 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:01.497465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8120898-4f93-4acf-8024-6f1188dee957 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:01.498279 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8120898-4f93-4acf-8024-6f1188dee957 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:01.499023 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8120898-4f93-4acf-8024-6f1188dee957 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:01.499315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8120898-4f93-4acf-8024-6f1188dee957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:01.500962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8120898-4f93-4acf-8024-6f1188dee957 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:01.509284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 374/727] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:30:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:01.512478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8120898-4f93-4acf-8024-6f1188dee957 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:01.518207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3f7a4-7137-477c-bdf7-ca15f20407c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:01.519034 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3f7a4-7137-477c-bdf7-ca15f20407c5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:01.519361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3f7a4-7137-477c-bdf7-ca15f20407c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:01.519817 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3f7a4-7137-477c-bdf7-ca15f20407c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:01.528196 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3f7a4-7137-477c-bdf7-ca15f20407c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:01.530586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3f7a4-7137-477c-bdf7-ca15f20407c5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:01.546486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-13b3f7a4-7137-477c-bdf7-ca15f20407c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:30:01.546486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:01.546486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:01.546486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:01.546486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:01.546486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:01.546486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:01.546486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:01.546486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:01.546486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:01.546486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:01.546486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:01.546486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:30:01.546486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:30:01.546486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:30:01.546486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:01.547490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:01.548490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:01.548490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:01.548490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:30:01.548490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:30:01.548490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:30:01.548490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:30:01.548490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:30:01.548490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:30:01.548490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:30:01.548490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:01.548490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 354/728] 10.222.0.81 () {56 vars in 1117 bytes} [Wed May 4 17:30:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:01.549589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a4fbc-b065-41d2-bf09-35a56e584a2f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:01.549589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a4fbc-b065-41d2-bf09-35a56e584a2f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:01.549755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a4fbc-b065-41d2-bf09-35a56e584a2f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:01.552631 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 355/729] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:01.552631 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a4fbc-b065-41d2-bf09-35a56e584a2f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:01.630716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8120898-4f93-4acf-8024-6f1188dee957 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:01.665021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a4fbc-b065-41d2-bf09-35a56e584a2f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:01.670349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bfab4-4158-4e79-8439-e4acbb6b9b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:01.671010 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bfab4-4158-4e79-8439-e4acbb6b9b5c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:01.671289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bfab4-4158-4e79-8439-e4acbb6b9b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:01.671562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bfab4-4158-4e79-8439-e4acbb6b9b5c None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:01.672501 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bfab4-4158-4e79-8439-e4acbb6b9b5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:01.672709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bfab4-4158-4e79-8439-e4acbb6b9b5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:01.674217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bfab4-4158-4e79-8439-e4acbb6b9b5c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:01.688832 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 375/730] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:30:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:01.694889 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bfab4-4158-4e79-8439-e4acbb6b9b5c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:01.710279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7961a0-6caf-4ba1-9a10-5ef2a1e07111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:01.710973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7961a0-6caf-4ba1-9a10-5ef2a1e07111 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:01.711249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7961a0-6caf-4ba1-9a10-5ef2a1e07111 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:01.711517 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7961a0-6caf-4ba1-9a10-5ef2a1e07111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:01.723138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7961a0-6caf-4ba1-9a10-5ef2a1e07111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:01.724725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7961a0-6caf-4ba1-9a10-5ef2a1e07111 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:01.743870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7a7961a0-6caf-4ba1-9a10-5ef2a1e07111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:01.743870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:01.743870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:01.743870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:01.743870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:01.743870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:01.743870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:01.743870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:01.743870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:01.743870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:01.743870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:01.743870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:01.743870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:01.743870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:01.743870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:01.744883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:01.745873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:01.745873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:01.745873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:01.745873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:01.745873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 356/731] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:01.746680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbecf2a-9fb1-4bbd-b741-34993ef2fa25 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:01.746680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbecf2a-9fb1-4bbd-b741-34993ef2fa25 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:01.746904 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbecf2a-9fb1-4bbd-b741-34993ef2fa25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:01.764986 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4cbecf2a-9fb1-4bbd-b741-34993ef2fa25 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:01.766200 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4cbecf2a-9fb1-4bbd-b741-34993ef2fa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:01.804341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bfab4-4158-4e79-8439-e4acbb6b9b5c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:01.847894 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 357/732] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:30:01.848860 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbecf2a-9fb1-4bbd-b741-34993ef2fa25 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:01.868867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ab8c2-b166-496f-abad-b797f1b7c409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:01.869544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ab8c2-b166-496f-abad-b797f1b7c409 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:01.869819 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ab8c2-b166-496f-abad-b797f1b7c409 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:01.870085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ab8c2-b166-496f-abad-b797f1b7c409 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:01.870928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ab8c2-b166-496f-abad-b797f1b7c409 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:01.871223 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ab8c2-b166-496f-abad-b797f1b7c409 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:01.872695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ab8c2-b166-496f-abad-b797f1b7c409 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:01.895762 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 376/733] 10.222.0.81 () {56 vars in 1149 bytes} [Wed May 4 17:30:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:01.895762 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ab8c2-b166-496f-abad-b797f1b7c409 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:01.958656 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbecf2a-9fb1-4bbd-b741-34993ef2fa25 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:01.994499 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9925d82-a4c1-49ab-a391-b3757d226ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:01.995081 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925d82-a4c1-49ab-a391-b3757d226ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:01.995367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925d82-a4c1-49ab-a391-b3757d226ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:01.995658 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925d82-a4c1-49ab-a391-b3757d226ab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:01.996560 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9925d82-a4c1-49ab-a391-b3757d226ab3 None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=d4a073d8f47a485cbb22db01530f3b37) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:01.996879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9925d82-a4c1-49ab-a391-b3757d226ab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:01.999269 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9925d82-a4c1-49ab-a391-b3757d226ab3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:02.016784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 358/734] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:30:01 2022] GET /identity/v3/role_assignments?user.id=d4a073d8f47a485cbb22db01530f3b37&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:02.016987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ab8c2-b166-496f-abad-b797f1b7c409 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:02.017071 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9925d82-a4c1-49ab-a391-b3757d226ab3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:02.050623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fd300-9c73-4457-bd9d-e068ad2eab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:02.051298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fd300-9c73-4457-bd9d-e068ad2eab13 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:02.051573 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fd300-9c73-4457-bd9d-e068ad2eab13 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:02.051845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fd300-9c73-4457-bd9d-e068ad2eab13 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:02.052620 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fd300-9c73-4457-bd9d-e068ad2eab13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:02.052924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fd300-9c73-4457-bd9d-e068ad2eab13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:02.054945 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fd300-9c73-4457-bd9d-e068ad2eab13 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:02.068543 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 377/735] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:02.069590 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fd300-9c73-4457-bd9d-e068ad2eab13 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:02.151339 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9925d82-a4c1-49ab-a391-b3757d226ab3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:02.195799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fd300-9c73-4457-bd9d-e068ad2eab13 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:02.200268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0274b4a-4ad9-4f78-8bba-ef09214d7b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:02.201794 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0274b4a-4ad9-4f78-8bba-ef09214d7b9d None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:02.202198 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0274b4a-4ad9-4f78-8bba-ef09214d7b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:02.202571 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0274b4a-4ad9-4f78-8bba-ef09214d7b9d None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:02.203429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0274b4a-4ad9-4f78-8bba-ef09214d7b9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:02.205184 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0274b4a-4ad9-4f78-8bba-ef09214d7b9d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:02.233021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b078d1-ec4e-4735-be69-7162ff354282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:02.233864 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b078d1-ec4e-4735-be69-7162ff354282 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:02.234145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b078d1-ec4e-4735-be69-7162ff354282 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:02.234425 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b078d1-ec4e-4735-be69-7162ff354282 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:02.311584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b078d1-ec4e-4735-be69-7162ff354282 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:02.313020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b078d1-ec4e-4735-be69-7162ff354282 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:02.358829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 359/736] 10.222.0.81 () {60 vars in 1141 bytes} [Wed May 4 17:30:02 2022] POST /identity/v3/services => generated 251 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:30:02.360093 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0274b4a-4ad9-4f78-8bba-ef09214d7b9d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:02.456602 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 378/737] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:30:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:30:02.465549 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b078d1-ec4e-4735-be69-7162ff354282 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:02.500208 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0274b4a-4ad9-4f78-8bba-ef09214d7b9d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:02.544826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e41a8a-8327-4a1b-875a-5de49cd70550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:02.546174 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e41a8a-8327-4a1b-875a-5de49cd70550 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:02.546701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e41a8a-8327-4a1b-875a-5de49cd70550 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:02.547264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e41a8a-8327-4a1b-875a-5de49cd70550 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:02.556932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e41a8a-8327-4a1b-875a-5de49cd70550 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:02.558826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e41a8a-8327-4a1b-875a-5de49cd70550 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:02.579305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-88e41a8a-8327-4a1b-875a-5de49cd70550 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 17:30:02.579305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:02.579305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:02.579305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:02.579305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:02.579305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:02.579305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:02.579305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:02.579305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:02.579305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:02.579305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:02.579305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:02.579305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:30:02.579305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:30:02.579305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:30:02.579305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:02.580308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:02.581308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:02.581308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:02.581308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:30:02.581308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:30:02.581308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:30:02.581308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:30:02.581308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:30:02.581308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:30:02.581308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 17:30:02.581308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:02.585015 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 360/738] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:30:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:02.592595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e41a8a-8327-4a1b-875a-5de49cd70550 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:02.661440 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b078d1-ec4e-4735-be69-7162ff354282 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:02.737932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e41a8a-8327-4a1b-875a-5de49cd70550 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:02.794053 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f275e01-b22a-4b6d-9616-5fc93cf56425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:02.794752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f275e01-b22a-4b6d-9616-5fc93cf56425 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:02.795061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f275e01-b22a-4b6d-9616-5fc93cf56425 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:02.795318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f275e01-b22a-4b6d-9616-5fc93cf56425 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:02.796185 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f275e01-b22a-4b6d-9616-5fc93cf56425 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:02.796536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f275e01-b22a-4b6d-9616-5fc93cf56425 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:02.798012 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f275e01-b22a-4b6d-9616-5fc93cf56425 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:02.818153 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 361/739] 10.222.0.81 () {56 vars in 1135 bytes} [Wed May 4 17:30:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:02.824621 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f275e01-b22a-4b6d-9616-5fc93cf56425 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:02.866462 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcb364-539a-46e0-a0f3-e6cdaa77d1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:02.867405 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcb364-539a-46e0-a0f3-e6cdaa77d1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:02.867772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcb364-539a-46e0-a0f3-e6cdaa77d1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:02.868140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcb364-539a-46e0-a0f3-e6cdaa77d1a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:02.884056 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcb364-539a-46e0-a0f3-e6cdaa77d1a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:02.885881 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcb364-539a-46e0-a0f3-e6cdaa77d1a8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:02.933139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-dcbcb364-539a-46e0-a0f3-e6cdaa77d1a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:02.933139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:02.933139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:02.933139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:02.933139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:02.933139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:02.933139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:02.933139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:02.933139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:02.933139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:02.933139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:02.933139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:02.933139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:02.933139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:02.933139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:02.934250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:02.935857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:02.935857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:02.935857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:02.935857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:02.937595 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 379/740] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 473 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:02.943196 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcb364-539a-46e0-a0f3-e6cdaa77d1a8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:02.960525 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f275e01-b22a-4b6d-9616-5fc93cf56425 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:03.005627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df619b-95cc-4c3f-a9de-108b13845bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:03.006299 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df619b-95cc-4c3f-a9de-108b13845bdc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:03.006583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df619b-95cc-4c3f-a9de-108b13845bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:03.006860 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df619b-95cc-4c3f-a9de-108b13845bdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:03.073254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcb364-539a-46e0-a0f3-e6cdaa77d1a8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:03.115576 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16023280-a0a6-43ac-8cea-a80757d63f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:03.118758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16023280-a0a6-43ac-8cea-a80757d63f09 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:03.119065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16023280-a0a6-43ac-8cea-a80757d63f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:03.119434 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16023280-a0a6-43ac-8cea-a80757d63f09 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:03.120261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16023280-a0a6-43ac-8cea-a80757d63f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:03.120684 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16023280-a0a6-43ac-8cea-a80757d63f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:03.123690 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16023280-a0a6-43ac-8cea-a80757d63f09 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:03.129329 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df619b-95cc-4c3f-a9de-108b13845bdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:03.130884 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df619b-95cc-4c3f-a9de-108b13845bdc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:03.142966 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 380/741] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:03.146163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b25c0-0da5-4d36-8339-2b9d27fbd9ab None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:03.146576 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b25c0-0da5-4d36-8339-2b9d27fbd9ab None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:03.146955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b25c0-0da5-4d36-8339-2b9d27fbd9ab None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:03.149520 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 381/742] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:03.150394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b25c0-0da5-4d36-8339-2b9d27fbd9ab None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:03.277419 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 362/743] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:30:02 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 17:30:03.280849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e40825-f042-4f21-af77-9f28510bb468 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:03.281714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e40825-f042-4f21-af77-9f28510bb468 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:03.282732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e40825-f042-4f21-af77-9f28510bb468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:03.283500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b25c0-0da5-4d36-8339-2b9d27fbd9ab None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:03.306174 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-72e40825-f042-4f21-af77-9f28510bb468 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:03.307641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-72e40825-f042-4f21-af77-9f28510bb468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:03.325386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2540f8-59f1-4037-9d5a-888de13fe577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:03.325386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2540f8-59f1-4037-9d5a-888de13fe577 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:03.325386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2540f8-59f1-4037-9d5a-888de13fe577 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:03.325386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2540f8-59f1-4037-9d5a-888de13fe577 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:03.335165 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2540f8-59f1-4037-9d5a-888de13fe577 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:03.336817 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2540f8-59f1-4037-9d5a-888de13fe577 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:03.358105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-cc2540f8-59f1-4037-9d5a-888de13fe577 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:03.358105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:03.358105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:03.358105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:03.358105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:03.358105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:03.358105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:03.358105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:03.358105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:03.358105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:03.358105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:03.358105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:03.358105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:30:03.358105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:30:03.358105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:03.359226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:03.360331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:30:03.360331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:30:03.360331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:30:03.360331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:30:03.360331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:30:03.360331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:30:03.360331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:03.360331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:03.362379 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 382/744] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:03.364369 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2540f8-59f1-4037-9d5a-888de13fe577 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:03.402651 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 363/745] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 17:30:03.403935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e40825-f042-4f21-af77-9f28510bb468 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:03.488893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2540f8-59f1-4037-9d5a-888de13fe577 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:03.531171 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf33cf-332a-4257-83d2-54cef539dc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:03.532067 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf33cf-332a-4257-83d2-54cef539dc22 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:03.532418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf33cf-332a-4257-83d2-54cef539dc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:03.532804 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf33cf-332a-4257-83d2-54cef539dc22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:03.534836 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e40825-f042-4f21-af77-9f28510bb468 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:03.543414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf33cf-332a-4257-83d2-54cef539dc22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:03.545658 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf33cf-332a-4257-83d2-54cef539dc22 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:03.564521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-afaf33cf-332a-4257-83d2-54cef539dc22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:03.564521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:03.564521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:03.564521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:03.564521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:03.564521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:03.564521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:03.564521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:03.564521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:03.564521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:03.564521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:03.564521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:03.564521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:03.564521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:03.564521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:03.566181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:03.567929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:03.567929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:03.567929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:03.567929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:03.568820 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 383/746] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:03.570150 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf33cf-332a-4257-83d2-54cef539dc22 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:03.599049 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86f9dd-1617-40e0-b483-e569e9a5b379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:03.599721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86f9dd-1617-40e0-b483-e569e9a5b379 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:03.600010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86f9dd-1617-40e0-b483-e569e9a5b379 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:03.600287 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86f9dd-1617-40e0-b483-e569e9a5b379 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:03.601126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86f9dd-1617-40e0-b483-e569e9a5b379 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:03.601437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86f9dd-1617-40e0-b483-e569e9a5b379 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:03.602882 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86f9dd-1617-40e0-b483-e569e9a5b379 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:03.618154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 364/747] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:30:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:03.619105 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86f9dd-1617-40e0-b483-e569e9a5b379 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:03.705415 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf33cf-332a-4257-83d2-54cef539dc22 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:03.739761 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488f677-c7fb-45d9-a97c-cb9fd9ec3541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:03.740468 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488f677-c7fb-45d9-a97c-cb9fd9ec3541 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:03.740729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488f677-c7fb-45d9-a97c-cb9fd9ec3541 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:03.740999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488f677-c7fb-45d9-a97c-cb9fd9ec3541 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:03.741716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488f677-c7fb-45d9-a97c-cb9fd9ec3541 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:03.743137 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488f677-c7fb-45d9-a97c-cb9fd9ec3541 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:03.766257 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86f9dd-1617-40e0-b483-e569e9a5b379 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:03.805694 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 384/748] 10.222.0.81 () {60 vars in 1141 bytes} [Wed May 4 17:30:03 2022] POST /identity/v3/services => generated 240 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:30:03.806541 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488f677-c7fb-45d9-a97c-cb9fd9ec3541 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:03.820694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df3c91-fc57-44f6-82de-2e608b6cfd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:03.822954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df3c91-fc57-44f6-82de-2e608b6cfd5f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:03.823512 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df3c91-fc57-44f6-82de-2e608b6cfd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:03.824004 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df3c91-fc57-44f6-82de-2e608b6cfd5f None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:03.825205 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df3c91-fc57-44f6-82de-2e608b6cfd5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:03.826903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df3c91-fc57-44f6-82de-2e608b6cfd5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:03.829566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df3c91-fc57-44f6-82de-2e608b6cfd5f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:03.850324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 365/749] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:03.855463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df3c91-fc57-44f6-82de-2e608b6cfd5f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:03.941127 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488f677-c7fb-45d9-a97c-cb9fd9ec3541 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:03.979139 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df3c91-fc57-44f6-82de-2e608b6cfd5f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:03.988892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c25d4-53c5-4315-a2cd-70b0b2d3abef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:03.989892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c25d4-53c5-4315-a2cd-70b0b2d3abef None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:03.990350 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c25d4-53c5-4315-a2cd-70b0b2d3abef None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:03.990857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c25d4-53c5-4315-a2cd-70b0b2d3abef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:03.992225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c25d4-53c5-4315-a2cd-70b0b2d3abef None admin] RBAC: Adding query filter params (role.id=61d7286cc614424e9d7b8514b201ee21, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=ef7da67b09104f4991befeb14cd0581b) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:03.993033 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c25d4-53c5-4315-a2cd-70b0b2d3abef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:03.995244 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c25d4-53c5-4315-a2cd-70b0b2d3abef None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:04.004773 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 385/750] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:30:03 2022] GET /identity/v3/role_assignments?user.id=ef7da67b09104f4991befeb14cd0581b&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=61d7286cc614424e9d7b8514b201ee21 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:04.050175 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b6f32-3ff9-4e07-8759-8483e06f5f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:04.051033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b6f32-3ff9-4e07-8759-8483e06f5f74 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:04.051313 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b6f32-3ff9-4e07-8759-8483e06f5f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:04.051583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b6f32-3ff9-4e07-8759-8483e06f5f74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:04.066449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b6f32-3ff9-4e07-8759-8483e06f5f74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:04.067985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b6f32-3ff9-4e07-8759-8483e06f5f74 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:04.090064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-628b6f32-3ff9-4e07-8759-8483e06f5f74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:04.090064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:04.090064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:04.090064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:04.090064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:04.090064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:04.090064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:04.090064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:04.090064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:04.090064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:04.090064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:04.090064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:04.090064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:30:04.090064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:30:04.090064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:04.091064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:04.092809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:30:04.092809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:30:04.092809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:30:04.092809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:30:04.092809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:30:04.092809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:30:04.092809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:04.092809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:04.092809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 366/751] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:04.097527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c25d4-53c5-4315-a2cd-70b0b2d3abef None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:04.238371 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c25d4-53c5-4315-a2cd-70b0b2d3abef None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:04.279272 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b27a65-f872-4667-bbe8-8ead39ff77ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:04.279945 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b27a65-f872-4667-bbe8-8ead39ff77ac None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:04.280215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b27a65-f872-4667-bbe8-8ead39ff77ac None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:04.280507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b27a65-f872-4667-bbe8-8ead39ff77ac None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:04.281313 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b27a65-f872-4667-bbe8-8ead39ff77ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:04.281805 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b27a65-f872-4667-bbe8-8ead39ff77ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:04.283261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b27a65-f872-4667-bbe8-8ead39ff77ac None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:04.297132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 386/752] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:04.303612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b6f32-3ff9-4e07-8759-8483e06f5f74 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:04.432567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b6f32-3ff9-4e07-8759-8483e06f5f74 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:04.473330 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda0e78-22cc-4cb0-8af5-1927db210333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:04.474136 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda0e78-22cc-4cb0-8af5-1927db210333 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:04.474478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda0e78-22cc-4cb0-8af5-1927db210333 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:04.474818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda0e78-22cc-4cb0-8af5-1927db210333 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:04.475788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda0e78-22cc-4cb0-8af5-1927db210333 None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=382e84e110754effa5ffec950f7c1598) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:04.476158 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda0e78-22cc-4cb0-8af5-1927db210333 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:04.477681 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda0e78-22cc-4cb0-8af5-1927db210333 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:04.490469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 367/753] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:30:04 2022] GET /identity/v3/role_assignments?user.id=382e84e110754effa5ffec950f7c1598&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:04.791792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b27a7d-7296-4ba6-879e-8b9b11e2fa78 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:04.792119 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b27a7d-7296-4ba6-879e-8b9b11e2fa78 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:04.792350 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b27a7d-7296-4ba6-879e-8b9b11e2fa78 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:04.793962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 387/754] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:04.800729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dec397-5593-4a32-9f7c-2c82b0a02dec None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:04.801019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dec397-5593-4a32-9f7c-2c82b0a02dec None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:04.801296 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dec397-5593-4a32-9f7c-2c82b0a02dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:04.818756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-33dec397-5593-4a32-9f7c-2c82b0a02dec None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:04.819928 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-33dec397-5593-4a32-9f7c-2c82b0a02dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:04.890837 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 368/755] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:04.913315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b27a7d-7296-4ba6-879e-8b9b11e2fa78 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:05.038342 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b27a7d-7296-4ba6-879e-8b9b11e2fa78 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:05.079545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13975c-520b-430a-87f2-91e38188f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:05.080305 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13975c-520b-430a-87f2-91e38188f586 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:05.080610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13975c-520b-430a-87f2-91e38188f586 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:05.080892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13975c-520b-430a-87f2-91e38188f586 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:05.093568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13975c-520b-430a-87f2-91e38188f586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:05.101476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3f13975c-520b-430a-87f2-91e38188f586 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:30:05.101476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:05.101476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:05.101476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:05.101476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:05.101476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:05.101476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:05.101476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:05.101476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:05.101476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:05.101476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:05.101476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:05.101476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:05.101476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:05.101476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:05.101476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:05.102453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:05.102453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:05.102453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:05.102453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:05.102453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:05.102453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:05.102453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:05.102453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:05.102453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:05.102453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:05.102453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:05.102453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:05.102453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:05.102453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:05.102453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:05.102453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:05.103739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:05.103739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:05.103739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:05.103739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:05.103739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:05.103739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:05.103739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:05.103739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:05.103739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:05.103739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:05.103739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:30:05.103739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:05.103739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 388/756] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:30:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:05.110126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dec397-5593-4a32-9f7c-2c82b0a02dec None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:05.255485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dec397-5593-4a32-9f7c-2c82b0a02dec None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:05.303102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520f863-300c-466f-8263-bb6eba5f063c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:05.303779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520f863-300c-466f-8263-bb6eba5f063c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:05.304307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520f863-300c-466f-8263-bb6eba5f063c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:05.304307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520f863-300c-466f-8263-bb6eba5f063c None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:05.305089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520f863-300c-466f-8263-bb6eba5f063c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:05.305397 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520f863-300c-466f-8263-bb6eba5f063c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:05.306763 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520f863-300c-466f-8263-bb6eba5f063c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:05.319766 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 369/757] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:30:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:05.325664 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13975c-520b-430a-87f2-91e38188f586 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:05.441266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea266b7-298a-4720-815c-181c784031b0 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:05.441636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea266b7-298a-4720-815c-181c784031b0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:05.441844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea266b7-298a-4720-815c-181c784031b0 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:05.448634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 370/758] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:05.454049 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba19ce-89c7-41c0-b6f7-1b07237f83b0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:05.454341 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba19ce-89c7-41c0-b6f7-1b07237f83b0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:05.454622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba19ce-89c7-41c0-b6f7-1b07237f83b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:05.474893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13975c-520b-430a-87f2-91e38188f586 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:05.483377 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8fba19ce-89c7-41c0-b6f7-1b07237f83b0 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:05.488641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8fba19ce-89c7-41c0-b6f7-1b07237f83b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:05.514008 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbc335-3e47-4750-bdf4-c0e91bafb8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:05.515449 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbc335-3e47-4750-bdf4-c0e91bafb8ab None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:05.515956 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbc335-3e47-4750-bdf4-c0e91bafb8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:05.516432 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbc335-3e47-4750-bdf4-c0e91bafb8ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:05.529303 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbc335-3e47-4750-bdf4-c0e91bafb8ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:05.531090 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbc335-3e47-4750-bdf4-c0e91bafb8ab None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:05.550749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-dbdbc335-3e47-4750-bdf4-c0e91bafb8ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:05.550749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:05.550749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:05.550749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:05.550749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:05.550749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:05.550749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:05.550749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:05.550749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:05.550749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:05.550749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:05.550749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:05.550749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:05.550749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:05.550749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:05.551667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:05.552586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:05.552586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:05.552586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:05.552586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:05.555500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 389/759] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:05.561478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbc335-3e47-4750-bdf4-c0e91bafb8ab None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:05.636693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 371/760] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:30:05.682542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba19ce-89c7-41c0-b6f7-1b07237f83b0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:05.684160 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbc335-3e47-4750-bdf4-c0e91bafb8ab None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:05.720491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b7487-4305-4426-af57-db19e056db6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:05.721154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b7487-4305-4426-af57-db19e056db6b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:05.721434 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b7487-4305-4426-af57-db19e056db6b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:05.721703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b7487-4305-4426-af57-db19e056db6b None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:05.723858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b7487-4305-4426-af57-db19e056db6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:05.723858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b7487-4305-4426-af57-db19e056db6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:05.724550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b7487-4305-4426-af57-db19e056db6b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:05.738700 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 390/761] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:05.744430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b7487-4305-4426-af57-db19e056db6b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:05.815876 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba19ce-89c7-41c0-b6f7-1b07237f83b0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:05.850565 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d25615-3f90-4ad5-ae10-c58f2c0e9a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:05.851373 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d25615-3f90-4ad5-ae10-c58f2c0e9a42 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:05.851658 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d25615-3f90-4ad5-ae10-c58f2c0e9a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:05.851930 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d25615-3f90-4ad5-ae10-c58f2c0e9a42 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:05.852616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d25615-3f90-4ad5-ae10-c58f2c0e9a42 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:05.854037 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d25615-3f90-4ad5-ae10-c58f2c0e9a42 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:05.866634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-89d25615-3f90-4ad5-ae10-c58f2c0e9a42 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:30:05.866634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:05.866634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:05.866634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:05.866634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:05.866634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:05.866634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:05.866634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:05.866634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:30:05.866634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:05.866634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:05.866634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:05.866634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:05.866634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:05.866634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:05.866634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:05.867586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:05.867586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:05.867586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:05.867586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:05.867586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:05.867586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:05.867586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:05.867586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:05.867586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:05.867586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:05.867586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:05.867586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:05.867586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:05.867586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:05.867586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:05.867586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:05.868471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:05.868471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:05.868471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:05.868471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:05.868471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:05.868471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:05.868471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:05.868471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:05.868471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:05.868471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:05.868471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:05.868471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:05.868471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:05.868471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:30:05.868471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:05.872740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 372/762] 10.222.0.81 () {56 vars in 1129 bytes} [Wed May 4 17:30:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:05.875253 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d25615-3f90-4ad5-ae10-c58f2c0e9a42 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:05.909799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b7487-4305-4426-af57-db19e056db6b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:05.965175 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fb67d-1a9c-41fb-8fde-093b79bec15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:05.966580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fb67d-1a9c-41fb-8fde-093b79bec15a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:05.967393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fb67d-1a9c-41fb-8fde-093b79bec15a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:05.967393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fb67d-1a9c-41fb-8fde-093b79bec15a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:05.974936 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fb67d-1a9c-41fb-8fde-093b79bec15a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:05.976393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fb67d-1a9c-41fb-8fde-093b79bec15a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:05.978984 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d25615-3f90-4ad5-ae10-c58f2c0e9a42 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:06.007333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ac2fb67d-1a9c-41fb-8fde-093b79bec15a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:30:06.007333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:06.007333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:06.007333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:06.007333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:06.007333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:06.007333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:06.007333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:06.007333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:06.007333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:06.007333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:06.007333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:06.007333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:30:06.007333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:30:06.007333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:30:06.007333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:06.010354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:06.016995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:06.016995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:06.016995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:30:06.016995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:30:06.016995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:30:06.016995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:30:06.016995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:30:06.016995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:30:06.016995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:30:06.016995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:06.016995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 391/763] 10.222.0.81 () {56 vars in 1093 bytes} [Wed May 4 17:30:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:06.016995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fb67d-1a9c-41fb-8fde-093b79bec15a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:06.028227 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b27c0-ad11-45d5-afa6-ef0e82279c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:06.029426 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b27c0-ad11-45d5-afa6-ef0e82279c44 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:06.029712 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b27c0-ad11-45d5-afa6-ef0e82279c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:06.029994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b27c0-ad11-45d5-afa6-ef0e82279c44 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:06.030729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b27c0-ad11-45d5-afa6-ef0e82279c44 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:06.031141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b27c0-ad11-45d5-afa6-ef0e82279c44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:06.032396 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b27c0-ad11-45d5-afa6-ef0e82279c44 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:06.050561 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 373/764] 10.222.0.81 () {56 vars in 1124 bytes} [Wed May 4 17:30:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:06.056158 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b27c0-ad11-45d5-afa6-ef0e82279c44 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:06.123901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fb67d-1a9c-41fb-8fde-093b79bec15a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:06.159530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce980a-7e7a-46f1-9b7f-1da4b26133e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:06.160541 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce980a-7e7a-46f1-9b7f-1da4b26133e0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:06.160990 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce980a-7e7a-46f1-9b7f-1da4b26133e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:06.161405 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce980a-7e7a-46f1-9b7f-1da4b26133e0 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:06.162392 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce980a-7e7a-46f1-9b7f-1da4b26133e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:06.162844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce980a-7e7a-46f1-9b7f-1da4b26133e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:06.164538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce980a-7e7a-46f1-9b7f-1da4b26133e0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:06.183067 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 392/765] 10.222.0.81 () {56 vars in 1133 bytes} [Wed May 4 17:30:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:06.194799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce980a-7e7a-46f1-9b7f-1da4b26133e0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:06.306636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b27c0-ad11-45d5-afa6-ef0e82279c44 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:06.341581 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce980a-7e7a-46f1-9b7f-1da4b26133e0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:06.386985 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583606c-21c7-486a-95f2-ad45240fc3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:06.390084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583606c-21c7-486a-95f2-ad45240fc3ff None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:06.391756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583606c-21c7-486a-95f2-ad45240fc3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:06.392192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583606c-21c7-486a-95f2-ad45240fc3ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:06.404609 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583606c-21c7-486a-95f2-ad45240fc3ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:06.406515 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583606c-21c7-486a-95f2-ad45240fc3ff None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:06.412853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e58d87-9054-4bc8-aab3-8e546585c2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:06.414162 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e58d87-9054-4bc8-aab3-8e546585c2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:06.414558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e58d87-9054-4bc8-aab3-8e546585c2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:06.415313 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e58d87-9054-4bc8-aab3-8e546585c2e3 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:06.417354 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e58d87-9054-4bc8-aab3-8e546585c2e3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:06.417793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e58d87-9054-4bc8-aab3-8e546585c2e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:06.420516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e58d87-9054-4bc8-aab3-8e546585c2e3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:06.427816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-1583606c-21c7-486a-95f2-ad45240fc3ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:06.427816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:06.427816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:06.427816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:06.427816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:06.427816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:06.427816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:06.427816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:06.427816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:06.427816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:06.427816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:06.427816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:06.427816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:06.427816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:06.427816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:06.428922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:06.429787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:06.429787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:06.429787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:06.429787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:06.432413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 393/766] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:06.438521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 374/767] 10.222.0.81 () {56 vars in 1124 bytes} [Wed May 4 17:30:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:06.438784 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583606c-21c7-486a-95f2-ad45240fc3ff None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:06.448547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e58d87-9054-4bc8-aab3-8e546585c2e3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:06.556629 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583606c-21c7-486a-95f2-ad45240fc3ff None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:06.605138 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca0a9b-3d19-4cd0-8a79-f84c3af2743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:06.605830 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca0a9b-3d19-4cd0-8a79-f84c3af2743c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:06.606107 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca0a9b-3d19-4cd0-8a79-f84c3af2743c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:06.607222 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca0a9b-3d19-4cd0-8a79-f84c3af2743c None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:06.608245 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca0a9b-3d19-4cd0-8a79-f84c3af2743c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:06.608245 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca0a9b-3d19-4cd0-8a79-f84c3af2743c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:06.609587 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca0a9b-3d19-4cd0-8a79-f84c3af2743c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:06.640205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 394/768] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:06.646597 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca0a9b-3d19-4cd0-8a79-f84c3af2743c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:06.680219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e58d87-9054-4bc8-aab3-8e546585c2e3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:06.764486 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca0a9b-3d19-4cd0-8a79-f84c3af2743c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:06.766592 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90d9a2-a1d0-44b2-b4a5-06404209a022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:06.767508 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90d9a2-a1d0-44b2-b4a5-06404209a022 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:06.768028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90d9a2-a1d0-44b2-b4a5-06404209a022 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:06.768554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90d9a2-a1d0-44b2-b4a5-06404209a022 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:06.769626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90d9a2-a1d0-44b2-b4a5-06404209a022 None admin] RBAC: Adding query filter params (interface=public, service_id=30ec848981804447924c801dc1a7679e, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:06.770154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90d9a2-a1d0-44b2-b4a5-06404209a022 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:06.771967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90d9a2-a1d0-44b2-b4a5-06404209a022 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:06.792027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 375/769] 10.222.0.81 () {56 vars in 1251 bytes} [Wed May 4 17:30:06 2022] GET /identity/v3/endpoints?service_id=30ec848981804447924c801dc1a7679e&interface=public®ion_id=RegionOne => generated 194 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:06.798171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90d9a2-a1d0-44b2-b4a5-06404209a022 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:06.806128 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5b024-e920-4962-b666-3d2f986102d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:06.806949 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5b024-e920-4962-b666-3d2f986102d7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:06.807226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5b024-e920-4962-b666-3d2f986102d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:06.807500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5b024-e920-4962-b666-3d2f986102d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:06.818746 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5b024-e920-4962-b666-3d2f986102d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:06.821051 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5b024-e920-4962-b666-3d2f986102d7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:06.840902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ced5b024-e920-4962-b666-3d2f986102d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:06.840902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:06.840902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:06.840902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:06.840902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:06.840902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:06.840902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:06.840902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:06.840902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:06.840902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:06.840902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:06.840902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:06.840902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:30:06.840902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:30:06.840902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:06.841911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:06.842769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:30:06.842769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:30:06.842769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:30:06.842769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:30:06.842769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:30:06.842769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:30:06.842769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:06.842769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:06.842769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 395/770] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:06.849221 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b68ac-2542-415d-9b20-93641101d9f8 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:06.849221 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b68ac-2542-415d-9b20-93641101d9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:06.849221 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b68ac-2542-415d-9b20-93641101d9f8 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:06.849221 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 396/771] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:06.849221 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b68ac-2542-415d-9b20-93641101d9f8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:06.921811 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90d9a2-a1d0-44b2-b4a5-06404209a022 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:06.960048 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b68ac-2542-415d-9b20-93641101d9f8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:06.963470 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d71b4-53c6-4cdc-a14f-527b5404f9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:06.964138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d71b4-53c6-4cdc-a14f-527b5404f9df None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:06.964419 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d71b4-53c6-4cdc-a14f-527b5404f9df None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:06.964718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d71b4-53c6-4cdc-a14f-527b5404f9df None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:06.965412 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d71b4-53c6-4cdc-a14f-527b5404f9df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:06.967158 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d71b4-53c6-4cdc-a14f-527b5404f9df None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:06.984471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 376/772] 10.222.0.81 () {56 vars in 1087 bytes} [Wed May 4 17:30:06 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:06.984471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7b2ee-6130-47f6-b16e-d44d0eff1e7e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:06.984471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7b2ee-6130-47f6-b16e-d44d0eff1e7e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:06.984471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7b2ee-6130-47f6-b16e-d44d0eff1e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:06.994281 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c5b7b2ee-6130-47f6-b16e-d44d0eff1e7e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:06.995527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c5b7b2ee-6130-47f6-b16e-d44d0eff1e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:07.013639 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc3e2f-47a5-43c5-a172-b10e512bea45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:07.014957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc3e2f-47a5-43c5-a172-b10e512bea45 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:07.015615 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc3e2f-47a5-43c5-a172-b10e512bea45 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:07.016000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc3e2f-47a5-43c5-a172-b10e512bea45 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:07.017043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc3e2f-47a5-43c5-a172-b10e512bea45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:07.017687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc3e2f-47a5-43c5-a172-b10e512bea45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:07.019753 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc3e2f-47a5-43c5-a172-b10e512bea45 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:07.036928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 397/773] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:30:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:07.039622 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116be72b-4738-4245-9c2d-a8f6b8f8a038 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:07.040052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116be72b-4738-4245-9c2d-a8f6b8f8a038 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:07.040461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116be72b-4738-4245-9c2d-a8f6b8f8a038 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:07.042270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 398/774] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:07.043099 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116be72b-4738-4245-9c2d-a8f6b8f8a038 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:07.082910 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 377/775] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:07.084422 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ae74f-4408-44b4-a2fc-13763ffc6264 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:07.084709 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ae74f-4408-44b4-a2fc-13763ffc6264 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:07.085005 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ae74f-4408-44b4-a2fc-13763ffc6264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:07.105972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-199ae74f-4408-44b4-a2fc-13763ffc6264 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:07.107045 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-199ae74f-4408-44b4-a2fc-13763ffc6264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:07.183888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 378/776] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:07.188494 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ae74f-4408-44b4-a2fc-13763ffc6264 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:07.207907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116be72b-4738-4245-9c2d-a8f6b8f8a038 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:07.260312 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2f4e8-9c0f-422b-96ba-fb8a814eb536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:07.261574 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2f4e8-9c0f-422b-96ba-fb8a814eb536 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:07.262053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2f4e8-9c0f-422b-96ba-fb8a814eb536 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:07.262325 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2f4e8-9c0f-422b-96ba-fb8a814eb536 None admin] PATH_INFO: `/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/d4a073d8f47a485cbb22db01530f3b37/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:07.265076 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2f4e8-9c0f-422b-96ba-fb8a814eb536 None admin] RBAC: Authorizing `identity:create_grant(project_id=544a56c4b97e43aea9fbb003d80af8dc, user_id=d4a073d8f47a485cbb22db01530f3b37, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:07.266542 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2f4e8-9c0f-422b-96ba-fb8a814eb536 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:07.301027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ae74f-4408-44b4-a2fc-13763ffc6264 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:07.348363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33953b60-ade8-4b1a-a016-107785c8d940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:07.349209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33953b60-ade8-4b1a-a016-107785c8d940 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:07.349488 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33953b60-ade8-4b1a-a016-107785c8d940 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:07.349865 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33953b60-ade8-4b1a-a016-107785c8d940 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:07.362387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 399/777] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:30:07 2022] PUT /identity/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/d4a073d8f47a485cbb22db01530f3b37/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:30:07.362909 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33953b60-ade8-4b1a-a016-107785c8d940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:07.364028 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2f4e8-9c0f-422b-96ba-fb8a814eb536 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:07.372954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-33953b60-ade8-4b1a-a016-107785c8d940 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:30:07.372954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:07.372954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:07.372954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:07.372954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:07.372954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:07.372954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:07.372954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:07.372954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:07.372954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:07.372954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:07.372954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:07.372954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:07.372954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:07.372954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:07.372954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:07.374562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:07.374562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:07.374562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:07.374562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:07.374562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:07.374562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:07.374562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:07.374562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:07.374562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:07.374562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:07.374562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:07.374562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:07.374562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:07.374562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:07.374562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:07.374562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:07.375385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:07.375385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:07.375385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:07.375385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:07.375385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:07.375385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:07.375385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:07.375385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:07.375385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:07.375385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:07.375385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:30:07.375385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:07.378237 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 379/778] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:30:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:07.392760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33953b60-ade8-4b1a-a016-107785c8d940 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:07.544900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2f4e8-9c0f-422b-96ba-fb8a814eb536 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:07.595537 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33953b60-ade8-4b1a-a016-107785c8d940 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:07.599961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c93754-09ac-4524-806a-20b0b78ca498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:07.599961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c93754-09ac-4524-806a-20b0b78ca498 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:07.599961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c93754-09ac-4524-806a-20b0b78ca498 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:07.599961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c93754-09ac-4524-806a-20b0b78ca498 None admin] PATH_INFO: `/v3/services/network` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:07.600325 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c93754-09ac-4524-806a-20b0b78ca498 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:07.600325 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c93754-09ac-4524-806a-20b0b78ca498 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f2c93754-09ac-4524-806a-20b0b78ca498 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:07.627467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:07.628591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:07.628591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:07.628591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:07.628591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:07.628591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:07.628591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:07.628591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:07.628591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:07.628591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:07.628591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:07.628591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:07.628591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:07.628591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:07.628591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:07.628591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:07.628591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:07.629413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:07.629413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:07.629413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:07.629413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:07.629413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:07.629413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:07.629413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:07.629413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:07.629413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:07.629413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:07.629413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:07.629413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:07.629413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:30:07.629413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:07.642164 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 400/779] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:07 2022] GET /identity/v3/services/network => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:07.642164 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc63e7-c704-49c0-b6e5-3cb604321ac3 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:07.642441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc63e7-c704-49c0-b6e5-3cb604321ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:07.642681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc63e7-c704-49c0-b6e5-3cb604321ac3 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:07.648472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 401/780] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:07.652084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc63e7-c704-49c0-b6e5-3cb604321ac3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:07.680958 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94244a5d-578f-41e0-8584-09db71b08c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:07.682447 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94244a5d-578f-41e0-8584-09db71b08c93 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:07.682808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94244a5d-578f-41e0-8584-09db71b08c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:07.683094 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94244a5d-578f-41e0-8584-09db71b08c93 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:07.683925 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94244a5d-578f-41e0-8584-09db71b08c93 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:07.684237 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94244a5d-578f-41e0-8584-09db71b08c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:07.687377 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94244a5d-578f-41e0-8584-09db71b08c93 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:07.701410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 380/781] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:30:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:07.702178 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3b24b-623d-4235-9ba7-89b95ee6a4ea None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:07.702471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3b24b-623d-4235-9ba7-89b95ee6a4ea None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:07.702749 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3b24b-623d-4235-9ba7-89b95ee6a4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:07.724669 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-67a3b24b-623d-4235-9ba7-89b95ee6a4ea None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:07.726169 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-67a3b24b-623d-4235-9ba7-89b95ee6a4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:07.824755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 381/782] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:07.824755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3b24b-623d-4235-9ba7-89b95ee6a4ea None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:07.887243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc63e7-c704-49c0-b6e5-3cb604321ac3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:07.963936 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95909cf-b1ac-46a7-be67-eb19d20a129f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:07.964883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95909cf-b1ac-46a7-be67-eb19d20a129f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:07.965308 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95909cf-b1ac-46a7-be67-eb19d20a129f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:07.966338 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95909cf-b1ac-46a7-be67-eb19d20a129f None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:07.967992 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95909cf-b1ac-46a7-be67-eb19d20a129f None admin] RBAC: Adding query filter params (name=network) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:07.968642 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95909cf-b1ac-46a7-be67-eb19d20a129f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:07.971310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95909cf-b1ac-46a7-be67-eb19d20a129f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:07.980348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 402/783] 10.222.0.81 () {56 vars in 1112 bytes} [Wed May 4 17:30:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:07.981576 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95909cf-b1ac-46a7-be67-eb19d20a129f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:07.990791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3b24b-623d-4235-9ba7-89b95ee6a4ea None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:08.050831 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcd930-d82d-47ee-b861-5777bbee67b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:08.052042 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcd930-d82d-47ee-b861-5777bbee67b9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:08.052567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcd930-d82d-47ee-b861-5777bbee67b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:08.053149 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcd930-d82d-47ee-b861-5777bbee67b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:08.065897 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcd930-d82d-47ee-b861-5777bbee67b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:08.067831 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcd930-d82d-47ee-b861-5777bbee67b9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:08.088797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-58dcd930-d82d-47ee-b861-5777bbee67b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:08.088797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:08.088797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:08.088797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:08.088797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:08.088797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:08.088797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:08.088797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:08.088797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:08.088797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:08.088797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:08.088797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:08.088797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:08.088797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:08.088797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:08.089814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:08.090843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:08.090843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:08.090843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:08.090843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:08.094237 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 382/784] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:08.100307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcd930-d82d-47ee-b861-5777bbee67b9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:08.106653 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95909cf-b1ac-46a7-be67-eb19d20a129f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:08.144240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354003a4-694d-48b4-9228-cae9183d9810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:08.145171 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354003a4-694d-48b4-9228-cae9183d9810 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:08.145448 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354003a4-694d-48b4-9228-cae9183d9810 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:08.145717 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354003a4-694d-48b4-9228-cae9183d9810 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:08.156855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354003a4-694d-48b4-9228-cae9183d9810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:08.164537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-354003a4-694d-48b4-9228-cae9183d9810 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:30:08.164537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:08.164537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:08.164537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:08.164537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:08.164537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:08.164537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:08.164537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:08.164537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:08.164537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:08.164537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:08.164537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:08.164537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:08.164537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:08.164537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:08.164537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:08.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:08.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:08.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:08.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:08.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:08.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:08.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:08.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:08.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:08.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:08.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:08.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:08.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:08.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:08.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:08.165525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:08.166378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:08.166378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:08.166378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:08.166378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:08.166378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:08.166378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:08.166378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:08.166378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:08.166378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:08.166378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:08.166378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:30:08.166378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:08.171085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 403/785] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:30:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:08.171815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354003a4-694d-48b4-9228-cae9183d9810 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:08.214266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcd930-d82d-47ee-b861-5777bbee67b9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:08.251478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2c47a-c812-4bf9-b0a0-e702ee0ea58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:08.252605 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2c47a-c812-4bf9-b0a0-e702ee0ea58b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:08.253118 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2c47a-c812-4bf9-b0a0-e702ee0ea58b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:08.253604 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2c47a-c812-4bf9-b0a0-e702ee0ea58b None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:08.254557 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2c47a-c812-4bf9-b0a0-e702ee0ea58b None admin] RBAC: Adding query filter params (type=network) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:08.255213 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2c47a-c812-4bf9-b0a0-e702ee0ea58b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:08.256849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2c47a-c812-4bf9-b0a0-e702ee0ea58b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:08.263671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 383/786] 10.222.0.81 () {56 vars in 1112 bytes} [Wed May 4 17:30:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:08.264892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2c47a-c812-4bf9-b0a0-e702ee0ea58b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:08.303959 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354003a4-694d-48b4-9228-cae9183d9810 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:08.341120 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d41da2-771e-445f-bb02-2ba4e2934619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:08.341800 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d41da2-771e-445f-bb02-2ba4e2934619 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:08.342078 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d41da2-771e-445f-bb02-2ba4e2934619 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:08.342350 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d41da2-771e-445f-bb02-2ba4e2934619 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:08.343135 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d41da2-771e-445f-bb02-2ba4e2934619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:08.343376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d41da2-771e-445f-bb02-2ba4e2934619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:08.345636 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d41da2-771e-445f-bb02-2ba4e2934619 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:08.364078 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 404/787] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:08.364078 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d41da2-771e-445f-bb02-2ba4e2934619 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:08.390513 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2c47a-c812-4bf9-b0a0-e702ee0ea58b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:08.432096 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9013f0-0825-446b-9638-0805a5e72ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:08.432886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9013f0-0825-446b-9638-0805a5e72ffc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:08.433176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9013f0-0825-446b-9638-0805a5e72ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:08.433456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9013f0-0825-446b-9638-0805a5e72ffc None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:08.434214 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9013f0-0825-446b-9638-0805a5e72ffc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:08.434807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9013f0-0825-446b-9638-0805a5e72ffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:08.437209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9013f0-0825-446b-9638-0805a5e72ffc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:08.448340 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 384/788] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:30:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:08.449377 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9013f0-0825-446b-9638-0805a5e72ffc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:08.474785 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d41da2-771e-445f-bb02-2ba4e2934619 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:08.515549 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125caf52-831f-4020-b620-091f0b3cf8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:08.516709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125caf52-831f-4020-b620-091f0b3cf8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:08.517198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125caf52-831f-4020-b620-091f0b3cf8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:08.517691 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125caf52-831f-4020-b620-091f0b3cf8e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:08.518691 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125caf52-831f-4020-b620-091f0b3cf8e9 None admin] RBAC: Adding query filter params (interface=public, service_id=062b4f89fdc04e1fbf3aa27d3972dd6a, region_id=RegionOne) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:08.519226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125caf52-831f-4020-b620-091f0b3cf8e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:08.520866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125caf52-831f-4020-b620-091f0b3cf8e9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:08.530195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 405/789] 10.222.0.81 () {56 vars in 1251 bytes} [Wed May 4 17:30:08 2022] GET /identity/v3/endpoints?service_id=062b4f89fdc04e1fbf3aa27d3972dd6a&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:08.531512 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125caf52-831f-4020-b620-091f0b3cf8e9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:08.567410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9013f0-0825-446b-9638-0805a5e72ffc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:08.605455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb8bef-356d-410b-b8df-cac23fff775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:08.607235 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb8bef-356d-410b-b8df-cac23fff775f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:08.607845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb8bef-356d-410b-b8df-cac23fff775f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:08.608400 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb8bef-356d-410b-b8df-cac23fff775f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:08.617609 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb8bef-356d-410b-b8df-cac23fff775f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:08.619416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb8bef-356d-410b-b8df-cac23fff775f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:08.639714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b7fb8bef-356d-410b-b8df-cac23fff775f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:30:08.639714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:08.639714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:08.639714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:08.639714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:08.639714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:08.639714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:08.639714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:08.639714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:08.639714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:08.639714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:08.639714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:08.639714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:30:08.639714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:30:08.639714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:30:08.639714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:08.640777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:08.641740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:08.641740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:08.641740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:30:08.641740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:30:08.641740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:30:08.641740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:30:08.641740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:30:08.641740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:30:08.641740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:30:08.641740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:08.649690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 385/790] 10.222.0.81 () {56 vars in 1117 bytes} [Wed May 4 17:30:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:08.650890 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb8bef-356d-410b-b8df-cac23fff775f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:08.657290 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125caf52-831f-4020-b620-091f0b3cf8e9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:08.704168 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db166b8c-73fb-48ef-89a4-c1d4e9baa0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:08.705294 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db166b8c-73fb-48ef-89a4-c1d4e9baa0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:08.705576 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db166b8c-73fb-48ef-89a4-c1d4e9baa0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:08.705846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db166b8c-73fb-48ef-89a4-c1d4e9baa0b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:08.722419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db166b8c-73fb-48ef-89a4-c1d4e9baa0b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:08.724676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db166b8c-73fb-48ef-89a4-c1d4e9baa0b0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:08.747796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-db166b8c-73fb-48ef-89a4-c1d4e9baa0b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:08.747796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:08.747796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:08.747796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:08.747796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:08.747796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:08.747796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:08.747796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:08.747796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:08.747796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:08.747796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:08.747796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:08.747796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:08.747796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:08.747796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:08.748796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:08.749912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:08.749912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:08.749912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:08.749912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:08.753163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 406/791] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:08.754345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db166b8c-73fb-48ef-89a4-c1d4e9baa0b0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:08.781194 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb8bef-356d-410b-b8df-cac23fff775f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:08.826995 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaf012-9f65-4ea6-8f01-5a9052eafdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:08.827731 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaf012-9f65-4ea6-8f01-5a9052eafdfa None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:08.828011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaf012-9f65-4ea6-8f01-5a9052eafdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:08.828292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaf012-9f65-4ea6-8f01-5a9052eafdfa None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:08.829408 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaf012-9f65-4ea6-8f01-5a9052eafdfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:08.831258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaf012-9f65-4ea6-8f01-5a9052eafdfa None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:08.838069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 386/792] 10.222.0.81 () {56 vars in 1087 bytes} [Wed May 4 17:30:08 2022] GET /identity/v3/services => generated 772 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:08.840186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaf012-9f65-4ea6-8f01-5a9052eafdfa None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:08.876852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db166b8c-73fb-48ef-89a4-c1d4e9baa0b0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:08.914831 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97daff-4621-4ff1-84d3-4b6cbdbdcfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:08.915920 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97daff-4621-4ff1-84d3-4b6cbdbdcfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:08.916422 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97daff-4621-4ff1-84d3-4b6cbdbdcfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:08.916947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97daff-4621-4ff1-84d3-4b6cbdbdcfa7 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:08.918055 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97daff-4621-4ff1-84d3-4b6cbdbdcfa7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:08.918581 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97daff-4621-4ff1-84d3-4b6cbdbdcfa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:08.920463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97daff-4621-4ff1-84d3-4b6cbdbdcfa7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:08.942128 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 407/793] 10.222.0.81 () {56 vars in 1149 bytes} [Wed May 4 17:30:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:08.948178 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97daff-4621-4ff1-84d3-4b6cbdbdcfa7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:08.954185 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaf012-9f65-4ea6-8f01-5a9052eafdfa None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:09.000974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cd12e-38af-4b99-aa74-6adb14f8f131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:09.001658 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cd12e-38af-4b99-aa74-6adb14f8f131 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:09.001991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cd12e-38af-4b99-aa74-6adb14f8f131 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:09.002267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cd12e-38af-4b99-aa74-6adb14f8f131 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:09.003064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cd12e-38af-4b99-aa74-6adb14f8f131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:09.003376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cd12e-38af-4b99-aa74-6adb14f8f131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:09.004793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cd12e-38af-4b99-aa74-6adb14f8f131 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:09.034011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 387/794] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:09.039805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cd12e-38af-4b99-aa74-6adb14f8f131 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:09.130070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97daff-4621-4ff1-84d3-4b6cbdbdcfa7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:09.185823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeee6f-67af-4a28-9628-3d666a4212f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:09.186660 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeee6f-67af-4a28-9628-3d666a4212f7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:09.187139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeee6f-67af-4a28-9628-3d666a4212f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:09.187752 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeee6f-67af-4a28-9628-3d666a4212f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:09.198738 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeee6f-67af-4a28-9628-3d666a4212f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:09.200408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeee6f-67af-4a28-9628-3d666a4212f7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:09.210437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cd12e-38af-4b99-aa74-6adb14f8f131 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:09.221395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-8eaeee6f-67af-4a28-9628-3d666a4212f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:09.221395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:09.221395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:09.221395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:09.221395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:09.221395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:09.221395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:09.221395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:09.221395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:09.221395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:09.221395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:09.221395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:09.221395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:09.221395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:09.221395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:09.222360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:09.223260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:09.223260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:09.223260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:09.223260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:09.227160 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 408/795] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:09.228377 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeee6f-67af-4a28-9628-3d666a4212f7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:09.260809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e1d59-3404-452d-ad2d-388cde22efb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:09.261614 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e1d59-3404-452d-ad2d-388cde22efb4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:09.261895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e1d59-3404-452d-ad2d-388cde22efb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:09.262169 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e1d59-3404-452d-ad2d-388cde22efb4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:09.274360 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e1d59-3404-452d-ad2d-388cde22efb4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:09.277113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e1d59-3404-452d-ad2d-388cde22efb4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:09.294994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-be0e1d59-3404-452d-ad2d-388cde22efb4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 17:30:09.294994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:09.294994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:09.294994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:09.294994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:09.294994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:09.294994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:09.294994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:09.294994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:09.294994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:09.294994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:09.294994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:09.294994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:30:09.294994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:30:09.294994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:30:09.294994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:09.296009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:09.298122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:09.298122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:09.298122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:30:09.298122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:30:09.298122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:30:09.298122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:30:09.298122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:30:09.298122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:30:09.298122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 17:30:09.298122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:09.301241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 388/796] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:30:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:09.307937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e1d59-3404-452d-ad2d-388cde22efb4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:09.430213 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e1d59-3404-452d-ad2d-388cde22efb4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:09.469190 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4d53a-e49c-4462-902d-18ff6779858a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:09.469868 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4d53a-e49c-4462-902d-18ff6779858a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:09.470151 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4d53a-e49c-4462-902d-18ff6779858a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:09.470425 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4d53a-e49c-4462-902d-18ff6779858a None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:09.471284 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4d53a-e49c-4462-902d-18ff6779858a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:09.471598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4d53a-e49c-4462-902d-18ff6779858a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:09.473346 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4d53a-e49c-4462-902d-18ff6779858a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:09.484360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeee6f-67af-4a28-9628-3d666a4212f7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:09.495587 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 389/797] 10.222.0.81 () {56 vars in 1135 bytes} [Wed May 4 17:30:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:09.502024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4d53a-e49c-4462-902d-18ff6779858a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:09.581965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb072f2c-2455-4c83-b7be-2e7ed817fbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:09.582647 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb072f2c-2455-4c83-b7be-2e7ed817fbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:09.582987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb072f2c-2455-4c83-b7be-2e7ed817fbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:09.589380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb072f2c-2455-4c83-b7be-2e7ed817fbf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:09.589380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb072f2c-2455-4c83-b7be-2e7ed817fbf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:09.589380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb072f2c-2455-4c83-b7be-2e7ed817fbf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:09.589380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb072f2c-2455-4c83-b7be-2e7ed817fbf5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:09.612592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 409/798] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:09.614931 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2c5bd-e30e-4f37-a9b4-03e812d284f3 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:09.615394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2c5bd-e30e-4f37-a9b4-03e812d284f3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:09.615845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2c5bd-e30e-4f37-a9b4-03e812d284f3 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:09.616600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4d53a-e49c-4462-902d-18ff6779858a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:09.618399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 410/799] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:09.620269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2c5bd-e30e-4f37-a9b4-03e812d284f3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:09.659852 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69e3bb-f334-443c-90f5-81b69137c801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:09.660686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69e3bb-f334-443c-90f5-81b69137c801 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:09.661144 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69e3bb-f334-443c-90f5-81b69137c801 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:09.661419 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69e3bb-f334-443c-90f5-81b69137c801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:09.674861 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69e3bb-f334-443c-90f5-81b69137c801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:09.676606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69e3bb-f334-443c-90f5-81b69137c801 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:09.698726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ca69e3bb-f334-443c-90f5-81b69137c801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:09.698726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:09.698726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:09.698726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:09.698726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:09.698726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:09.698726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:09.698726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:09.698726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:09.698726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:09.698726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:09.698726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:09.698726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:09.698726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:09.698726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:09.700595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:09.702181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:09.702181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:09.702181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:09.702181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:09.708457 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 390/800] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:09.708457 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11792f3-aac5-4ae8-b3fb-163712cc34c1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:09.708457 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11792f3-aac5-4ae8-b3fb-163712cc34c1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:09.708457 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11792f3-aac5-4ae8-b3fb-163712cc34c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:09.727478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d11792f3-aac5-4ae8-b3fb-163712cc34c1 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:09.728972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d11792f3-aac5-4ae8-b3fb-163712cc34c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:09.765711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2c5bd-e30e-4f37-a9b4-03e812d284f3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:09.804691 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 391/801] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:09.805870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11792f3-aac5-4ae8-b3fb-163712cc34c1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:09.807234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e437a6-bfdb-41a7-8c14-2397c246579b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:09.808037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e437a6-bfdb-41a7-8c14-2397c246579b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:09.808543 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e437a6-bfdb-41a7-8c14-2397c246579b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:09.808822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e437a6-bfdb-41a7-8c14-2397c246579b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:09.818786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e437a6-bfdb-41a7-8c14-2397c246579b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:09.820833 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e437a6-bfdb-41a7-8c14-2397c246579b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:09.841000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-20e437a6-bfdb-41a7-8c14-2397c246579b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:09.841000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:09.841000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:09.841000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:09.841000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:09.841000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:09.841000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:09.841000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:09.841000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:09.841000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:09.841000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:09.841000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:09.841000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:30:09.841000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:30:09.841000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:09.842843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:09.844492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:30:09.844492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:30:09.844492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:30:09.844492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:30:09.844492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:30:09.844492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:30:09.844492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:09.844492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:09.844492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 411/802] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:09.844492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e437a6-bfdb-41a7-8c14-2397c246579b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:09.938527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11792f3-aac5-4ae8-b3fb-163712cc34c1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:09.989769 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64667320-fe56-47ce-832c-ce4990210fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:09.990439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64667320-fe56-47ce-832c-ce4990210fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:09.990728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64667320-fe56-47ce-832c-ce4990210fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:09.991009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64667320-fe56-47ce-832c-ce4990210fa6 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:09.991746 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64667320-fe56-47ce-832c-ce4990210fa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:09.992059 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64667320-fe56-47ce-832c-ce4990210fa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:09.994604 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64667320-fe56-47ce-832c-ce4990210fa6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:10.005901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e437a6-bfdb-41a7-8c14-2397c246579b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:10.016542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 392/803] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:10.017507 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64667320-fe56-47ce-832c-ce4990210fa6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:10.051436 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d44d2-2f42-4b40-9ae6-f5a53c6b7b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:10.052411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d44d2-2f42-4b40-9ae6-f5a53c6b7b6f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:10.053031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d44d2-2f42-4b40-9ae6-f5a53c6b7b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:10.053627 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d44d2-2f42-4b40-9ae6-f5a53c6b7b6f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:10.054310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d44d2-2f42-4b40-9ae6-f5a53c6b7b6f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:10.055869 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d44d2-2f42-4b40-9ae6-f5a53c6b7b6f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:10.072073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-2c5d44d2-2f42-4b40-9ae6-f5a53c6b7b6f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:30:10.072073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:10.072073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:10.072073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:10.072073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:10.072073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:10.072073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:10.072073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:10.072073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:30:10.072073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:10.072073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:10.072073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:10.072073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:10.072073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:10.072073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:10.072073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:10.073186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:10.073186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:10.073186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:10.073186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:10.073186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:10.073186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:10.073186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:10.073186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:10.073186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:10.073186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:10.073186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:10.073186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:10.073186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:10.073186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:10.073186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:10.073186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:10.074032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:10.074032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:10.074032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:10.074032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:10.074032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:10.074032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:10.074032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:10.074032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:10.074032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:10.074032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:10.074032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:10.074032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:10.074032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:10.074032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 17:30:10.074032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:10.074032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 412/804] 10.222.0.81 () {56 vars in 1129 bytes} [Wed May 4 17:30:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:10.074895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d44d2-2f42-4b40-9ae6-f5a53c6b7b6f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:10.133203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64667320-fe56-47ce-832c-ce4990210fa6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:10.172433 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbb18c-5298-431c-9043-9bb089257181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:10.173125 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbb18c-5298-431c-9043-9bb089257181 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:10.173434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbb18c-5298-431c-9043-9bb089257181 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:10.173693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbb18c-5298-431c-9043-9bb089257181 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:10.174484 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbb18c-5298-431c-9043-9bb089257181 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:10.174794 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbb18c-5298-431c-9043-9bb089257181 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:10.176250 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbb18c-5298-431c-9043-9bb089257181 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:10.185055 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d44d2-2f42-4b40-9ae6-f5a53c6b7b6f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:10.190401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 393/805] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:10.191699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be51dd-ed24-46a7-8ade-eed7bdf3748e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:10.191986 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be51dd-ed24-46a7-8ade-eed7bdf3748e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:10.192256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be51dd-ed24-46a7-8ade-eed7bdf3748e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:10.193831 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 394/806] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:10.194538 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be51dd-ed24-46a7-8ade-eed7bdf3748e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:10.227364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497cda4-aa0a-4188-baaf-5ab88921f7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:10.228623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497cda4-aa0a-4188-baaf-5ab88921f7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:10.228903 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497cda4-aa0a-4188-baaf-5ab88921f7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:10.229261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497cda4-aa0a-4188-baaf-5ab88921f7e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:10.237759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497cda4-aa0a-4188-baaf-5ab88921f7e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:10.239219 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497cda4-aa0a-4188-baaf-5ab88921f7e6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:10.258347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-1497cda4-aa0a-4188-baaf-5ab88921f7e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:10.258347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:10.258347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:10.258347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:10.258347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:10.258347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:10.258347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:10.258347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:10.258347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:10.258347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:10.258347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:10.258347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:10.258347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:30:10.258347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:30:10.258347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:10.260511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:10.262682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:30:10.262682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:30:10.262682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:30:10.262682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:30:10.262682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:30:10.262682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:30:10.262682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:10.262682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:10.262682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 413/807] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:10.262682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497cda4-aa0a-4188-baaf-5ab88921f7e6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:10.308455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be51dd-ed24-46a7-8ade-eed7bdf3748e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:10.345576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9320de3-9964-486c-ba5f-12ebb2456590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:10.346406 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320de3-9964-486c-ba5f-12ebb2456590 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:10.346692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320de3-9964-486c-ba5f-12ebb2456590 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:10.346967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320de3-9964-486c-ba5f-12ebb2456590 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:10.347682 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9320de3-9964-486c-ba5f-12ebb2456590 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:10.348483 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9320de3-9964-486c-ba5f-12ebb2456590 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:10.349380 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9320de3-9964-486c-ba5f-12ebb2456590 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:10.359671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 395/808] 10.222.0.81 () {56 vars in 1124 bytes} [Wed May 4 17:30:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:10.359671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d0b62-aac1-40de-b577-bbd18e892205 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:10.359671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d0b62-aac1-40de-b577-bbd18e892205 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:10.359671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d0b62-aac1-40de-b577-bbd18e892205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:10.375583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2e3d0b62-aac1-40de-b577-bbd18e892205 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:10.376867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2e3d0b62-aac1-40de-b577-bbd18e892205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:10.393918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497cda4-aa0a-4188-baaf-5ab88921f7e6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:10.436824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd07bff-3d3d-40f0-8827-9dc0c2448773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:10.437904 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd07bff-3d3d-40f0-8827-9dc0c2448773 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:10.438188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd07bff-3d3d-40f0-8827-9dc0c2448773 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:10.438458 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd07bff-3d3d-40f0-8827-9dc0c2448773 None admin] PATH_INFO: `/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/ef7da67b09104f4991befeb14cd0581b/roles/61d7286cc614424e9d7b8514b201ee21` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:10.454059 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 396/809] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:10.454984 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d0b62-aac1-40de-b577-bbd18e892205 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:10.467671 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd07bff-3d3d-40f0-8827-9dc0c2448773 None admin] RBAC: Authorizing `identity:create_grant(project_id=544a56c4b97e43aea9fbb003d80af8dc, user_id=ef7da67b09104f4991befeb14cd0581b, role_id=61d7286cc614424e9d7b8514b201ee21)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:10.469459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd07bff-3d3d-40f0-8827-9dc0c2448773 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:10.540026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 414/810] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:30:10 2022] PUT /identity/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/ef7da67b09104f4991befeb14cd0581b/roles/61d7286cc614424e9d7b8514b201ee21 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:30:10.540811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd07bff-3d3d-40f0-8827-9dc0c2448773 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:10.580396 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d0b62-aac1-40de-b577-bbd18e892205 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:10.629003 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5ba40-49e2-4ee2-9b6d-b4d555dcdaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:10.629685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5ba40-49e2-4ee2-9b6d-b4d555dcdaf5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:10.629967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5ba40-49e2-4ee2-9b6d-b4d555dcdaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:10.630245 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5ba40-49e2-4ee2-9b6d-b4d555dcdaf5 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:10.631065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5ba40-49e2-4ee2-9b6d-b4d555dcdaf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:10.631376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5ba40-49e2-4ee2-9b6d-b4d555dcdaf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:10.633056 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5ba40-49e2-4ee2-9b6d-b4d555dcdaf5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:10.651700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 397/811] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:10.651700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5ba40-49e2-4ee2-9b6d-b4d555dcdaf5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:10.683237 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd07bff-3d3d-40f0-8827-9dc0c2448773 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:10.723999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32767a64-8b95-4de4-a995-24f288067f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:10.725134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767a64-8b95-4de4-a995-24f288067f2e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:10.725627 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767a64-8b95-4de4-a995-24f288067f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:10.726112 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767a64-8b95-4de4-a995-24f288067f2e None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:10.727080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32767a64-8b95-4de4-a995-24f288067f2e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:10.727746 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32767a64-8b95-4de4-a995-24f288067f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:10.729412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32767a64-8b95-4de4-a995-24f288067f2e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:10.740225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 415/812] 10.222.0.81 () {56 vars in 1124 bytes} [Wed May 4 17:30:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:10.741508 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32767a64-8b95-4de4-a995-24f288067f2e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:10.763641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5ba40-49e2-4ee2-9b6d-b4d555dcdaf5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:10.804191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb93afc-0d51-4eee-a4d7-2cbc5528c303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:10.804958 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb93afc-0d51-4eee-a4d7-2cbc5528c303 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:10.805242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb93afc-0d51-4eee-a4d7-2cbc5528c303 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:10.805516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb93afc-0d51-4eee-a4d7-2cbc5528c303 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:10.817216 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb93afc-0d51-4eee-a4d7-2cbc5528c303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:10.825708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-3eb93afc-0d51-4eee-a4d7-2cbc5528c303 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:30:10.825708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:10.825708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:10.825708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:10.825708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:10.825708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:10.825708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:10.825708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:10.825708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:10.825708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:10.825708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:10.825708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:10.825708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:10.825708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:10.825708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:10.825708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:10.826719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:10.826719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:10.826719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:10.826719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:10.826719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:10.826719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:10.826719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:10.826719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:10.826719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:10.826719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:10.826719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:10.826719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:10.826719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:10.826719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:10.826719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:10.826719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:10.827577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:10.827577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:10.827577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:10.827577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:10.827577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:10.827577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:10.827577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:10.827577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:10.827577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:10.827577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:10.827577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:30:10.827577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:10.832044 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 398/813] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:30:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:10.832943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb93afc-0d51-4eee-a4d7-2cbc5528c303 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:10.881063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32767a64-8b95-4de4-a995-24f288067f2e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:10.924138 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5811d-19af-49e0-b496-f2c57178f72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:10.925371 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5811d-19af-49e0-b496-f2c57178f72f None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:10.925656 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5811d-19af-49e0-b496-f2c57178f72f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:10.926087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5811d-19af-49e0-b496-f2c57178f72f None admin] PATH_INFO: `/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/382e84e110754effa5ffec950f7c1598/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:10.930524 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5811d-19af-49e0-b496-f2c57178f72f None admin] RBAC: Authorizing `identity:create_grant(project_id=544a56c4b97e43aea9fbb003d80af8dc, user_id=382e84e110754effa5ffec950f7c1598, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:10.932112 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5811d-19af-49e0-b496-f2c57178f72f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:10.963145 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb93afc-0d51-4eee-a4d7-2cbc5528c303 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:11.003210 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc80ee6-bfe1-43e3-b919-1cd2538d0ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:11.003871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80ee6-bfe1-43e3-b919-1cd2538d0ab4 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:11.004151 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80ee6-bfe1-43e3-b919-1cd2538d0ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:11.004426 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80ee6-bfe1-43e3-b919-1cd2538d0ab4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:11.005186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc80ee6-bfe1-43e3-b919-1cd2538d0ab4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:11.006569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc80ee6-bfe1-43e3-b919-1cd2538d0ab4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:11.028661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 416/814] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:30:10 2022] PUT /identity/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/382e84e110754effa5ffec950f7c1598/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:30:11.030144 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5811d-19af-49e0-b496-f2c57178f72f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:11.099794 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 399/815] 10.222.0.81 () {60 vars in 1144 bytes} [Wed May 4 17:30:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:30:11.173314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5811d-19af-49e0-b496-f2c57178f72f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:11.221062 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3153da-9b3f-4552-a80f-81f6338ba7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:11.222111 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3153da-9b3f-4552-a80f-81f6338ba7ed None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:11.222644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3153da-9b3f-4552-a80f-81f6338ba7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:11.223134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3153da-9b3f-4552-a80f-81f6338ba7ed None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:11.224134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3153da-9b3f-4552-a80f-81f6338ba7ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:11.224762 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3153da-9b3f-4552-a80f-81f6338ba7ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:11.226372 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3153da-9b3f-4552-a80f-81f6338ba7ed None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:11.242005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 417/816] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:30:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:11.243828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc80ee6-bfe1-43e3-b919-1cd2538d0ab4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:11.364148 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc80ee6-bfe1-43e3-b919-1cd2538d0ab4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:11.404631 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06177eb1-59a9-4976-81a2-50f35369cf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:11.405680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06177eb1-59a9-4976-81a2-50f35369cf74 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:11.406068 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06177eb1-59a9-4976-81a2-50f35369cf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:11.406441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06177eb1-59a9-4976-81a2-50f35369cf74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:11.422103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06177eb1-59a9-4976-81a2-50f35369cf74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:11.422103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06177eb1-59a9-4976-81a2-50f35369cf74 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:11.442098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-06177eb1-59a9-4976-81a2-50f35369cf74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:11.442098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:11.442098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:11.442098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:11.442098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:11.442098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:11.442098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:11.442098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:11.442098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:11.442098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:11.442098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:11.442098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:11.442098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:11.442098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:11.442098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:11.443199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:11.444285 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:11.444285 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:11.444285 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:11.444285 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:11.449024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 400/817] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:11.452998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3153da-9b3f-4552-a80f-81f6338ba7ed None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:11.584596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3153da-9b3f-4552-a80f-81f6338ba7ed None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:11.626173 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06d200-d890-4e41-a53a-1faf4507d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:11.626861 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06d200-d890-4e41-a53a-1faf4507d2cc None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:11.627212 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06d200-d890-4e41-a53a-1faf4507d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:11.627556 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06d200-d890-4e41-a53a-1faf4507d2cc None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:11.628357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06d200-d890-4e41-a53a-1faf4507d2cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:11.628757 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06d200-d890-4e41-a53a-1faf4507d2cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:11.630197 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06d200-d890-4e41-a53a-1faf4507d2cc None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:11.648580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 418/818] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:11.654319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06177eb1-59a9-4976-81a2-50f35369cf74 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:11.655287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e5478-0e25-4bcd-9227-72d7f05f6df9 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:11.655650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e5478-0e25-4bcd-9227-72d7f05f6df9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:11.656001 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e5478-0e25-4bcd-9227-72d7f05f6df9 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:11.657451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 419/819] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:30:11.663716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a8041-8353-499e-964a-2f17a512d936 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:11.664113 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a8041-8353-499e-964a-2f17a512d936 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:11.664488 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a8041-8353-499e-964a-2f17a512d936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:11.683184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a97a8041-8353-499e-964a-2f17a512d936 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:11.684988 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a97a8041-8353-499e-964a-2f17a512d936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:11.812779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 420/820] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:30:11.828821 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06177eb1-59a9-4976-81a2-50f35369cf74 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:11.839469 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a8041-8353-499e-964a-2f17a512d936 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:11.909311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b9519-1151-468f-912a-613c5b62013e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:11.910033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b9519-1151-468f-912a-613c5b62013e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:11.910315 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b9519-1151-468f-912a-613c5b62013e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:11.910589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b9519-1151-468f-912a-613c5b62013e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:11.927609 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b9519-1151-468f-912a-613c5b62013e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:11.929106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b9519-1151-468f-912a-613c5b62013e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:11.965923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c98b9519-1151-468f-912a-613c5b62013e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:30:11.965923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:11.965923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:11.965923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:11.965923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:11.965923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:11.965923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:11.965923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:11.965923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:11.965923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:11.965923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:11.965923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:11.965923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:30:11.965923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:30:11.965923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:30:11.965923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:11.966975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:11.968324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:11.968324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:11.968324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:30:11.968324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:30:11.968324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:30:11.968324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:30:11.968324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:30:11.968324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:30:11.968324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:30:11.968324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:11.968324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 401/821] 10.222.0.81 () {56 vars in 1093 bytes} [Wed May 4 17:30:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:11.974730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b9519-1151-468f-912a-613c5b62013e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:11.986824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a8041-8353-499e-964a-2f17a512d936 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:12.029216 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce12d32-9e21-410c-be05-a72ee71dad90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:12.030010 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce12d32-9e21-410c-be05-a72ee71dad90 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:12.030350 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce12d32-9e21-410c-be05-a72ee71dad90 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:12.030620 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce12d32-9e21-410c-be05-a72ee71dad90 None admin] PATH_INFO: `/v3/services/network` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:12.031285 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce12d32-9e21-410c-be05-a72ee71dad90 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:12.032755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce12d32-9e21-410c-be05-a72ee71dad90 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-9ce12d32-9e21-410c-be05-a72ee71dad90 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:12.046215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:12.048261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:12.048261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:12.048261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:12.048261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:12.048261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:12.048261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:12.048261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:12.048261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:12.048261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:12.048261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:12.048261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:12.048261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:12.048261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:12.048261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:12.048261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:12.048261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:12.049848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:12.049848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:12.049848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:12.049848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:12.049848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:12.049848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:12.049848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:12.049848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:12.049848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:12.049848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:12.049848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:12.049848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:12.049848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 17:30:12.049848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:12.049848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 421/822] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:11 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:12.056885 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce12d32-9e21-410c-be05-a72ee71dad90 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:12.183155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce12d32-9e21-410c-be05-a72ee71dad90 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:12.228504 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b9519-1151-468f-912a-613c5b62013e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:12.253635 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba206a-22a6-461e-8ecd-78cfc56b197d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:12.254697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba206a-22a6-461e-8ecd-78cfc56b197d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:12.256536 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba206a-22a6-461e-8ecd-78cfc56b197d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:12.257939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba206a-22a6-461e-8ecd-78cfc56b197d None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:12.258865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba206a-22a6-461e-8ecd-78cfc56b197d None admin] RBAC: Adding query filter params (name=network) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:12.260961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba206a-22a6-461e-8ecd-78cfc56b197d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:12.263157 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba206a-22a6-461e-8ecd-78cfc56b197d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:12.281211 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 422/823] 10.222.0.81 () {56 vars in 1112 bytes} [Wed May 4 17:30:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:12.291107 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba206a-22a6-461e-8ecd-78cfc56b197d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:12.308246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632f3a0-d7f1-4039-a012-3693a16aa053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:12.310044 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632f3a0-d7f1-4039-a012-3693a16aa053 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:12.310545 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632f3a0-d7f1-4039-a012-3693a16aa053 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:12.311201 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632f3a0-d7f1-4039-a012-3693a16aa053 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:12.312323 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632f3a0-d7f1-4039-a012-3693a16aa053 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:12.312858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632f3a0-d7f1-4039-a012-3693a16aa053 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:12.314499 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632f3a0-d7f1-4039-a012-3693a16aa053 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:12.356103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 402/824] 10.222.0.81 () {56 vars in 1133 bytes} [Wed May 4 17:30:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:12.360326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632f3a0-d7f1-4039-a012-3693a16aa053 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:12.470955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632f3a0-d7f1-4039-a012-3693a16aa053 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:12.507051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ef4e8-acfa-4f76-82e0-aa1f7038bbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:12.507748 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ef4e8-acfa-4f76-82e0-aa1f7038bbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:12.508031 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ef4e8-acfa-4f76-82e0-aa1f7038bbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:12.508309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ef4e8-acfa-4f76-82e0-aa1f7038bbc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:12.544743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba206a-22a6-461e-8ecd-78cfc56b197d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:12.582645 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ef4e8-acfa-4f76-82e0-aa1f7038bbc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:12.584115 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ef4e8-acfa-4f76-82e0-aa1f7038bbc8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:12.642699 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a4c37-ab2a-43bb-9d97-3cc9183a4488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:12.643369 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a4c37-ab2a-43bb-9d97-3cc9183a4488 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:12.643651 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a4c37-ab2a-43bb-9d97-3cc9183a4488 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:12.643926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a4c37-ab2a-43bb-9d97-3cc9183a4488 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:12.644677 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a4c37-ab2a-43bb-9d97-3cc9183a4488 None admin] RBAC: Adding query filter params (type=network) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:12.644987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a4c37-ab2a-43bb-9d97-3cc9183a4488 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:12.646366 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a4c37-ab2a-43bb-9d97-3cc9183a4488 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:12.659944 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 423/825] 10.222.0.81 () {56 vars in 1112 bytes} [Wed May 4 17:30:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:12.665501 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a4c37-ab2a-43bb-9d97-3cc9183a4488 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:12.689359 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 403/826] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:30:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:30:12.695779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ef4e8-acfa-4f76-82e0-aa1f7038bbc8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:12.790428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a4c37-ab2a-43bb-9d97-3cc9183a4488 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:12.800729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ef4e8-acfa-4f76-82e0-aa1f7038bbc8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:12.825791 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5d1a5-0d87-407c-bdfa-e5c789dc745a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:12.826453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5d1a5-0d87-407c-bdfa-e5c789dc745a None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:12.826734 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5d1a5-0d87-407c-bdfa-e5c789dc745a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:12.827011 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5d1a5-0d87-407c-bdfa-e5c789dc745a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:12.827763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5d1a5-0d87-407c-bdfa-e5c789dc745a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:12.829183 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5d1a5-0d87-407c-bdfa-e5c789dc745a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:12.844270 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dabb8-09ca-4ac0-9a81-12fba166bda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:12.845148 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dabb8-09ca-4ac0-9a81-12fba166bda7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:12.845476 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dabb8-09ca-4ac0-9a81-12fba166bda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:12.845748 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dabb8-09ca-4ac0-9a81-12fba166bda7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:12.857083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3dabb8-09ca-4ac0-9a81-12fba166bda7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:12.858660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3dabb8-09ca-4ac0-9a81-12fba166bda7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:12.878355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-3f3dabb8-09ca-4ac0-9a81-12fba166bda7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:12.878355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:12.878355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:12.878355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:12.878355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:12.878355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:12.878355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:12.878355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:12.878355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:12.878355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:12.878355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:12.878355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:12.878355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:12.878355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:12.878355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:12.879307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:12.880602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:12.880602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:12.880602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:12.880602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:12.880602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 404/827] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:12.892360 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dabb8-09ca-4ac0-9a81-12fba166bda7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:12.918518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 424/828] 10.222.0.81 () {60 vars in 1144 bytes} [Wed May 4 17:30:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:30:13.039210 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dabb8-09ca-4ac0-9a81-12fba166bda7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:13.093806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad002c71-7efb-486d-9661-100b1cfe4706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:13.094608 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad002c71-7efb-486d-9661-100b1cfe4706 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:13.094898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad002c71-7efb-486d-9661-100b1cfe4706 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:13.095177 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad002c71-7efb-486d-9661-100b1cfe4706 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:13.095986 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad002c71-7efb-486d-9661-100b1cfe4706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:13.096299 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad002c71-7efb-486d-9661-100b1cfe4706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:13.097739 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad002c71-7efb-486d-9661-100b1cfe4706 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:13.123417 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 405/829] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:13.132901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5d1a5-0d87-407c-bdfa-e5c789dc745a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:13.287336 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5d1a5-0d87-407c-bdfa-e5c789dc745a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:13.332077 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67998b6d-5025-4edc-808f-78c423dff63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:13.332940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67998b6d-5025-4edc-808f-78c423dff63a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:13.333218 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67998b6d-5025-4edc-808f-78c423dff63a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:13.333491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67998b6d-5025-4edc-808f-78c423dff63a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:13.343734 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67998b6d-5025-4edc-808f-78c423dff63a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:13.345346 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67998b6d-5025-4edc-808f-78c423dff63a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:13.361997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-67998b6d-5025-4edc-808f-78c423dff63a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:13.361997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:13.361997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:13.361997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:13.361997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:13.361997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:13.361997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:13.361997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:13.361997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:13.361997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:13.361997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:13.361997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:13.361997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:30:13.361997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:30:13.361997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:13.363131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:13.364184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:30:13.364184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:30:13.364184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:30:13.364184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:30:13.364184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:30:13.364184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:30:13.364184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:13.364184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:13.366707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffaf1bf-6f13-4989-b801-7b1e2a0d9ec8 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:13.367088 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffaf1bf-6f13-4989-b801-7b1e2a0d9ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:13.367293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 425/830] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:13.374268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffaf1bf-6f13-4989-b801-7b1e2a0d9ec8 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:13.376204 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 406/831] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:13.377591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67998b6d-5025-4edc-808f-78c423dff63a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:13.391373 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89b4f1-ea3f-46dc-a616-e1310edc8de9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:13.391977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89b4f1-ea3f-46dc-a616-e1310edc8de9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:13.392431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89b4f1-ea3f-46dc-a616-e1310edc8de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:13.419351 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9f89b4f1-ea3f-46dc-a616-e1310edc8de9 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:13.420934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9f89b4f1-ea3f-46dc-a616-e1310edc8de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:13.510408 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 407/832] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:13.531968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67998b6d-5025-4edc-808f-78c423dff63a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:13.547069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89b4f1-ea3f-46dc-a616-e1310edc8de9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:13.574098 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837dd65-52ce-445f-803c-70ce3ab2c370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:13.575690 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837dd65-52ce-445f-803c-70ce3ab2c370 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:13.576181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837dd65-52ce-445f-803c-70ce3ab2c370 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:13.576747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837dd65-52ce-445f-803c-70ce3ab2c370 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:13.577763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837dd65-52ce-445f-803c-70ce3ab2c370 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:13.578272 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837dd65-52ce-445f-803c-70ce3ab2c370 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:13.579959 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837dd65-52ce-445f-803c-70ce3ab2c370 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:13.592941 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 426/833] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:30:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:13.600623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837dd65-52ce-445f-803c-70ce3ab2c370 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:13.666871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89b4f1-ea3f-46dc-a616-e1310edc8de9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:13.737640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d06cd0-705c-4e03-9d99-579766e9dfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:13.738457 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d06cd0-705c-4e03-9d99-579766e9dfae None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:13.738744 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d06cd0-705c-4e03-9d99-579766e9dfae None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:13.739021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d06cd0-705c-4e03-9d99-579766e9dfae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:13.760327 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837dd65-52ce-445f-803c-70ce3ab2c370 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:13.763589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d06cd0-705c-4e03-9d99-579766e9dfae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:13.775947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b6d06cd0-705c-4e03-9d99-579766e9dfae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:30:13.775947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:13.775947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:13.775947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:13.775947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:13.775947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:13.775947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:13.775947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:13.775947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:13.775947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:13.775947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:13.775947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:13.775947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:13.775947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:13.775947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:13.775947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:13.776960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:13.776960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:13.776960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:13.776960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:13.776960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:13.776960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:13.776960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:13.776960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:13.776960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:13.776960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:13.776960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:13.776960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:13.776960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:13.776960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:13.776960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:13.776960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:13.778370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:13.778370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:13.778370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:13.778370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:13.778370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:13.778370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:13.778370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:13.778370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:13.778370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:13.778370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:13.778370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:30:13.778370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:13.784046 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 408/834] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:30:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:13.788564 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d06cd0-705c-4e03-9d99-579766e9dfae None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:13.841680 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a1dc4-8150-48e8-8455-4f72afb08fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:13.842850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a1dc4-8150-48e8-8455-4f72afb08fcf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:13.843486 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a1dc4-8150-48e8-8455-4f72afb08fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:13.844013 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a1dc4-8150-48e8-8455-4f72afb08fcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:13.845243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a1dc4-8150-48e8-8455-4f72afb08fcf None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=d4a073d8f47a485cbb22db01530f3b37) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:13.845777 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a1dc4-8150-48e8-8455-4f72afb08fcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:13.847430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a1dc4-8150-48e8-8455-4f72afb08fcf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:13.863310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 427/835] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:30:13 2022] GET /identity/v3/role_assignments?user.id=d4a073d8f47a485cbb22db01530f3b37&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:13.873572 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20caf69-b730-440b-a0d7-a5f1ae48e3df None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:13.874509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20caf69-b730-440b-a0d7-a5f1ae48e3df None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:13.875034 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20caf69-b730-440b-a0d7-a5f1ae48e3df None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:13.877614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 428/836] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:13.882391 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27279963-7bf5-47ea-88fb-f1c71a15c0e6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:13.882995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27279963-7bf5-47ea-88fb-f1c71a15c0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:13.883527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27279963-7bf5-47ea-88fb-f1c71a15c0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:13.902530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-27279963-7bf5-47ea-88fb-f1c71a15c0e6 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:13.905018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-27279963-7bf5-47ea-88fb-f1c71a15c0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:13.932486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d06cd0-705c-4e03-9d99-579766e9dfae None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:13.979644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56bd82-dd35-4b1f-ab38-4dee1d081a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:13.980348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56bd82-dd35-4b1f-ab38-4dee1d081a1e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:13.981283 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56bd82-dd35-4b1f-ab38-4dee1d081a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:13.981699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56bd82-dd35-4b1f-ab38-4dee1d081a1e None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:13.983106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56bd82-dd35-4b1f-ab38-4dee1d081a1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:13.983419 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56bd82-dd35-4b1f-ab38-4dee1d081a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:13.986740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56bd82-dd35-4b1f-ab38-4dee1d081a1e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:14.005633 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 409/837] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:30:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:14.008642 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 429/838] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:30:14.009795 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56bd82-dd35-4b1f-ab38-4dee1d081a1e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:14.048658 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27279963-7bf5-47ea-88fb-f1c71a15c0e6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:14.181984 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56bd82-dd35-4b1f-ab38-4dee1d081a1e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:14.222239 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27279963-7bf5-47ea-88fb-f1c71a15c0e6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:14.229445 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddc36d-9dfe-49bb-bfe4-c5ec1cace305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:14.230259 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddc36d-9dfe-49bb-bfe4-c5ec1cace305 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:14.230547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddc36d-9dfe-49bb-bfe4-c5ec1cace305 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:14.231542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddc36d-9dfe-49bb-bfe4-c5ec1cace305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:14.242877 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddc36d-9dfe-49bb-bfe4-c5ec1cace305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:14.244414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddc36d-9dfe-49bb-bfe4-c5ec1cace305 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:14.257746 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f0fdd-b33d-4983-b775-018031205814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:14.258527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f0fdd-b33d-4983-b775-018031205814 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:14.258800 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f0fdd-b33d-4983-b775-018031205814 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:14.259065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f0fdd-b33d-4983-b775-018031205814 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:14.262570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d7ddc36d-9dfe-49bb-bfe4-c5ec1cace305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:14.262570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:14.262570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:14.262570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:14.262570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:14.262570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:14.262570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:14.262570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:14.262570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:14.262570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:14.262570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:14.262570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:14.262570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:14.262570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:14.262570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:14.263439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:14.264312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:14.264312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:14.264312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:14.264312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:14.264312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 410/839] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:14.270918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f0fdd-b33d-4983-b775-018031205814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:14.273445 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddc36d-9dfe-49bb-bfe4-c5ec1cace305 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:14.279309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-a99f0fdd-b33d-4983-b775-018031205814 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:30:14.279309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:14.279309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:14.279309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:14.279309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:14.279309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:14.279309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:14.279309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:14.279309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:14.279309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:14.279309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:14.279309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:14.279309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:14.279309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:14.279309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:14.279309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:14.280246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:14.280246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:14.280246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:14.280246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:14.280246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:14.280246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:14.280246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:14.280246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:14.280246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:14.280246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:14.280246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:14.280246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:14.280246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:14.280246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:14.280246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:14.280246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:14.281200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:14.281200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:14.281200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:14.281200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:14.281200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:14.281200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:14.281200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:14.281200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:14.281200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:14.281200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:14.281200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:30:14.281200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:14.281200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 430/840] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:30:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:14.282352 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79aae3-3190-46d7-b09a-f7f77dcf7f73 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:14.282352 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79aae3-3190-46d7-b09a-f7f77dcf7f73 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:14.287655 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79aae3-3190-46d7-b09a-f7f77dcf7f73 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:14.287655 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 431/841] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:14.288889 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79aae3-3190-46d7-b09a-f7f77dcf7f73 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:14.401707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddc36d-9dfe-49bb-bfe4-c5ec1cace305 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:14.408991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79aae3-3190-46d7-b09a-f7f77dcf7f73 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:14.447418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251a3e4-79c0-4a4d-b50c-70f86c6398c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:14.448002 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251a3e4-79c0-4a4d-b50c-70f86c6398c2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:14.448281 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251a3e4-79c0-4a4d-b50c-70f86c6398c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:14.448587 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251a3e4-79c0-4a4d-b50c-70f86c6398c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:14.449356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251a3e4-79c0-4a4d-b50c-70f86c6398c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:14.450235 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251a3e4-79c0-4a4d-b50c-70f86c6398c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:14.451595 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251a3e4-79c0-4a4d-b50c-70f86c6398c2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:14.453402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00c7dd-4674-4dcd-ac94-757a1d2e4882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:14.454440 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00c7dd-4674-4dcd-ac94-757a1d2e4882 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:14.454884 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00c7dd-4674-4dcd-ac94-757a1d2e4882 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:14.455247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00c7dd-4674-4dcd-ac94-757a1d2e4882 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:14.456066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00c7dd-4674-4dcd-ac94-757a1d2e4882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:14.456603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00c7dd-4674-4dcd-ac94-757a1d2e4882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:14.458833 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00c7dd-4674-4dcd-ac94-757a1d2e4882 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:14.464884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 432/842] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:30:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:14.464884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db004c16-798c-4ee5-9c12-94351732f379 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:14.464884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db004c16-798c-4ee5-9c12-94351732f379 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:14.464884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db004c16-798c-4ee5-9c12-94351732f379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:14.481993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 411/843] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:14.481993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00c7dd-4674-4dcd-ac94-757a1d2e4882 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:14.483547 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-db004c16-798c-4ee5-9c12-94351732f379 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:14.484775 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-db004c16-798c-4ee5-9c12-94351732f379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:14.556471 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 433/844] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:14.557688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db004c16-798c-4ee5-9c12-94351732f379 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:14.594218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00c7dd-4674-4dcd-ac94-757a1d2e4882 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:14.631032 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad01258-3844-43e2-9d2f-a24d4294136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:14.631826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad01258-3844-43e2-9d2f-a24d4294136f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:14.632109 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad01258-3844-43e2-9d2f-a24d4294136f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:14.632381 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad01258-3844-43e2-9d2f-a24d4294136f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:14.643867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad01258-3844-43e2-9d2f-a24d4294136f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:14.651546 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad01258-3844-43e2-9d2f-a24d4294136f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:14.663309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-dad01258-3844-43e2-9d2f-a24d4294136f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:14.663309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:14.663309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:14.663309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:14.663309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:14.663309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:14.663309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:14.663309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:14.663309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:14.663309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:14.663309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:14.663309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:14.663309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:14.663309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:14.663309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:14.664246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:14.665150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:14.665150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:14.665150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:14.665150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:14.665150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 412/845] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:14.665426 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad01258-3844-43e2-9d2f-a24d4294136f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:14.671833 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db004c16-798c-4ee5-9c12-94351732f379 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:14.710903 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882550b3-7496-4026-bd22-73277731ebf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:14.711637 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882550b3-7496-4026-bd22-73277731ebf3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:14.711916 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882550b3-7496-4026-bd22-73277731ebf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:14.713072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882550b3-7496-4026-bd22-73277731ebf3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:14.720545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882550b3-7496-4026-bd22-73277731ebf3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:14.722592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882550b3-7496-4026-bd22-73277731ebf3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:14.745712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-882550b3-7496-4026-bd22-73277731ebf3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:30:14.745712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:14.745712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:14.745712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:14.745712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:14.745712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:14.745712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:14.745712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:14.745712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:14.745712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:14.745712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:14.745712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:14.745712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:30:14.745712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:30:14.745712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:30:14.745712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:14.747939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:14.749866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:14.749866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:14.749866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:30:14.749866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:30:14.749866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:30:14.749866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:30:14.749866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:30:14.749866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:30:14.749866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:30:14.749866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:14.749866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 434/846] 10.222.0.81 () {56 vars in 1117 bytes} [Wed May 4 17:30:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:14.749866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882550b3-7496-4026-bd22-73277731ebf3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:14.780902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad01258-3844-43e2-9d2f-a24d4294136f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:14.817914 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff29ad0-939e-4040-ae3b-3bc6b019445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:14.818722 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff29ad0-939e-4040-ae3b-3bc6b019445e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:14.819006 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff29ad0-939e-4040-ae3b-3bc6b019445e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:14.819279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff29ad0-939e-4040-ae3b-3bc6b019445e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:14.819944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff29ad0-939e-4040-ae3b-3bc6b019445e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:14.821666 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff29ad0-939e-4040-ae3b-3bc6b019445e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7ff29ad0-939e-4040-ae3b-3bc6b019445e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:14.834080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:14.835116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:14.835116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:14.835116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:14.835116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:14.835116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:14.835116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:14.835116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:14.835116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:14.835116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:14.835116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:14.835116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:14.835116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:14.835116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:14.835116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:14.835116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:14.835116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:14.835918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:14.835918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:14.835918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:14.835918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:14.835918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:14.835918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:14.835918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:14.835918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:14.835918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:14.835918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:14.835918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:14.835918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:14.835918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:30:14.835918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:14.835918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 413/847] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:30:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:14.836707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff29ad0-939e-4040-ae3b-3bc6b019445e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:14.875389 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882550b3-7496-4026-bd22-73277731ebf3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:14.912545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bb2ee-e537-4dda-b6c8-3d4939f84437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:14.913203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bb2ee-e537-4dda-b6c8-3d4939f84437 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:14.913488 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bb2ee-e537-4dda-b6c8-3d4939f84437 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:14.913750 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bb2ee-e537-4dda-b6c8-3d4939f84437 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:14.914477 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bb2ee-e537-4dda-b6c8-3d4939f84437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:14.914779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bb2ee-e537-4dda-b6c8-3d4939f84437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:14.916149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bb2ee-e537-4dda-b6c8-3d4939f84437 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:14.930736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 435/848] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:14.932055 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bb2ee-e537-4dda-b6c8-3d4939f84437 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:14.955301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff29ad0-939e-4040-ae3b-3bc6b019445e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:15.004829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a0d53-5dfa-4ecc-a915-2fcd4df299f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:15.005444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a0d53-5dfa-4ecc-a915-2fcd4df299f6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:15.005932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a0d53-5dfa-4ecc-a915-2fcd4df299f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:15.006216 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a0d53-5dfa-4ecc-a915-2fcd4df299f6 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:15.007071 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a0d53-5dfa-4ecc-a915-2fcd4df299f6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:15.007385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a0d53-5dfa-4ecc-a915-2fcd4df299f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:15.008938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a0d53-5dfa-4ecc-a915-2fcd4df299f6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:15.029951 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 414/849] 10.222.0.81 () {56 vars in 1149 bytes} [Wed May 4 17:30:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:15.031148 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a0d53-5dfa-4ecc-a915-2fcd4df299f6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:15.047149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bb2ee-e537-4dda-b6c8-3d4939f84437 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:15.084861 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2bf99-1b70-4ab3-bc16-d8b2f06720ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:15.085780 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2bf99-1b70-4ab3-bc16-d8b2f06720ff None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:15.086228 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2bf99-1b70-4ab3-bc16-d8b2f06720ff None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:15.086663 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2bf99-1b70-4ab3-bc16-d8b2f06720ff None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:15.087561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2bf99-1b70-4ab3-bc16-d8b2f06720ff None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:15.088011 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2bf99-1b70-4ab3-bc16-d8b2f06720ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:15.089557 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2bf99-1b70-4ab3-bc16-d8b2f06720ff None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:15.100648 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 436/850] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:30:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:15.101939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2bf99-1b70-4ab3-bc16-d8b2f06720ff None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:15.138168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a0d53-5dfa-4ecc-a915-2fcd4df299f6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:15.181575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebcdb8-65b3-4d36-ad30-9e2e6daa0b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:15.182620 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebcdb8-65b3-4d36-ad30-9e2e6daa0b4a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:15.182901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebcdb8-65b3-4d36-ad30-9e2e6daa0b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:15.183175 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebcdb8-65b3-4d36-ad30-9e2e6daa0b4a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:15.191387 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebcdb8-65b3-4d36-ad30-9e2e6daa0b4a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:15.192900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebcdb8-65b3-4d36-ad30-9e2e6daa0b4a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:15.214874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ecebcdb8-65b3-4d36-ad30-9e2e6daa0b4a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 17:30:15.214874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:15.214874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:15.214874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:15.214874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:15.214874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:15.214874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:15.214874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:15.214874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:15.214874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:15.214874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:15.214874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:15.214874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:30:15.214874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:30:15.214874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:30:15.214874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:15.216988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:15.217924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:15.217924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:15.217924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:30:15.217924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:30:15.217924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:30:15.217924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:30:15.217924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:30:15.217924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:30:15.217924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 17:30:15.217924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:15.218461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 415/851] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:30:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:15.219321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebcdb8-65b3-4d36-ad30-9e2e6daa0b4a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:15.225011 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2bf99-1b70-4ab3-bc16-d8b2f06720ff None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:15.265698 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2fda8-9216-4e68-830d-10bcd88bf3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:15.266268 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2fda8-9216-4e68-830d-10bcd88bf3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:15.266549 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2fda8-9216-4e68-830d-10bcd88bf3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:15.266821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2fda8-9216-4e68-830d-10bcd88bf3e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:15.341684 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebcdb8-65b3-4d36-ad30-9e2e6daa0b4a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:15.345797 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2fda8-9216-4e68-830d-10bcd88bf3e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:15.347261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2fda8-9216-4e68-830d-10bcd88bf3e4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:15.387907 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae186e20-a68b-42a2-8f4e-2174a48c208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:15.388743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae186e20-a68b-42a2-8f4e-2174a48c208c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:15.389028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae186e20-a68b-42a2-8f4e-2174a48c208c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:15.389303 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae186e20-a68b-42a2-8f4e-2174a48c208c None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:15.390028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae186e20-a68b-42a2-8f4e-2174a48c208c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:15.390335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae186e20-a68b-42a2-8f4e-2174a48c208c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:15.392486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae186e20-a68b-42a2-8f4e-2174a48c208c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:15.408536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 416/852] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:30:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:15.408536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae186e20-a68b-42a2-8f4e-2174a48c208c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:15.458586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 437/853] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:30:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:30:15.464742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2fda8-9216-4e68-830d-10bcd88bf3e4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:15.515648 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae186e20-a68b-42a2-8f4e-2174a48c208c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:15.554626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4fdb9-c2e0-49d0-ac4d-1aac05072d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:15.555292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4fdb9-c2e0-49d0-ac4d-1aac05072d95 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:15.555583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4fdb9-c2e0-49d0-ac4d-1aac05072d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:15.555864 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4fdb9-c2e0-49d0-ac4d-1aac05072d95 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:15.556773 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4fdb9-c2e0-49d0-ac4d-1aac05072d95 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:15.557085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4fdb9-c2e0-49d0-ac4d-1aac05072d95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:15.559436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4fdb9-c2e0-49d0-ac4d-1aac05072d95 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:15.584731 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 417/854] 10.222.0.81 () {56 vars in 1135 bytes} [Wed May 4 17:30:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:15.586742 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4fdb9-c2e0-49d0-ac4d-1aac05072d95 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:15.596056 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2fda8-9216-4e68-830d-10bcd88bf3e4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:15.642025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7756f-43c9-4c04-85d1-91e9fff595d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:15.642827 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7756f-43c9-4c04-85d1-91e9fff595d8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:15.643102 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7756f-43c9-4c04-85d1-91e9fff595d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:15.643374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7756f-43c9-4c04-85d1-91e9fff595d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:15.664150 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7756f-43c9-4c04-85d1-91e9fff595d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:15.666079 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7756f-43c9-4c04-85d1-91e9fff595d8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:15.689607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-bbb7756f-43c9-4c04-85d1-91e9fff595d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:15.689607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:15.689607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:15.689607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:15.689607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:15.689607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:15.689607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:15.689607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:15.689607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:15.689607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:15.689607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:15.689607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:15.689607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:15.689607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:15.689607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:15.690580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:15.691561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:15.691561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:15.691561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:15.691561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:15.693869 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 438/855] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:15.702105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7756f-43c9-4c04-85d1-91e9fff595d8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:15.727764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4fdb9-c2e0-49d0-ac4d-1aac05072d95 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:15.783263 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f93331-bb0d-44a6-8074-e2e4dc64e4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:15.785700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f93331-bb0d-44a6-8074-e2e4dc64e4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:15.786459 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f93331-bb0d-44a6-8074-e2e4dc64e4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:15.787381 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f93331-bb0d-44a6-8074-e2e4dc64e4b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:15.858856 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7756f-43c9-4c04-85d1-91e9fff595d8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:15.885321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f93331-bb0d-44a6-8074-e2e4dc64e4b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:15.887466 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f93331-bb0d-44a6-8074-e2e4dc64e4b8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:15.909329 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732056be-f6d2-4236-b396-c01d70db4fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:15.911070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732056be-f6d2-4236-b396-c01d70db4fbf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:15.911566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732056be-f6d2-4236-b396-c01d70db4fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:15.912061 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732056be-f6d2-4236-b396-c01d70db4fbf None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:15.913147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732056be-f6d2-4236-b396-c01d70db4fbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:15.914502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732056be-f6d2-4236-b396-c01d70db4fbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:15.916452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732056be-f6d2-4236-b396-c01d70db4fbf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:15.936711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 439/856] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:15.939507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732056be-f6d2-4236-b396-c01d70db4fbf None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:16.012363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 418/857] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:30:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:30:16.015304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f93331-bb0d-44a6-8074-e2e4dc64e4b8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:16.072707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732056be-f6d2-4236-b396-c01d70db4fbf None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:16.114591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017efdd-8ab9-42fd-9d97-04d851d8095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:16.116104 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017efdd-8ab9-42fd-9d97-04d851d8095d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:16.116773 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017efdd-8ab9-42fd-9d97-04d851d8095d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:16.117269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017efdd-8ab9-42fd-9d97-04d851d8095d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:16.125545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017efdd-8ab9-42fd-9d97-04d851d8095d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:16.127435 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017efdd-8ab9-42fd-9d97-04d851d8095d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:16.133845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f93331-bb0d-44a6-8074-e2e4dc64e4b8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:16.144496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-1017efdd-8ab9-42fd-9d97-04d851d8095d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:16.144496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:16.144496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:16.144496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:16.144496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:16.144496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:16.144496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:16.144496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:16.144496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:16.144496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:16.144496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:16.144496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:16.144496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:30:16.144496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:30:16.144496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:16.145444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:16.146315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:30:16.146315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:30:16.146315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:30:16.146315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:30:16.146315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:30:16.146315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:30:16.146315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:16.146315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:16.154171 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 440/858] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:16.155990 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017efdd-8ab9-42fd-9d97-04d851d8095d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:16.180750 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b16989-4c5d-4b77-bdf5-1037a7c7cc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:16.181486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b16989-4c5d-4b77-bdf5-1037a7c7cc8c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:16.181861 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b16989-4c5d-4b77-bdf5-1037a7c7cc8c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:16.182145 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b16989-4c5d-4b77-bdf5-1037a7c7cc8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:16.195182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b16989-4c5d-4b77-bdf5-1037a7c7cc8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:16.196305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b16989-4c5d-4b77-bdf5-1037a7c7cc8c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:16.217589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-16b16989-4c5d-4b77-bdf5-1037a7c7cc8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:16.217589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:16.217589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:16.217589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:16.217589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:16.217589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:16.217589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:16.217589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:16.217589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:16.217589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:16.217589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:16.217589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:16.217589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:16.217589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:16.217589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:16.218585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:16.225461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:16.225461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:16.225461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:16.225461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:16.225461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 419/859] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:16.227449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b16989-4c5d-4b77-bdf5-1037a7c7cc8c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:16.304469 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017efdd-8ab9-42fd-9d97-04d851d8095d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:16.345510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045133d-9770-45e3-a895-2188486798fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:16.346533 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045133d-9770-45e3-a895-2188486798fb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:16.347051 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045133d-9770-45e3-a895-2188486798fb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:16.347599 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045133d-9770-45e3-a895-2188486798fb None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:16.348689 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045133d-9770-45e3-a895-2188486798fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:16.349202 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045133d-9770-45e3-a895-2188486798fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:16.350926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045133d-9770-45e3-a895-2188486798fb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:16.364879 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 441/860] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:30:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:16.371308 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045133d-9770-45e3-a895-2188486798fb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:16.374675 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b16989-4c5d-4b77-bdf5-1037a7c7cc8c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:16.421182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9348684-1e63-4a79-b62b-9d0295c2d5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:16.424461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9348684-1e63-4a79-b62b-9d0295c2d5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:16.424461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9348684-1e63-4a79-b62b-9d0295c2d5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:16.424461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9348684-1e63-4a79-b62b-9d0295c2d5b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:16.424461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9348684-1e63-4a79-b62b-9d0295c2d5b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:16.424461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9348684-1e63-4a79-b62b-9d0295c2d5b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:16.424883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9348684-1e63-4a79-b62b-9d0295c2d5b3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:16.439838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 420/861] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:16.441550 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984dec6-1e03-46ab-be39-c28a476b5f08 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:16.441840 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984dec6-1e03-46ab-be39-c28a476b5f08 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:16.442118 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984dec6-1e03-46ab-be39-c28a476b5f08 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:16.443692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 421/862] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:16.444598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984dec6-1e03-46ab-be39-c28a476b5f08 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:16.485875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045133d-9770-45e3-a895-2188486798fb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:16.529027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc33d9-a64c-4fa9-a4b5-422a2f9295fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:16.529692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc33d9-a64c-4fa9-a4b5-422a2f9295fb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:16.529975 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc33d9-a64c-4fa9-a4b5-422a2f9295fb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:16.530246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc33d9-a64c-4fa9-a4b5-422a2f9295fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:16.531087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc33d9-a64c-4fa9-a4b5-422a2f9295fb None admin] RBAC: Adding query filter params (role.id=61d7286cc614424e9d7b8514b201ee21, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=ef7da67b09104f4991befeb14cd0581b) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:16.531395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc33d9-a64c-4fa9-a4b5-422a2f9295fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:16.532880 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc33d9-a64c-4fa9-a4b5-422a2f9295fb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:16.540687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 442/863] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:30:16 2022] GET /identity/v3/role_assignments?user.id=ef7da67b09104f4991befeb14cd0581b&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=61d7286cc614424e9d7b8514b201ee21 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:16.542240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dc77a-25ee-4039-a8a0-bc5ef90be944 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:16.542656 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dc77a-25ee-4039-a8a0-bc5ef90be944 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:16.542841 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dc77a-25ee-4039-a8a0-bc5ef90be944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:16.562052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-681dc77a-25ee-4039-a8a0-bc5ef90be944 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:16.564004 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-681dc77a-25ee-4039-a8a0-bc5ef90be944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:16.576529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984dec6-1e03-46ab-be39-c28a476b5f08 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:16.628032 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fb359-92f9-4861-bc99-ac057cb3b111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:16.629474 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fb359-92f9-4861-bc99-ac057cb3b111 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:16.629948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fb359-92f9-4861-bc99-ac057cb3b111 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:16.630588 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fb359-92f9-4861-bc99-ac057cb3b111 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:16.640836 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fb359-92f9-4861-bc99-ac057cb3b111 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:16.642862 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fb359-92f9-4861-bc99-ac057cb3b111 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:16.665033 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 443/864] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:16.667217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c86fb359-92f9-4861-bc99-ac057cb3b111 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:16.667217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:16.667217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:16.667217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:16.667217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:16.667217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:16.667217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:16.667217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:16.667217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:16.667217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:16.667217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:16.667217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:16.667217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:30:16.667217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:30:16.667217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:16.669407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:16.671050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:30:16.671050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:30:16.671050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:30:16.671050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:30:16.671050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:30:16.671050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:30:16.671050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:16.671050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:16.678823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 422/865] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:16.680042 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dc77a-25ee-4039-a8a0-bc5ef90be944 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:16.689007 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fb359-92f9-4861-bc99-ac057cb3b111 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:16.826773 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dc77a-25ee-4039-a8a0-bc5ef90be944 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:16.834105 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fb359-92f9-4861-bc99-ac057cb3b111 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:16.881246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6c9ec-fa6e-4f36-b5ee-817edcd0aee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:16.882005 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6c9ec-fa6e-4f36-b5ee-817edcd0aee2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:16.882293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6c9ec-fa6e-4f36-b5ee-817edcd0aee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:16.883014 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6c9ec-fa6e-4f36-b5ee-817edcd0aee2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:16.883249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6c9ec-fa6e-4f36-b5ee-817edcd0aee2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:16.888490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6c9ec-fa6e-4f36-b5ee-817edcd0aee2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:16.889730 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fe15b-3403-4a34-8d05-b812e8584c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:16.890404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fe15b-3403-4a34-8d05-b812e8584c44 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:16.890679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fe15b-3403-4a34-8d05-b812e8584c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:16.890949 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fe15b-3403-4a34-8d05-b812e8584c44 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:16.891742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fe15b-3403-4a34-8d05-b812e8584c44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:16.892043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fe15b-3403-4a34-8d05-b812e8584c44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:16.893494 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fe15b-3403-4a34-8d05-b812e8584c44 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:16.900501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c3b6c9ec-fa6e-4f36-b5ee-817edcd0aee2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:30:16.900501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:16.900501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:16.900501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:16.900501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:16.900501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:16.900501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:16.900501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:16.900501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:30:16.900501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:16.900501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:16.900501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:16.900501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:16.900501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:16.900501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:16.900501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:16.901461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:16.901461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:16.901461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:16.901461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:16.901461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:16.901461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:16.901461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:16.901461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:16.901461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:16.901461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:16.901461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:16.901461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:16.901461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:16.901461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:16.901461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:16.901461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:16.902319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:16.902319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:16.902319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:16.902319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:16.902319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:16.902319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:16.902319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:16.902319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:16.902319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:16.902319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:16.902319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:16.902319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:16.902319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:16.902319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:30:16.902319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:16.902319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 423/866] 10.222.0.81 () {56 vars in 1132 bytes} [Wed May 4 17:30:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:16.911542 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 444/867] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:30:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:16.913075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6c9ec-fa6e-4f36-b5ee-817edcd0aee2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:16.920148 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fe15b-3403-4a34-8d05-b812e8584c44 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:17.035025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fe15b-3403-4a34-8d05-b812e8584c44 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:17.036676 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6c9ec-fa6e-4f36-b5ee-817edcd0aee2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:17.075961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d518cc4-b542-4e11-836d-c5dec958e410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:17.076409 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97885c8a-3c7a-44dd-8c4f-d5ecc7863054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:17.076706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d518cc4-b542-4e11-836d-c5dec958e410 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:17.076929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d518cc4-b542-4e11-836d-c5dec958e410 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:17.077152 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97885c8a-3c7a-44dd-8c4f-d5ecc7863054 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:17.077370 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d518cc4-b542-4e11-836d-c5dec958e410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:17.077529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97885c8a-3c7a-44dd-8c4f-d5ecc7863054 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:17.077529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97885c8a-3c7a-44dd-8c4f-d5ecc7863054 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:17.080480 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d518cc4-b542-4e11-836d-c5dec958e410 None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=382e84e110754effa5ffec950f7c1598) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:17.080756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97885c8a-3c7a-44dd-8c4f-d5ecc7863054 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:17.080999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d518cc4-b542-4e11-836d-c5dec958e410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:17.081237 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97885c8a-3c7a-44dd-8c4f-d5ecc7863054 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:17.081483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d518cc4-b542-4e11-836d-c5dec958e410 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:17.081721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97885c8a-3c7a-44dd-8c4f-d5ecc7863054 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:17.084992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 424/868] 10.222.0.81 () {56 vars in 1126 bytes} [Wed May 4 17:30:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:17.091310 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97885c8a-3c7a-44dd-8c4f-d5ecc7863054 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:17.096823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 445/869] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:30:16 2022] GET /identity/v3/role_assignments?user.id=382e84e110754effa5ffec950f7c1598&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:17.212469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97885c8a-3c7a-44dd-8c4f-d5ecc7863054 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:17.252517 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c014f-ebc4-4cf8-a018-88ccdab99190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:17.253270 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c014f-ebc4-4cf8-a018-88ccdab99190 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:17.253561 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c014f-ebc4-4cf8-a018-88ccdab99190 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:17.253841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c014f-ebc4-4cf8-a018-88ccdab99190 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:17.254573 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c014f-ebc4-4cf8-a018-88ccdab99190 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:17.254885 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c014f-ebc4-4cf8-a018-88ccdab99190 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:17.256289 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c014f-ebc4-4cf8-a018-88ccdab99190 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:17.262213 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 425/870] 10.222.0.81 () {56 vars in 1126 bytes} [Wed May 4 17:30:17 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:17.848157 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed9fae-c804-41df-8c3b-4ad62474133b None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:17.848566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed9fae-c804-41df-8c3b-4ad62474133b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:17.848744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed9fae-c804-41df-8c3b-4ad62474133b None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:17.850406 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 446/871] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:30:17.856378 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ec932-b9f0-4b72-9c5c-f204a7e19473 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:17.856874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ec932-b9f0-4b72-9c5c-f204a7e19473 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:17.857054 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ec932-b9f0-4b72-9c5c-f204a7e19473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:17.876590 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7d8ec932-b9f0-4b72-9c5c-f204a7e19473 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:17.879567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7d8ec932-b9f0-4b72-9c5c-f204a7e19473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:17.961870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 426/872] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:17.985540 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed9fae-c804-41df-8c3b-4ad62474133b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:18.102519 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed9fae-c804-41df-8c3b-4ad62474133b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:18.141934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd1ead-6a4b-4090-a218-5386ef981b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:18.143073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd1ead-6a4b-4090-a218-5386ef981b17 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:18.143656 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd1ead-6a4b-4090-a218-5386ef981b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:18.144125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd1ead-6a4b-4090-a218-5386ef981b17 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:18.145088 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd1ead-6a4b-4090-a218-5386ef981b17 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:18.146644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd1ead-6a4b-4090-a218-5386ef981b17 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:18.258327 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 447/873] 10.222.0.81 () {60 vars in 1141 bytes} [Wed May 4 17:30:17 2022] POST /identity/v3/services => generated 251 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:30:19.498783 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ff2d1-5fc9-4de6-8366-af008c9ded97 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:19.498783 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ff2d1-5fc9-4de6-8366-af008c9ded97 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:19.498783 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ff2d1-5fc9-4de6-8366-af008c9ded97 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:19.499862 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 427/874] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:19.505524 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56cf45-78fd-4921-82b9-09a8289c77ef None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:19.505917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56cf45-78fd-4921-82b9-09a8289c77ef None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:19.506078 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56cf45-78fd-4921-82b9-09a8289c77ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:19.545443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9c56cf45-78fd-4921-82b9-09a8289c77ef None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:19.546657 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9c56cf45-78fd-4921-82b9-09a8289c77ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:19.634318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f25e1-33e7-4db8-b500-f2b4ffecd3af None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:19.634993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f25e1-33e7-4db8-b500-f2b4ffecd3af None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:19.634993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f25e1-33e7-4db8-b500-f2b4ffecd3af None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:19.636429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 428/875] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:19.643423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf47ff5-9662-458d-bb6c-bc6472856c30 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:19.643777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf47ff5-9662-458d-bb6c-bc6472856c30 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:19.643986 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf47ff5-9662-458d-bb6c-bc6472856c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:19.662193 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0bf47ff5-9662-458d-bb6c-bc6472856c30 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:19.663433 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0bf47ff5-9662-458d-bb6c-bc6472856c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:19.729863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 448/876] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:19 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:19.752501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 429/877] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:19 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:30:19.764878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56cf45-78fd-4921-82b9-09a8289c77ef None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:19.778542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf47ff5-9662-458d-bb6c-bc6472856c30 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:19.928015 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf47ff5-9662-458d-bb6c-bc6472856c30 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:19.963725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56cf45-78fd-4921-82b9-09a8289c77ef None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:19.978371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5feea-74d7-4e34-8cfc-1fb09a9855a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:19.980817 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5feea-74d7-4e34-8cfc-1fb09a9855a6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:19.981286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5feea-74d7-4e34-8cfc-1fb09a9855a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:19.981827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5feea-74d7-4e34-8cfc-1fb09a9855a6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:19.998327 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5feea-74d7-4e34-8cfc-1fb09a9855a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:20.004251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf80b3-f1cd-43c9-b199-f3d1ebb11013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:20.005205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf80b3-f1cd-43c9-b199-f3d1ebb11013 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:20.005480 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf80b3-f1cd-43c9-b199-f3d1ebb11013 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:20.005759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf80b3-f1cd-43c9-b199-f3d1ebb11013 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:20.006400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf80b3-f1cd-43c9-b199-f3d1ebb11013 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:20.007757 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf80b3-f1cd-43c9-b199-f3d1ebb11013 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-cdcf80b3-f1cd-43c9-b199-f3d1ebb11013 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:20.019509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:20.020695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:20.020695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:20.020695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:20.020695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:20.020695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:20.020695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:20.020695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:20.020695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:20.020695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:20.020695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:20.020695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:20.020695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:20.020695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:20.020695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:20.020695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:20.020695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:20.021584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:20.021584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:20.021584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:20.021584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:20.021584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:20.021584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:20.021584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:20.021584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:20.021584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:20.021584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:20.021584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:20.021584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:20.021584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:30:20.021584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:20.022639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d4c5feea-74d7-4e34-8cfc-1fb09a9855a6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:30:20.022639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:20.022639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:20.022639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:20.022639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:20.022639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:20.022639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:20.022639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:20.022639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:20.022639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:20.022639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:20.022639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:20.022639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:20.022639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:20.022639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:20.022639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:20.023500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:20.023500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:20.023500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:20.023500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:20.023500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:20.023500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:20.023500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:20.023500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:20.023500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:20.023500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:20.023500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:20.023500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:20.023500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:20.023500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:20.023500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:20.023500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:20.029536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:20.029536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:20.029536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:20.029536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:20.029536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:20.029536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:20.029536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:20.029536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:20.029536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:20.029536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:20.029536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:30:20.029536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:20.029536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 430/878] 10.222.0.81 () {56 vars in 1120 bytes} [Wed May 4 17:30:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:20.029536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbefaf-46c7-49aa-952d-1bf1fb6ddabc None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:20.030312 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 449/879] 10.222.0.81 () {56 vars in 1126 bytes} [Wed May 4 17:30:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:20.030398 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbefaf-46c7-49aa-952d-1bf1fb6ddabc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:20.030398 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbefaf-46c7-49aa-952d-1bf1fb6ddabc None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:20.030528 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf80b3-f1cd-43c9-b199-f3d1ebb11013 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:20.030596 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 431/880] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:20.030596 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbefaf-46c7-49aa-952d-1bf1fb6ddabc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:20.154305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbefaf-46c7-49aa-952d-1bf1fb6ddabc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:20.167451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf80b3-f1cd-43c9-b199-f3d1ebb11013 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:20.192990 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb029b-6e54-410c-a95e-c71336bd25fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:20.193580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb029b-6e54-410c-a95e-c71336bd25fb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:20.193862 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb029b-6e54-410c-a95e-c71336bd25fb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:20.194135 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb029b-6e54-410c-a95e-c71336bd25fb None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:20.194882 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb029b-6e54-410c-a95e-c71336bd25fb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:20.195188 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb029b-6e54-410c-a95e-c71336bd25fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:20.196572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb029b-6e54-410c-a95e-c71336bd25fb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:20.205443 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 432/881] 10.222.0.81 () {56 vars in 1115 bytes} [Wed May 4 17:30:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:20.205684 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1df0b-533a-49e1-aa7d-0d2be4a7c387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:20.206569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1df0b-533a-49e1-aa7d-0d2be4a7c387 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:20.206675 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f795428-c20a-4ace-8806-515e2e61ce34 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:20.206956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f795428-c20a-4ace-8806-515e2e61ce34 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:20.207234 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f795428-c20a-4ace-8806-515e2e61ce34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:20.207472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1df0b-533a-49e1-aa7d-0d2be4a7c387 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:20.207903 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1df0b-533a-49e1-aa7d-0d2be4a7c387 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:20.208830 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1df0b-533a-49e1-aa7d-0d2be4a7c387 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:20.209136 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1df0b-533a-49e1-aa7d-0d2be4a7c387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:20.210578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1df0b-533a-49e1-aa7d-0d2be4a7c387 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:20.216662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 450/882] 10.222.0.81 () {56 vars in 1122 bytes} [Wed May 4 17:30:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:20.217820 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1df0b-533a-49e1-aa7d-0d2be4a7c387 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:20.225589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7f795428-c20a-4ace-8806-515e2e61ce34 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:20.226485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7f795428-c20a-4ace-8806-515e2e61ce34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:20.295688 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 433/883] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:20 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:20.297004 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f795428-c20a-4ace-8806-515e2e61ce34 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:20.337723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1df0b-533a-49e1-aa7d-0d2be4a7c387 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:20.373884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5004fd-9619-4c82-92ab-a74aa2ba0dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:20.374925 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5004fd-9619-4c82-92ab-a74aa2ba0dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:20.375378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5004fd-9619-4c82-92ab-a74aa2ba0dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:20.375799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5004fd-9619-4c82-92ab-a74aa2ba0dc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:20.387479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5004fd-9619-4c82-92ab-a74aa2ba0dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:20.389103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5004fd-9619-4c82-92ab-a74aa2ba0dc0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:20.407603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3f5004fd-9619-4c82-92ab-a74aa2ba0dc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:20.407603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:20.407603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:20.407603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:20.407603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:20.407603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:20.407603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:20.407603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:20.407603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:20.407603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:20.407603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:20.407603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:20.407603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:20.407603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:20.407603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:20.408568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:20.409502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:20.409502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:20.409502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:20.409502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:20.409502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 451/884] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:20.410079 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5004fd-9619-4c82-92ab-a74aa2ba0dc0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:20.413932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f795428-c20a-4ace-8806-515e2e61ce34 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:20.448295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804a796-e2f3-4eed-9261-c2f4906d433e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:20.449460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804a796-e2f3-4eed-9261-c2f4906d433e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:20.449878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804a796-e2f3-4eed-9261-c2f4906d433e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:20.450165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804a796-e2f3-4eed-9261-c2f4906d433e None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:20.450877 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804a796-e2f3-4eed-9261-c2f4906d433e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:20.451182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804a796-e2f3-4eed-9261-c2f4906d433e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:20.452557 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804a796-e2f3-4eed-9261-c2f4906d433e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:20.460664 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 434/885] 10.222.0.81 () {56 vars in 1122 bytes} [Wed May 4 17:30:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:20.461820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804a796-e2f3-4eed-9261-c2f4906d433e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:20.523366 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5004fd-9619-4c82-92ab-a74aa2ba0dc0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:20.562313 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6a8b4-38e0-4e6c-9fab-f7c1836154e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:20.563401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6a8b4-38e0-4e6c-9fab-f7c1836154e5 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:20.563898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6a8b4-38e0-4e6c-9fab-f7c1836154e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:20.564375 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6a8b4-38e0-4e6c-9fab-f7c1836154e5 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:20.565399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6a8b4-38e0-4e6c-9fab-f7c1836154e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:20.567064 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6a8b4-38e0-4e6c-9fab-f7c1836154e5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:20.584563 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804a796-e2f3-4eed-9261-c2f4906d433e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:20.624954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000379cb-3920-46bf-8619-a855bdb89ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:20.625624 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000379cb-3920-46bf-8619-a855bdb89ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:20.625959 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000379cb-3920-46bf-8619-a855bdb89ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:20.626240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000379cb-3920-46bf-8619-a855bdb89ec9 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:20.626978 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000379cb-3920-46bf-8619-a855bdb89ec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:20.627286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000379cb-3920-46bf-8619-a855bdb89ec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:20.628698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000379cb-3920-46bf-8619-a855bdb89ec9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:20.642496 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 435/886] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:20.649338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000379cb-3920-46bf-8619-a855bdb89ec9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:20.720806 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 452/887] 10.222.0.81 () {60 vars in 1141 bytes} [Wed May 4 17:30:20 2022] POST /identity/v3/services => generated 269 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:30:20.770991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000379cb-3920-46bf-8619-a855bdb89ec9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:20.834905 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbf7c9-0c22-4a21-9d35-1d25b132de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:20.836162 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbf7c9-0c22-4a21-9d35-1d25b132de5d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:20.836716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbf7c9-0c22-4a21-9d35-1d25b132de5d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:20.837224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbf7c9-0c22-4a21-9d35-1d25b132de5d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:20.847828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbf7c9-0c22-4a21-9d35-1d25b132de5d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:20.849755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbf7c9-0c22-4a21-9d35-1d25b132de5d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:20.867316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-34fbf7c9-0c22-4a21-9d35-1d25b132de5d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:30:20.867316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:20.867316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:20.867316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:20.867316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:20.867316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:20.867316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:20.867316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:20.867316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:20.867316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:20.867316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:20.867316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:20.867316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:30:20.867316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:30:20.867316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:30:20.867316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:20.868331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:20.869325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:20.869325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:20.869325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:30:20.869325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:30:20.869325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:30:20.869325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:30:20.869325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:30:20.869325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:30:20.869325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:30:20.869325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:20.872854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 436/888] 10.222.0.81 () {56 vars in 1117 bytes} [Wed May 4 17:30:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:20.879257 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6a8b4-38e0-4e6c-9fab-f7c1836154e5 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:20.996995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6a8b4-38e0-4e6c-9fab-f7c1836154e5 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:21.033112 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beb49f-ea54-43c5-acf1-90d816900622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:21.033789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beb49f-ea54-43c5-acf1-90d816900622 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:21.034067 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beb49f-ea54-43c5-acf1-90d816900622 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:21.034341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beb49f-ea54-43c5-acf1-90d816900622 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:21.035188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beb49f-ea54-43c5-acf1-90d816900622 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:21.035488 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beb49f-ea54-43c5-acf1-90d816900622 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:21.036957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beb49f-ea54-43c5-acf1-90d816900622 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:21.044357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365880e7-8086-49ef-b506-07f1d2fc0db4 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:21.044703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365880e7-8086-49ef-b506-07f1d2fc0db4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:21.044986 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365880e7-8086-49ef-b506-07f1d2fc0db4 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:21.048745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 437/889] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:21.052361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62447c8-daf8-4692-a935-bf2d6fb5c471 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:21.052721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62447c8-daf8-4692-a935-bf2d6fb5c471 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:21.053053 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62447c8-daf8-4692-a935-bf2d6fb5c471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:21.058054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 453/890] 10.222.0.81 () {56 vars in 1149 bytes} [Wed May 4 17:30:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:21.065299 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beb49f-ea54-43c5-acf1-90d816900622 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:21.075206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b62447c8-daf8-4692-a935-bf2d6fb5c471 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:21.076419 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b62447c8-daf8-4692-a935-bf2d6fb5c471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:21.177161 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 438/891] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:21.189048 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beb49f-ea54-43c5-acf1-90d816900622 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:21.201737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62447c8-daf8-4692-a935-bf2d6fb5c471 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:21.232094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b3c64-2bdb-4058-8705-7e7cc6350e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:21.233301 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b3c64-2bdb-4058-8705-7e7cc6350e2b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:21.234118 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b3c64-2bdb-4058-8705-7e7cc6350e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:21.234861 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b3c64-2bdb-4058-8705-7e7cc6350e2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:21.318097 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62447c8-daf8-4692-a935-bf2d6fb5c471 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:21.328166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b3c64-2bdb-4058-8705-7e7cc6350e2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:21.329684 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b3c64-2bdb-4058-8705-7e7cc6350e2b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:21.365804 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dce61f-062c-411d-9ebe-5800f17b2817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:21.366961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dce61f-062c-411d-9ebe-5800f17b2817 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:21.367492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dce61f-062c-411d-9ebe-5800f17b2817 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:21.367972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dce61f-062c-411d-9ebe-5800f17b2817 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:21.368863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dce61f-062c-411d-9ebe-5800f17b2817 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:21.370427 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dce61f-062c-411d-9ebe-5800f17b2817 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-00dce61f-062c-411d-9ebe-5800f17b2817 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:21.382972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:21.383966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:21.383966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:21.383966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:21.383966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:21.383966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:21.383966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:21.383966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:21.383966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:21.383966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:21.383966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:21.383966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:21.383966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:21.383966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:21.383966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:21.383966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:21.383966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:21.384818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:21.384818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:21.384818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:21.384818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:21.384818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:21.384818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:21.384818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:21.384818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:21.384818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:21.384818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:21.384818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:21.384818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:21.384818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:30:21.384818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:21.391952 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 439/892] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:30:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:21.400066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dce61f-062c-411d-9ebe-5800f17b2817 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:21.439797 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 454/893] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:30:21 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:30:21.441089 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b3c64-2bdb-4058-8705-7e7cc6350e2b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:21.516292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dce61f-062c-411d-9ebe-5800f17b2817 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:21.543566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b3c64-2bdb-4058-8705-7e7cc6350e2b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:21.552235 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a9454-66b8-4459-9a91-3934fda317cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:21.553310 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a9454-66b8-4459-9a91-3934fda317cc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:21.553814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a9454-66b8-4459-9a91-3934fda317cc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:21.554291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a9454-66b8-4459-9a91-3934fda317cc None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:21.555200 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a9454-66b8-4459-9a91-3934fda317cc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:21.555716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a9454-66b8-4459-9a91-3934fda317cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:21.557317 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a9454-66b8-4459-9a91-3934fda317cc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:21.567230 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 440/894] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:30:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:21.568497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a9454-66b8-4459-9a91-3934fda317cc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:21.579116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1198cba-ffeb-44ba-9f53-21dbab20187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:21.579966 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198cba-ffeb-44ba-9f53-21dbab20187d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:21.580249 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198cba-ffeb-44ba-9f53-21dbab20187d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:21.580612 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198cba-ffeb-44ba-9f53-21dbab20187d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:21.592069 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1198cba-ffeb-44ba-9f53-21dbab20187d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:21.593930 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1198cba-ffeb-44ba-9f53-21dbab20187d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:21.613122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-b1198cba-ffeb-44ba-9f53-21dbab20187d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:21.613122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:21.613122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:21.613122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:21.613122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:21.613122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:21.613122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:21.613122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:21.613122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:21.613122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:21.613122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:21.613122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:21.613122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:21.613122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:21.613122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:21.614254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:21.615327 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:21.615327 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:21.615327 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:21.615327 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:21.620714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 455/895] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:21.622994 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1198cba-ffeb-44ba-9f53-21dbab20187d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:21.685352 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a9454-66b8-4459-9a91-3934fda317cc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:21.727491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb0d9a-3fb5-4266-b711-0689058103d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:21.727743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1198cba-ffeb-44ba-9f53-21dbab20187d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:21.728624 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb0d9a-3fb5-4266-b711-0689058103d0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:21.729211 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb0d9a-3fb5-4266-b711-0689058103d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:21.729632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb0d9a-3fb5-4266-b711-0689058103d0 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:21.731409 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb0d9a-3fb5-4266-b711-0689058103d0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:21.731860 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb0d9a-3fb5-4266-b711-0689058103d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:21.733548 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb0d9a-3fb5-4266-b711-0689058103d0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:21.738747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 441/896] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:30:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:21.745230 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb0d9a-3fb5-4266-b711-0689058103d0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:21.769144 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83104b-c5a4-43d8-ae6a-c1d505c928c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:21.769899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83104b-c5a4-43d8-ae6a-c1d505c928c3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:21.770191 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83104b-c5a4-43d8-ae6a-c1d505c928c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:21.770551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83104b-c5a4-43d8-ae6a-c1d505c928c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:21.771173 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83104b-c5a4-43d8-ae6a-c1d505c928c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:21.771476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83104b-c5a4-43d8-ae6a-c1d505c928c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:21.772944 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83104b-c5a4-43d8-ae6a-c1d505c928c3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:21.784723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 456/897] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:21.791673 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83104b-c5a4-43d8-ae6a-c1d505c928c3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:21.867750 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb0d9a-3fb5-4266-b711-0689058103d0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:21.904396 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f9673-ac99-4a2e-9548-1c7065c87a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:21.905087 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f9673-ac99-4a2e-9548-1c7065c87a68 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:21.905374 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f9673-ac99-4a2e-9548-1c7065c87a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:21.905651 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f9673-ac99-4a2e-9548-1c7065c87a68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:21.906448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f9673-ac99-4a2e-9548-1c7065c87a68 None admin] RBAC: Adding query filter params (interface=public, service_id=e18613151812470ea06d9efa40993326, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:21.906762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f9673-ac99-4a2e-9548-1c7065c87a68 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:21.908179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f9673-ac99-4a2e-9548-1c7065c87a68 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:21.918516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 442/898] 10.222.0.81 () {56 vars in 1251 bytes} [Wed May 4 17:30:21 2022] GET /identity/v3/endpoints?service_id=e18613151812470ea06d9efa40993326&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:21.919742 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f9673-ac99-4a2e-9548-1c7065c87a68 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:21.921971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83104b-c5a4-43d8-ae6a-c1d505c928c3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:21.964406 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfc280-3fc0-43b0-b50a-834f22563339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:21.965506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfc280-3fc0-43b0-b50a-834f22563339 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:21.965935 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfc280-3fc0-43b0-b50a-834f22563339 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:21.966378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfc280-3fc0-43b0-b50a-834f22563339 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:21.976618 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfc280-3fc0-43b0-b50a-834f22563339 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:21.978840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfc280-3fc0-43b0-b50a-834f22563339 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:22.001021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-a4cfc280-3fc0-43b0-b50a-834f22563339 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:22.001021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:22.001021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:22.001021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:22.001021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:22.001021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:22.001021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:22.001021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:22.001021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:22.001021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:22.001021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:22.001021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:22.001021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:30:22.001021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:30:22.001021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:22.002882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:22.004760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:30:22.004760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:30:22.004760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:30:22.004760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:30:22.004760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:30:22.004760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:30:22.004760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:22.004760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:22.013045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 457/899] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:22.017522 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfc280-3fc0-43b0-b50a-834f22563339 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:22.038556 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f9673-ac99-4a2e-9548-1c7065c87a68 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:22.076500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99cb58-cada-4109-b94e-f387ff69e8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:22.077170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99cb58-cada-4109-b94e-f387ff69e8fc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:22.077447 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99cb58-cada-4109-b94e-f387ff69e8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:22.077728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99cb58-cada-4109-b94e-f387ff69e8fc None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:22.078415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99cb58-cada-4109-b94e-f387ff69e8fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:22.079784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99cb58-cada-4109-b94e-f387ff69e8fc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:22.085624 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 443/900] 10.222.0.81 () {56 vars in 1087 bytes} [Wed May 4 17:30:21 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:30:22.188036 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfc280-3fc0-43b0-b50a-834f22563339 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:22.226614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653055b-2349-4d09-8218-8975f55fcb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:22.227651 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653055b-2349-4d09-8218-8975f55fcb6c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:22.228129 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653055b-2349-4d09-8218-8975f55fcb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:22.228644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653055b-2349-4d09-8218-8975f55fcb6c None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:22.229645 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653055b-2349-4d09-8218-8975f55fcb6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:22.230191 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653055b-2349-4d09-8218-8975f55fcb6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:22.231849 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653055b-2349-4d09-8218-8975f55fcb6c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:22.251020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 458/901] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:30:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:22.253562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99cb58-cada-4109-b94e-f387ff69e8fc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:22.381953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99cb58-cada-4109-b94e-f387ff69e8fc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:22.418216 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797958aa-710f-40b9-8695-346279bd02db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:22.418887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797958aa-710f-40b9-8695-346279bd02db None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:22.419180 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797958aa-710f-40b9-8695-346279bd02db None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:22.420812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797958aa-710f-40b9-8695-346279bd02db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:22.420812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797958aa-710f-40b9-8695-346279bd02db None admin] RBAC: Adding query filter params (role.id=ca2ed1519dea4a5f9b31d465765c20a4, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=ef7da67b09104f4991befeb14cd0581b) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:22.420812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797958aa-710f-40b9-8695-346279bd02db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:22.424462 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797958aa-710f-40b9-8695-346279bd02db None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:22.428517 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 444/902] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:30:22 2022] GET /identity/v3/role_assignments?user.id=ef7da67b09104f4991befeb14cd0581b&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=ca2ed1519dea4a5f9b31d465765c20a4 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:22.892290 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44472c-ace0-4ab0-8cb4-a5c3ba6ac498 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:22.892847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44472c-ace0-4ab0-8cb4-a5c3ba6ac498 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:22.893130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44472c-ace0-4ab0-8cb4-a5c3ba6ac498 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:22.895065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 459/903] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:22.900626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b387a5-4131-47da-9cca-1af16e794bee None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:22.901099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b387a5-4131-47da-9cca-1af16e794bee None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:22.901191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b387a5-4131-47da-9cca-1af16e794bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:22.918247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-62b387a5-4131-47da-9cca-1af16e794bee None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:22.919516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-62b387a5-4131-47da-9cca-1af16e794bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:22.989888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 445/904] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:23.013931 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44472c-ace0-4ab0-8cb4-a5c3ba6ac498 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:23.120839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44472c-ace0-4ab0-8cb4-a5c3ba6ac498 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:23.157398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2d8ae-37f8-4072-944b-7653f55fed93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:23.158283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d8ae-37f8-4072-944b-7653f55fed93 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:23.158729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d8ae-37f8-4072-944b-7653f55fed93 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:23.159191 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d8ae-37f8-4072-944b-7653f55fed93 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:23.160100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2d8ae-37f8-4072-944b-7653f55fed93 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:23.161643 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2d8ae-37f8-4072-944b-7653f55fed93 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:23.211326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf48c8-2c68-456c-bcfd-c9efcaf103de None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:23.211684 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf48c8-2c68-456c-bcfd-c9efcaf103de None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:23.211885 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf48c8-2c68-456c-bcfd-c9efcaf103de None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:23.213335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 446/905] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:30:23.219193 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc809b-2b06-4c4e-a487-6a98bc3a6127 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:23.219483 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc809b-2b06-4c4e-a487-6a98bc3a6127 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:23.223953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc809b-2b06-4c4e-a487-6a98bc3a6127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:23.239804 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1fdc809b-2b06-4c4e-a487-6a98bc3a6127 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:23.248828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 460/906] 10.222.0.81 () {60 vars in 1141 bytes} [Wed May 4 17:30:23 2022] POST /identity/v3/services => generated 241 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:30:23.248972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1fdc809b-2b06-4c4e-a487-6a98bc3a6127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:23.356937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 447/907] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:30:23.380374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2d8ae-37f8-4072-944b-7653f55fed93 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:23.496015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2d8ae-37f8-4072-944b-7653f55fed93 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:23.533357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad639eda-03f8-4e8e-af32-be3cce0ff5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:23.534165 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad639eda-03f8-4e8e-af32-be3cce0ff5ca None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:23.534442 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad639eda-03f8-4e8e-af32-be3cce0ff5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:23.534713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad639eda-03f8-4e8e-af32-be3cce0ff5ca None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:23.535362 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad639eda-03f8-4e8e-af32-be3cce0ff5ca None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:23.536747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad639eda-03f8-4e8e-af32-be3cce0ff5ca None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:23.548899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ad639eda-03f8-4e8e-af32-be3cce0ff5ca None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:30:23.548899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:23.548899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:23.548899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:23.548899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:23.548899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:23.548899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:23.548899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:23.548899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:30:23.548899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:23.548899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:23.548899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:23.548899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:23.548899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:23.548899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:23.548899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:23.549844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:23.549844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:23.549844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:23.549844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:23.549844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:23.549844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:23.549844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:23.549844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:23.549844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:23.549844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:23.549844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:23.549844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:23.549844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:23.549844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:23.549844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:23.549844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:23.550692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:23.550692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:23.550692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:23.550692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:23.550692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:23.550692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:23.550692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:23.550692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:23.550692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:23.550692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:23.550692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:23.550692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:23.550692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:23.550692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:30:23.550692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:23.550692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 461/908] 10.222.0.81 () {56 vars in 1132 bytes} [Wed May 4 17:30:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:23.557617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc809b-2b06-4c4e-a487-6a98bc3a6127 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:23.671583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc809b-2b06-4c4e-a487-6a98bc3a6127 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:23.706682 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d174d6-d72a-4745-a809-551db018c95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:23.707741 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d174d6-d72a-4745-a809-551db018c95d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:23.708226 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d174d6-d72a-4745-a809-551db018c95d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:23.708863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d174d6-d72a-4745-a809-551db018c95d None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:23.709769 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d174d6-d72a-4745-a809-551db018c95d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:23.710298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d174d6-d72a-4745-a809-551db018c95d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:23.711843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d174d6-d72a-4745-a809-551db018c95d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:23.717197 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 448/909] 10.222.0.81 () {56 vars in 1126 bytes} [Wed May 4 17:30:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:23.722980 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad639eda-03f8-4e8e-af32-be3cce0ff5ca None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:23.834571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad639eda-03f8-4e8e-af32-be3cce0ff5ca None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:23.876463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0528c-1063-4a93-881c-8b9394a87119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:23.876463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0528c-1063-4a93-881c-8b9394a87119 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:23.876463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0528c-1063-4a93-881c-8b9394a87119 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:23.876463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0528c-1063-4a93-881c-8b9394a87119 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:23.876861 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0528c-1063-4a93-881c-8b9394a87119 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:23.876861 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0528c-1063-4a93-881c-8b9394a87119 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:23.876861 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0528c-1063-4a93-881c-8b9394a87119 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:23.881855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 462/910] 10.222.0.81 () {56 vars in 1126 bytes} [Wed May 4 17:30:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:23.887684 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d174d6-d72a-4745-a809-551db018c95d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:23.989037 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d174d6-d72a-4745-a809-551db018c95d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:24.025940 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267dd10-116a-4817-910c-5db6f5ca1100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:24.026603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267dd10-116a-4817-910c-5db6f5ca1100 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:24.026917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267dd10-116a-4817-910c-5db6f5ca1100 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:24.031908 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267dd10-116a-4817-910c-5db6f5ca1100 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:24.031908 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267dd10-116a-4817-910c-5db6f5ca1100 None admin] RBAC: Adding query filter params (interface=public, service_id=1f95fda224f84aedb624ea9f17e4e975, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:24.031908 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267dd10-116a-4817-910c-5db6f5ca1100 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:24.031908 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267dd10-116a-4817-910c-5db6f5ca1100 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:24.035226 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 449/911] 10.222.0.81 () {56 vars in 1251 bytes} [Wed May 4 17:30:23 2022] GET /identity/v3/endpoints?service_id=1f95fda224f84aedb624ea9f17e4e975&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:24.040658 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0528c-1063-4a93-881c-8b9394a87119 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:24.146430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0528c-1063-4a93-881c-8b9394a87119 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:24.182008 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a351a-a1a7-4f7a-a15a-a9ea7dc77d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:24.182756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a351a-a1a7-4f7a-a15a-a9ea7dc77d8d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:24.183152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a351a-a1a7-4f7a-a15a-a9ea7dc77d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:24.188463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a351a-a1a7-4f7a-a15a-a9ea7dc77d8d None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:24.188463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a351a-a1a7-4f7a-a15a-a9ea7dc77d8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:24.188463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a351a-a1a7-4f7a-a15a-a9ea7dc77d8d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:24.192737 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 463/912] 10.222.0.81 () {56 vars in 1087 bytes} [Wed May 4 17:30:24 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:30:24.570068 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0025e2-8883-4d61-a6a8-b41ec56725a5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:24.570448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0025e2-8883-4d61-a6a8-b41ec56725a5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:24.570640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0025e2-8883-4d61-a6a8-b41ec56725a5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:24.571969 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 450/913] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:24.577635 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba570c-8bd6-40e4-8082-389957963d7c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:24.577924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba570c-8bd6-40e4-8082-389957963d7c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:24.578200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba570c-8bd6-40e4-8082-389957963d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:24.596543 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-dbba570c-8bd6-40e4-8082-389957963d7c None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:24.597768 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dbba570c-8bd6-40e4-8082-389957963d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:24.672530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 464/914] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:30:24.701640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0025e2-8883-4d61-a6a8-b41ec56725a5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:24.802737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0025e2-8883-4d61-a6a8-b41ec56725a5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:24.839735 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fed801-0abf-4039-beb8-92681aab96fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:24.840530 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fed801-0abf-4039-beb8-92681aab96fa None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:24.840812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fed801-0abf-4039-beb8-92681aab96fa None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:24.841086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fed801-0abf-4039-beb8-92681aab96fa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:24.841787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fed801-0abf-4039-beb8-92681aab96fa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:24.843433 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fed801-0abf-4039-beb8-92681aab96fa None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a8fed801-0abf-4039-beb8-92681aab96fa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:24.855975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:24.857029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:24.857029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:24.857029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:24.857029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:24.857029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:24.857029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:24.857029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:24.857029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:24.857029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:24.857029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:24.857029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:24.857029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:24.857029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:24.857029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:24.857029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:24.857029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:24.857844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:24.857844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:24.857844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:24.857844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:24.857844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:24.857844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:24.857844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:24.857844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:24.857844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:24.857844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:24.857844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:24.857844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:24.857844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 17:30:24.857844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:24.857844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 451/915] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:30:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:24.862762 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a258b4-3b41-423a-a13e-81ba8ea5f6b7 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:24.863049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a258b4-3b41-423a-a13e-81ba8ea5f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:24.863220 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fed801-0abf-4039-beb8-92681aab96fa None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:24.863374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a258b4-3b41-423a-a13e-81ba8ea5f6b7 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:24.868504 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 465/916] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:24.870000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7c102-8a0c-4bd8-8019-9e7ce4dadc4b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:24.870283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7c102-8a0c-4bd8-8019-9e7ce4dadc4b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:24.871123 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7c102-8a0c-4bd8-8019-9e7ce4dadc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:24.890919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-84a7c102-8a0c-4bd8-8019-9e7ce4dadc4b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:24.892086 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-84a7c102-8a0c-4bd8-8019-9e7ce4dadc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:24.968767 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fed801-0abf-4039-beb8-92681aab96fa None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:24.972504 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 466/917] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:30:24.995166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7c102-8a0c-4bd8-8019-9e7ce4dadc4b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:25.010255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ca59d-edcf-45a1-9e89-817ec9b623a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:25.012380 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ca59d-edcf-45a1-9e89-817ec9b623a7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:25.012991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ca59d-edcf-45a1-9e89-817ec9b623a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:25.013472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ca59d-edcf-45a1-9e89-817ec9b623a7 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:25.014416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ca59d-edcf-45a1-9e89-817ec9b623a7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:25.014942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ca59d-edcf-45a1-9e89-817ec9b623a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:25.016730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ca59d-edcf-45a1-9e89-817ec9b623a7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:25.026776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 452/918] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:30:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:25.028980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ca59d-edcf-45a1-9e89-817ec9b623a7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:25.107107 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7c102-8a0c-4bd8-8019-9e7ce4dadc4b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:25.135722 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ca59d-edcf-45a1-9e89-817ec9b623a7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:25.150563 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95054af3-cfbe-46a5-874b-eee0daa29425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:25.151371 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054af3-cfbe-46a5-874b-eee0daa29425 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:25.151681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054af3-cfbe-46a5-874b-eee0daa29425 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:25.152589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054af3-cfbe-46a5-874b-eee0daa29425 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:25.165871 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95054af3-cfbe-46a5-874b-eee0daa29425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:25.176386 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8b6e8-2880-4695-b7f9-cf00e295f7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:25.177150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8b6e8-2880-4695-b7f9-cf00e295f7da None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:25.177428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8b6e8-2880-4695-b7f9-cf00e295f7da None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:25.177701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8b6e8-2880-4695-b7f9-cf00e295f7da None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:25.178410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8b6e8-2880-4695-b7f9-cf00e295f7da None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:25.178687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-95054af3-cfbe-46a5-874b-eee0daa29425 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:30:25.178687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:25.178687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:25.178687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:25.178687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:25.178687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:25.178687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:25.178687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:25.178687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:25.178687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:25.178687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:25.178687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:25.178687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:25.178687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:25.178687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:25.178687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:25.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:25.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:25.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:25.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:25.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:25.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:25.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:25.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:25.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:25.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:25.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:25.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:25.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:25.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:25.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:25.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:25.180408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:25.180408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:25.180408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:25.180408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:25.180408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:25.180408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:25.180408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:25.180408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:25.180408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:25.180408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:25.180408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:30:25.180408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:25.181056 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8b6e8-2880-4695-b7f9-cf00e295f7da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:25.181056 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8b6e8-2880-4695-b7f9-cf00e295f7da None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:25.188732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 467/919] 10.222.0.81 () {56 vars in 1120 bytes} [Wed May 4 17:30:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:25.191115 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 453/920] 10.222.0.81 () {56 vars in 1114 bytes} [Wed May 4 17:30:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:25.192282 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95054af3-cfbe-46a5-874b-eee0daa29425 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:25.197084 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8b6e8-2880-4695-b7f9-cf00e295f7da None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:25.317305 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95054af3-cfbe-46a5-874b-eee0daa29425 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:25.343629 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8b6e8-2880-4695-b7f9-cf00e295f7da None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:25.365368 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c5c52-6b60-4b7f-b7ac-fea248695c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:25.366438 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c5c52-6b60-4b7f-b7ac-fea248695c67 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:25.366997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c5c52-6b60-4b7f-b7ac-fea248695c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:25.367524 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c5c52-6b60-4b7f-b7ac-fea248695c67 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:25.368566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c5c52-6b60-4b7f-b7ac-fea248695c67 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:25.369073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c5c52-6b60-4b7f-b7ac-fea248695c67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:25.371374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c5c52-6b60-4b7f-b7ac-fea248695c67 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:25.384944 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 468/921] 10.222.0.81 () {56 vars in 1115 bytes} [Wed May 4 17:30:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:25.386977 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c5c52-6b60-4b7f-b7ac-fea248695c67 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:25.387518 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ce98f-75bd-411a-b683-72f5246c029c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:25.388282 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ce98f-75bd-411a-b683-72f5246c029c None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:25.388612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ce98f-75bd-411a-b683-72f5246c029c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:25.388934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ce98f-75bd-411a-b683-72f5246c029c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:25.389765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ce98f-75bd-411a-b683-72f5246c029c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:25.391401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ce98f-75bd-411a-b683-72f5246c029c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:25.512465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 454/922] 10.222.0.81 () {60 vars in 1144 bytes} [Wed May 4 17:30:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:30:25.515290 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c5c52-6b60-4b7f-b7ac-fea248695c67 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:25.565441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eefb7e-8c37-476d-ac9d-0d99ed9af8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:25.568460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eefb7e-8c37-476d-ac9d-0d99ed9af8ee None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:25.568460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eefb7e-8c37-476d-ac9d-0d99ed9af8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:25.568460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eefb7e-8c37-476d-ac9d-0d99ed9af8ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:25.594008 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eefb7e-8c37-476d-ac9d-0d99ed9af8ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:25.595973 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eefb7e-8c37-476d-ac9d-0d99ed9af8ee None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:25.616516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-93eefb7e-8c37-476d-ac9d-0d99ed9af8ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:25.616516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:25.616516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:25.616516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:25.616516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:25.616516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:25.616516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:25.616516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:25.616516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:25.616516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:25.616516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:25.616516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:25.616516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:25.616516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:25.616516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:25.617452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:25.618400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:25.618400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:25.618400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:25.618400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:25.626370 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 469/923] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:25.629598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ce98f-75bd-411a-b683-72f5246c029c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:25.652720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a530d-fc1a-4a31-b57f-0c5b9ce4c4ba None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:25.653022 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a530d-fc1a-4a31-b57f-0c5b9ce4c4ba None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:25.653452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a530d-fc1a-4a31-b57f-0c5b9ce4c4ba None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:25.655127 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 470/924] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:30:25.660732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb652-14a2-4d0a-a64e-02aba4a6ebc3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:25.661302 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb652-14a2-4d0a-a64e-02aba4a6ebc3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:25.661780 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb652-14a2-4d0a-a64e-02aba4a6ebc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:25.686835 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-59deb652-14a2-4d0a-a64e-02aba4a6ebc3 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:25.688465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-59deb652-14a2-4d0a-a64e-02aba4a6ebc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:25.760006 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ce98f-75bd-411a-b683-72f5246c029c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:25.773014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 471/925] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:25.797236 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deb652-14a2-4d0a-a64e-02aba4a6ebc3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:25.802651 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55150fee-83b5-41ad-8f57-5065f1b6abe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:25.803553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55150fee-83b5-41ad-8f57-5065f1b6abe6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:25.804036 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55150fee-83b5-41ad-8f57-5065f1b6abe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:25.804484 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55150fee-83b5-41ad-8f57-5065f1b6abe6 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:25.805362 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55150fee-83b5-41ad-8f57-5065f1b6abe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:25.806313 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55150fee-83b5-41ad-8f57-5065f1b6abe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:25.808755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55150fee-83b5-41ad-8f57-5065f1b6abe6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:25.824484 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 455/926] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:25.829317 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55150fee-83b5-41ad-8f57-5065f1b6abe6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:25.921406 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deb652-14a2-4d0a-a64e-02aba4a6ebc3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:25.956401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fa2f3-f237-433d-8e2c-f1f7657e8699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:25.956807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55150fee-83b5-41ad-8f57-5065f1b6abe6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:25.957701 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fa2f3-f237-433d-8e2c-f1f7657e8699 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:25.958125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fa2f3-f237-433d-8e2c-f1f7657e8699 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:25.958555 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fa2f3-f237-433d-8e2c-f1f7657e8699 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:25.959357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fa2f3-f237-433d-8e2c-f1f7657e8699 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:25.960984 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fa2f3-f237-433d-8e2c-f1f7657e8699 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-000fa2f3-f237-433d-8e2c-f1f7657e8699 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:25.974054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:25.975071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:25.975071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:25.975071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:25.975071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:25.975071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:25.975071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:25.975071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:25.975071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:25.975071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:25.975071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:25.975071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:25.975071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:25.975071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:25.975071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:25.975071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:25.975071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:25.975872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:25.975872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:25.975872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:25.975872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:25.975872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:25.975872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:25.975872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:25.975872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:25.975872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:25.975872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:25.975872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:25.975872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:25.975872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:30:25.975872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:25.978697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 472/927] 10.222.0.81 () {56 vars in 1126 bytes} [Wed May 4 17:30:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:25.984545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fa2f3-f237-433d-8e2c-f1f7657e8699 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:26.000043 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8f400-7416-4c4d-9695-d473668ab2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:26.001030 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8f400-7416-4c4d-9695-d473668ab2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:26.001379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8f400-7416-4c4d-9695-d473668ab2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:26.001725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8f400-7416-4c4d-9695-d473668ab2d3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:26.010839 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8f400-7416-4c4d-9695-d473668ab2d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:26.013308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8f400-7416-4c4d-9695-d473668ab2d3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:26.029128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9ca8f400-7416-4c4d-9695-d473668ab2d3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:30:26.029128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:26.029128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:26.029128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:26.029128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:26.029128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:26.029128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:26.029128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:26.029128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:26.029128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:26.029128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:26.029128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:26.029128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:30:26.029128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:30:26.029128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:30:26.029128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:26.030113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:26.031035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:26.031035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:26.031035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:30:26.031035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:30:26.031035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:30:26.031035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:30:26.031035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:30:26.031035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:30:26.031035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:30:26.031035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:26.031035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 456/928] 10.222.0.81 () {56 vars in 1117 bytes} [Wed May 4 17:30:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:26.041024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8f400-7416-4c4d-9695-d473668ab2d3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:26.116593 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fa2f3-f237-433d-8e2c-f1f7657e8699 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:26.151202 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1529486-5c3c-40be-8fd8-f01b61325a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:26.151930 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1529486-5c3c-40be-8fd8-f01b61325a6f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:26.152193 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1529486-5c3c-40be-8fd8-f01b61325a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:26.152556 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1529486-5c3c-40be-8fd8-f01b61325a6f None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:26.153270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1529486-5c3c-40be-8fd8-f01b61325a6f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:26.153575 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1529486-5c3c-40be-8fd8-f01b61325a6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:26.154467 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8f400-7416-4c4d-9695-d473668ab2d3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:26.154952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1529486-5c3c-40be-8fd8-f01b61325a6f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:26.164521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 473/929] 10.222.0.81 () {56 vars in 1122 bytes} [Wed May 4 17:30:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:26.165386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1529486-5c3c-40be-8fd8-f01b61325a6f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:26.191309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51a844-9303-4f01-bef2-d2db23794a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:26.192074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a844-9303-4f01-bef2-d2db23794a8d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:26.192354 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a844-9303-4f01-bef2-d2db23794a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:26.192707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a844-9303-4f01-bef2-d2db23794a8d None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:26.193556 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51a844-9303-4f01-bef2-d2db23794a8d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:26.193860 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51a844-9303-4f01-bef2-d2db23794a8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:26.195381 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51a844-9303-4f01-bef2-d2db23794a8d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:26.224463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 457/930] 10.222.0.81 () {56 vars in 1149 bytes} [Wed May 4 17:30:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:26.224463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51a844-9303-4f01-bef2-d2db23794a8d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:26.274969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1529486-5c3c-40be-8fd8-f01b61325a6f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:26.311309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587848f-b2bd-461f-a772-09af136df3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:26.311971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587848f-b2bd-461f-a772-09af136df3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:26.312250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587848f-b2bd-461f-a772-09af136df3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:26.312550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587848f-b2bd-461f-a772-09af136df3a1 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:26.313258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587848f-b2bd-461f-a772-09af136df3a1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:26.313560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587848f-b2bd-461f-a772-09af136df3a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:26.320470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587848f-b2bd-461f-a772-09af136df3a1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:26.327442 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51a844-9303-4f01-bef2-d2db23794a8d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:26.332469 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 474/931] 10.222.0.81 () {56 vars in 1122 bytes} [Wed May 4 17:30:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:26.332469 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587848f-b2bd-461f-a772-09af136df3a1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:26.370715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0c797-27a9-409d-8328-4376ecc38601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:26.371911 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0c797-27a9-409d-8328-4376ecc38601 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:26.372372 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0c797-27a9-409d-8328-4376ecc38601 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:26.372916 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0c797-27a9-409d-8328-4376ecc38601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:26.385283 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0c797-27a9-409d-8328-4376ecc38601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:26.388144 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0c797-27a9-409d-8328-4376ecc38601 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:26.408246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0ac0c797-27a9-409d-8328-4376ecc38601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:26.408246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:26.408246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:26.408246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:26.408246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:26.408246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:26.408246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:26.408246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:26.408246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:26.408246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:26.408246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:26.408246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:26.408246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:26.408246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:26.408246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:26.409279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:26.410135 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:26.410135 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:26.410135 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:26.410135 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:26.416424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 458/932] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:26.418535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0c797-27a9-409d-8328-4376ecc38601 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:26.447491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587848f-b2bd-461f-a772-09af136df3a1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:26.482811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013dcdb-ff54-4599-bb0e-7ce4c5e4f3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:26.483473 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013dcdb-ff54-4599-bb0e-7ce4c5e4f3ad None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:26.483750 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013dcdb-ff54-4599-bb0e-7ce4c5e4f3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:26.484059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013dcdb-ff54-4599-bb0e-7ce4c5e4f3ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:26.484925 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013dcdb-ff54-4599-bb0e-7ce4c5e4f3ad None admin] RBAC: Adding query filter params (interface=public, service_id=b0cab488f62a407d8f25314b219654a8, region_id=RegionOne) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:26.485400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013dcdb-ff54-4599-bb0e-7ce4c5e4f3ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:26.486589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013dcdb-ff54-4599-bb0e-7ce4c5e4f3ad None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:26.492337 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 475/933] 10.222.0.81 () {56 vars in 1251 bytes} [Wed May 4 17:30:26 2022] GET /identity/v3/endpoints?service_id=b0cab488f62a407d8f25314b219654a8&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:26.497712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013dcdb-ff54-4599-bb0e-7ce4c5e4f3ad None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:26.528278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0c797-27a9-409d-8328-4376ecc38601 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:26.563025 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf2f8b-23a9-48e7-a9b2-b26a090c0401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:26.564044 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf2f8b-23a9-48e7-a9b2-b26a090c0401 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:26.564574 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf2f8b-23a9-48e7-a9b2-b26a090c0401 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:26.565049 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf2f8b-23a9-48e7-a9b2-b26a090c0401 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:26.565979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf2f8b-23a9-48e7-a9b2-b26a090c0401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:26.566502 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf2f8b-23a9-48e7-a9b2-b26a090c0401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:26.568108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf2f8b-23a9-48e7-a9b2-b26a090c0401 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:26.580821 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 459/934] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:26.582542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e969823-92e5-4b9f-933b-57a9305f05bb None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:26.583030 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e969823-92e5-4b9f-933b-57a9305f05bb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:26.583498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e969823-92e5-4b9f-933b-57a9305f05bb None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:26.585334 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 460/935] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:26.586268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e969823-92e5-4b9f-933b-57a9305f05bb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:26.611434 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013dcdb-ff54-4599-bb0e-7ce4c5e4f3ad None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:26.648071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348299b-b603-4b3a-a10c-6c9c02b93bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:26.648784 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348299b-b603-4b3a-a10c-6c9c02b93bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:26.649045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348299b-b603-4b3a-a10c-6c9c02b93bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:26.649314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348299b-b603-4b3a-a10c-6c9c02b93bb7 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:26.650042 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348299b-b603-4b3a-a10c-6c9c02b93bb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:26.651479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348299b-b603-4b3a-a10c-6c9c02b93bb7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:26.660566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 476/936] 10.222.0.81 () {56 vars in 1087 bytes} [Wed May 4 17:30:26 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:30:26.661829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1f38e-4211-4987-8972-a7cbe45d256b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:26.662115 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1f38e-4211-4987-8972-a7cbe45d256b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:26.662391 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1f38e-4211-4987-8972-a7cbe45d256b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:26.684524 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e0d1f38e-4211-4987-8972-a7cbe45d256b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:26.684524 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e0d1f38e-4211-4987-8972-a7cbe45d256b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:26.711249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e969823-92e5-4b9f-933b-57a9305f05bb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:26.753625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3e024-403b-4334-b9b8-0c365e8db071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:26.754722 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3e024-403b-4334-b9b8-0c365e8db071 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:26.755007 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3e024-403b-4334-b9b8-0c365e8db071 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:26.755332 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3e024-403b-4334-b9b8-0c365e8db071 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:26.758033 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 477/937] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:26.774252 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3e024-403b-4334-b9b8-0c365e8db071 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:26.775994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3e024-403b-4334-b9b8-0c365e8db071 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:26.787273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1f38e-4211-4987-8972-a7cbe45d256b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:26.799531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ace3e024-403b-4334-b9b8-0c365e8db071 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:26.799531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:26.799531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:26.799531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:26.799531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:26.799531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:26.799531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:26.799531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:26.799531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:26.799531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:26.799531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:26.799531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:26.799531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:30:26.799531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:30:26.799531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:26.800535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:26.801437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:30:26.801437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:30:26.801437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:30:26.801437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:30:26.801437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:30:26.801437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:30:26.801437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:26.801437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:26.802731 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 461/938] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:26.808075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3e024-403b-4334-b9b8-0c365e8db071 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:26.914490 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1f38e-4211-4987-8972-a7cbe45d256b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:26.938688 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3e024-403b-4334-b9b8-0c365e8db071 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:26.951916 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f3f4b-6887-41cc-825b-6bbf23067520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:26.952799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f3f4b-6887-41cc-825b-6bbf23067520 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:26.953080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f3f4b-6887-41cc-825b-6bbf23067520 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:26.953349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f3f4b-6887-41cc-825b-6bbf23067520 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:26.954016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f3f4b-6887-41cc-825b-6bbf23067520 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:26.955380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f3f4b-6887-41cc-825b-6bbf23067520 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:26.968511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-491f3f4b-6887-41cc-825b-6bbf23067520 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:30:26.968511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:26.968511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:26.968511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:26.968511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:26.968511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:26.968511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:26.968511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:26.968511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:30:26.968511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:26.968511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:26.968511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:26.968511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:26.968511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:26.968511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:26.968511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:26.969485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:26.969485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:26.969485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:26.969485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:26.969485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:26.969485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:26.969485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:26.969485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:26.969485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:26.969485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:26.969485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:26.969485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:26.969485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:26.969485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:26.969485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:26.969485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:26.970357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:26.970357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:26.970357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:26.970357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:26.970357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:26.970357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:26.970357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:26.970357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:26.970357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:26.970357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:26.970357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:26.970357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:26.970357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:26.970357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 17:30:26.970357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:26.970357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 478/939] 10.222.0.81 () {56 vars in 1132 bytes} [Wed May 4 17:30:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:26.976626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c6f82-582c-4568-a2a9-8546c4ca5c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:26.980469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c6f82-582c-4568-a2a9-8546c4ca5c8d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:26.980469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c6f82-582c-4568-a2a9-8546c4ca5c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:26.980469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c6f82-582c-4568-a2a9-8546c4ca5c8d None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:26.980971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f3f4b-6887-41cc-825b-6bbf23067520 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:26.981161 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c6f82-582c-4568-a2a9-8546c4ca5c8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:26.981161 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c6f82-582c-4568-a2a9-8546c4ca5c8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:26.981161 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c6f82-582c-4568-a2a9-8546c4ca5c8d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:27.002116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 462/940] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:30:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:27.008462 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c6f82-582c-4568-a2a9-8546c4ca5c8d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:27.096466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f3f4b-6887-41cc-825b-6bbf23067520 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:27.112466 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c6f82-582c-4568-a2a9-8546c4ca5c8d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:27.132674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c9585-ed1f-4359-b073-71111b187d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:27.136460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c9585-ed1f-4359-b073-71111b187d02 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:27.136460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c9585-ed1f-4359-b073-71111b187d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:27.136460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c9585-ed1f-4359-b073-71111b187d02 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:27.136460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c9585-ed1f-4359-b073-71111b187d02 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:27.136460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c9585-ed1f-4359-b073-71111b187d02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:27.137214 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c9585-ed1f-4359-b073-71111b187d02 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:27.142181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 479/941] 10.222.0.81 () {56 vars in 1126 bytes} [Wed May 4 17:30:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:27.147336 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcae67a-ddd3-4437-b248-b5fa41e4f3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:27.147772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c9585-ed1f-4359-b073-71111b187d02 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:27.148307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcae67a-ddd3-4437-b248-b5fa41e4f3b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:27.148562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcae67a-ddd3-4437-b248-b5fa41e4f3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:27.148847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcae67a-ddd3-4437-b248-b5fa41e4f3b0 None admin] PATH_INFO: `/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/ef7da67b09104f4991befeb14cd0581b/roles/ca2ed1519dea4a5f9b31d465765c20a4` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:27.151138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcae67a-ddd3-4437-b248-b5fa41e4f3b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=544a56c4b97e43aea9fbb003d80af8dc, user_id=ef7da67b09104f4991befeb14cd0581b, role_id=ca2ed1519dea4a5f9b31d465765c20a4)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:27.153274 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcae67a-ddd3-4437-b248-b5fa41e4f3b0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:27.249635 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c9585-ed1f-4359-b073-71111b187d02 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:27.272461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 463/942] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:30:27 2022] PUT /identity/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/ef7da67b09104f4991befeb14cd0581b/roles/ca2ed1519dea4a5f9b31d465765c20a4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:30:27.295743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8f867-3c76-498c-9dc1-3e21a4df190a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:27.296558 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8f867-3c76-498c-9dc1-3e21a4df190a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:27.296840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8f867-3c76-498c-9dc1-3e21a4df190a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:27.297165 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8f867-3c76-498c-9dc1-3e21a4df190a None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:27.297957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8f867-3c76-498c-9dc1-3e21a4df190a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:27.298266 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8f867-3c76-498c-9dc1-3e21a4df190a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:27.299806 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8f867-3c76-498c-9dc1-3e21a4df190a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:27.306584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 480/943] 10.222.0.81 () {56 vars in 1126 bytes} [Wed May 4 17:30:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:27.312235 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcae67a-ddd3-4437-b248-b5fa41e4f3b0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:27.443765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcae67a-ddd3-4437-b248-b5fa41e4f3b0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:27.487040 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638ed25-3675-444c-9fae-c2c84bb0c0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:27.487709 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638ed25-3675-444c-9fae-c2c84bb0c0fb None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:27.488058 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638ed25-3675-444c-9fae-c2c84bb0c0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:27.488346 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638ed25-3675-444c-9fae-c2c84bb0c0fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:27.489142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638ed25-3675-444c-9fae-c2c84bb0c0fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:27.490518 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638ed25-3675-444c-9fae-c2c84bb0c0fb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:27.600320 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 464/944] 10.222.0.81 () {60 vars in 1144 bytes} [Wed May 4 17:30:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:30:28.028827 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ac96c-6fcd-4e84-a3e7-0ddf1937ecbd None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:28.029231 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ac96c-6fcd-4e84-a3e7-0ddf1937ecbd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:28.029430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ac96c-6fcd-4e84-a3e7-0ddf1937ecbd None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:28.032241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 481/945] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:28.039619 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b155b-4644-4f40-bf96-e05c7ad14a43 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:28.039911 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b155b-4644-4f40-bf96-e05c7ad14a43 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:28.040192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b155b-4644-4f40-bf96-e05c7ad14a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:28.057449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e03b155b-4644-4f40-bf96-e05c7ad14a43 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:28.058951 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e03b155b-4644-4f40-bf96-e05c7ad14a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:28.138047 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 465/946] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:28.158567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ac96c-6fcd-4e84-a3e7-0ddf1937ecbd None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:28.285799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ac96c-6fcd-4e84-a3e7-0ddf1937ecbd None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:28.330552 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c756436-9cd2-447c-b2ac-29ca3675ee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:28.331223 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c756436-9cd2-447c-b2ac-29ca3675ee21 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:28.331504 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c756436-9cd2-447c-b2ac-29ca3675ee21 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:28.336815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c756436-9cd2-447c-b2ac-29ca3675ee21 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:28.337571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c756436-9cd2-447c-b2ac-29ca3675ee21 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:28.339165 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c756436-9cd2-447c-b2ac-29ca3675ee21 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:28.341074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: WARNING keystone.server.flask.common [None req-7c756436-9cd2-447c-b2ac-29ca3675ee21 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 04 17:30:28.404282 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.sql.core [None req-7c756436-9cd2-447c-b2ac-29ca3675ee21 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 17:30:28.404282 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 17:30:28.404282 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [parameters: {'id': 'dcbbff8f5d44463ea43b7ddfbd119e08', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 17:30:28.404282 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80386) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 17:30:28.422729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7c756436-9cd2-447c-b2ac-29ca3675ee21 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dcbbff8f5d44463ea43b7ddfbd119e08.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dcbbff8f5d44463ea43b7ddfbd119e08. May 04 17:30:28.422729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:28.422729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 17:30:28.422729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 17:30:28.422729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 17:30:28.422729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 17:30:28.422729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 17:30:28.422729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application result = self._query(query) May 04 17:30:28.422729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 17:30:28.422729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application conn.query(q) May 04 17:30:28.422729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 17:30:28.422729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 17:30:28.422729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application result.read() May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 04 17:30:28.425043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return project_ref.to_dict() May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application next(self.gen) May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application yield resource May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application next(self.gen) May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.session.rollback() May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.force_reraise() May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise self.value May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application session.commit() May 04 17:30:28.425986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._prepare_impl() May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.session.flush() May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._flush(objects) May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application compat.raise_( May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application flush_context.execute() May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 17:30:28.426850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rec.execute(self) May 04 17:30:28.427727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 17:30:28.427727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 17:30:28.427727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 17:30:28.427727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 17:30:28.427727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 17:30:28.427727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 17:30:28.427727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 17:30:28.427727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 17:30:28.427727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 17:30:28.427727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 17:30:28.427727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 17:30:28.427727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 17:30:28.427727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 17:30:28.427727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 17:30:28.427727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application result = self._query(query) May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application conn.query(q) May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application result.read() May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 17:30:28.428510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 17:30:28.429376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 17:30:28.429376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 17:30:28.429376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 17:30:28.429376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 17:30:28.429376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 17:30:28.429376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 17:30:28.429376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 17:30:28.429376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 17:30:28.429376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [parameters: {'id': 'dcbbff8f5d44463ea43b7ddfbd119e08', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 17:30:28.429376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 17:30:28.429376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:28.429376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:28.429376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:28.429376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:28.429376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:28.432427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:28.436343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:28.436343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 04 17:30:28.436343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 04 17:30:28.436343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:28.436343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:28.436343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 04 17:30:28.436343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.Conflict( May 04 17:30:28.436343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dcbbff8f5d44463ea43b7ddfbd119e08. May 04 17:30:28.436343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:28.436343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 482/947] 10.222.0.81 () {60 vars in 1140 bytes} [Wed May 4 17:30:28 2022] POST /identity/v3/projects => generated 262 bytes in 271 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:28.437908 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b155b-4644-4f40-bf96-e05c7ad14a43 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:28.540691 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b155b-4644-4f40-bf96-e05c7ad14a43 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:28.575763 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05771ba5-dad2-4dad-b867-853197522c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:28.576644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05771ba5-dad2-4dad-b867-853197522c5e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:28.576935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05771ba5-dad2-4dad-b867-853197522c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:28.577215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05771ba5-dad2-4dad-b867-853197522c5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:28.584632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05771ba5-dad2-4dad-b867-853197522c5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:28.586251 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05771ba5-dad2-4dad-b867-853197522c5e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:28.601390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-05771ba5-dad2-4dad-b867-853197522c5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:28.601390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:28.601390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:28.601390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:28.601390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:28.601390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:28.601390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:28.601390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:28.601390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:28.601390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:28.601390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:28.601390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:28.601390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:30:28.601390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:30:28.601390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:28.603478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:28.606048 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:30:28.606048 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:30:28.606048 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:30:28.606048 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:30:28.606048 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:30:28.606048 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:30:28.606048 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:28.606048 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:28.612480 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 466/948] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:28.612693 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c756436-9cd2-447c-b2ac-29ca3675ee21 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:28.715582 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c756436-9cd2-447c-b2ac-29ca3675ee21 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:28.752333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b489a-c60e-4586-a5d7-1ac172d8a03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:28.753047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b489a-c60e-4586-a5d7-1ac172d8a03e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:28.753328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b489a-c60e-4586-a5d7-1ac172d8a03e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:28.753601 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b489a-c60e-4586-a5d7-1ac172d8a03e None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:28.754423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b489a-c60e-4586-a5d7-1ac172d8a03e None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:28.754727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b489a-c60e-4586-a5d7-1ac172d8a03e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:28.756388 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b489a-c60e-4586-a5d7-1ac172d8a03e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:28.784756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 483/949] 10.222.0.81 () {56 vars in 1112 bytes} [Wed May 4 17:30:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:29.082643 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0887c6-7d74-4019-ba0a-bc3dde6f0a12 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:29.083019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0887c6-7d74-4019-ba0a-bc3dde6f0a12 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:29.083212 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0887c6-7d74-4019-ba0a-bc3dde6f0a12 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:29.084855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 467/950] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:29.091232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58a7d0-8bac-4968-9cf0-1b27c3ec327c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:29.091521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58a7d0-8bac-4968-9cf0-1b27c3ec327c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:29.091793 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58a7d0-8bac-4968-9cf0-1b27c3ec327c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:29.109847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6d58a7d0-8bac-4968-9cf0-1b27c3ec327c None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:29.111326 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6d58a7d0-8bac-4968-9cf0-1b27c3ec327c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:29.180166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 484/951] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:29.204647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0887c6-7d74-4019-ba0a-bc3dde6f0a12 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:29.312894 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0887c6-7d74-4019-ba0a-bc3dde6f0a12 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:29.357258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea04ffe-2dbf-45a2-8819-6f8c1328d436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:29.358068 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea04ffe-2dbf-45a2-8819-6f8c1328d436 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:29.358354 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea04ffe-2dbf-45a2-8819-6f8c1328d436 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:29.358633 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea04ffe-2dbf-45a2-8819-6f8c1328d436 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:29.359289 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea04ffe-2dbf-45a2-8819-6f8c1328d436 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:29.360738 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea04ffe-2dbf-45a2-8819-6f8c1328d436 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-aea04ffe-2dbf-45a2-8819-6f8c1328d436 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:29.373506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:29.374514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:29.374514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:29.374514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:29.374514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:29.374514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:29.374514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:29.374514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:29.374514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:29.374514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:29.374514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:29.374514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:29.374514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:29.374514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:29.374514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:29.374514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:29.374514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:29.375338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:29.375338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:29.375338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:29.375338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:29.375338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:29.375338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:29.375338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:29.375338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:29.375338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:29.375338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:29.375338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:29.375338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:29.375338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:30:29.375338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:29.375338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 468/952] 10.222.0.81 () {56 vars in 1126 bytes} [Wed May 4 17:30:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:29.380637 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58a7d0-8bac-4968-9cf0-1b27c3ec327c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:29.484649 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58a7d0-8bac-4968-9cf0-1b27c3ec327c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:29.519445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3128c9-79d6-4216-afe4-13596a8cdc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:29.520096 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3128c9-79d6-4216-afe4-13596a8cdc2a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:29.520371 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3128c9-79d6-4216-afe4-13596a8cdc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:29.520667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3128c9-79d6-4216-afe4-13596a8cdc2a None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:29.521369 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3128c9-79d6-4216-afe4-13596a8cdc2a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:29.521670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3128c9-79d6-4216-afe4-13596a8cdc2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:29.523018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3128c9-79d6-4216-afe4-13596a8cdc2a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:29.528913 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 485/953] 10.222.0.81 () {56 vars in 1122 bytes} [Wed May 4 17:30:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:29.535338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea04ffe-2dbf-45a2-8819-6f8c1328d436 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:29.650566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea04ffe-2dbf-45a2-8819-6f8c1328d436 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:29.692472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11af38-3fc1-40fe-9983-618ee66e79ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:29.696460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11af38-3fc1-40fe-9983-618ee66e79ce None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:29.696460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11af38-3fc1-40fe-9983-618ee66e79ce None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:29.696460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11af38-3fc1-40fe-9983-618ee66e79ce None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:29.696460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11af38-3fc1-40fe-9983-618ee66e79ce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:29.696460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11af38-3fc1-40fe-9983-618ee66e79ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:29.696460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11af38-3fc1-40fe-9983-618ee66e79ce None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:29.704469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 469/954] 10.222.0.81 () {56 vars in 1122 bytes} [Wed May 4 17:30:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:29.707341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3128c9-79d6-4216-afe4-13596a8cdc2a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:29.738288 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b4d5f-16e3-4b63-8624-01f3f28b509a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:29.738605 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b4d5f-16e3-4b63-8624-01f3f28b509a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:29.738864 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b4d5f-16e3-4b63-8624-01f3f28b509a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:29.740582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 470/955] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:30:29.746041 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e26d56-53a3-4e3c-8ecd-82c75f374ddc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:29.746452 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e26d56-53a3-4e3c-8ecd-82c75f374ddc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:29.746737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e26d56-53a3-4e3c-8ecd-82c75f374ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:29.765254 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-74e26d56-53a3-4e3c-8ecd-82c75f374ddc None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:29.767027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-74e26d56-53a3-4e3c-8ecd-82c75f374ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:29.820426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3128c9-79d6-4216-afe4-13596a8cdc2a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:29.848543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 471/956] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:29.857142 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d66c91-2660-4718-b7f9-0ac195afbe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:29.858062 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d66c91-2660-4718-b7f9-0ac195afbe1e None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:29.858541 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d66c91-2660-4718-b7f9-0ac195afbe1e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:29.859035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d66c91-2660-4718-b7f9-0ac195afbe1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:29.859980 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d66c91-2660-4718-b7f9-0ac195afbe1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:29.861600 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d66c91-2660-4718-b7f9-0ac195afbe1e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:29.866934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e26d56-53a3-4e3c-8ecd-82c75f374ddc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:29.954089 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 486/957] 10.222.0.81 () {60 vars in 1144 bytes} [Wed May 4 17:30:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:30:29.957097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf7525-b67b-436f-b0f3-f7b739dc4976 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:29.959713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf7525-b67b-436f-b0f3-f7b739dc4976 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:29.959713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf7525-b67b-436f-b0f3-f7b739dc4976 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:29.960246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 487/958] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:30:29.967277 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4521be-ebb4-481c-8ad3-93ab44a9e45b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:29.967909 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4521be-ebb4-481c-8ad3-93ab44a9e45b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:29.968752 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4521be-ebb4-481c-8ad3-93ab44a9e45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:29.977908 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e26d56-53a3-4e3c-8ecd-82c75f374ddc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:29.999678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7c4521be-ebb4-481c-8ad3-93ab44a9e45b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:30.002777 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7c4521be-ebb4-481c-8ad3-93ab44a9e45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:30.031352 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed50a0-c7bb-4485-8d5b-8fa65e44dc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:30.032177 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed50a0-c7bb-4485-8d5b-8fa65e44dc96 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:30.032485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed50a0-c7bb-4485-8d5b-8fa65e44dc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:30.033196 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed50a0-c7bb-4485-8d5b-8fa65e44dc96 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:30.047567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed50a0-c7bb-4485-8d5b-8fa65e44dc96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:30.058883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c0ed50a0-c7bb-4485-8d5b-8fa65e44dc96 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:30:30.058883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:30.058883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:30.058883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:30.058883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:30.058883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:30.058883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:30.058883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:30.058883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:30.058883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:30.058883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:30.058883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:30.058883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:30.058883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:30.058883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:30.058883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:30.059920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:30.059920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:30.059920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:30.059920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:30.059920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:30.059920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:30.059920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:30.059920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:30.059920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:30.059920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:30.059920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:30.059920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:30.059920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:30.059920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:30.059920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:30.059920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:30.060803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:30.060803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:30.060803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:30.060803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:30.060803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:30.060803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:30.060803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:30.060803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:30.060803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:30.060803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:30.060803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:30:30.060803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:30.060803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 472/959] 10.222.0.81 () {56 vars in 1120 bytes} [Wed May 4 17:30:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:30.070286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed50a0-c7bb-4485-8d5b-8fa65e44dc96 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:30.099526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 488/960] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:30:30.132464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4521be-ebb4-481c-8ad3-93ab44a9e45b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:30.197491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed50a0-c7bb-4485-8d5b-8fa65e44dc96 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:30.238955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f987eb5-b48f-4e46-94f9-d98afe02567c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:30.239942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f987eb5-b48f-4e46-94f9-d98afe02567c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:30.240291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f987eb5-b48f-4e46-94f9-d98afe02567c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:30.241685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f987eb5-b48f-4e46-94f9-d98afe02567c None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:30.244472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f987eb5-b48f-4e46-94f9-d98afe02567c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:30.244472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f987eb5-b48f-4e46-94f9-d98afe02567c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:30.247773 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f987eb5-b48f-4e46-94f9-d98afe02567c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:30.258087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4521be-ebb4-481c-8ad3-93ab44a9e45b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:30.263990 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 473/961] 10.222.0.81 () {56 vars in 1115 bytes} [Wed May 4 17:30:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:30.273377 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f987eb5-b48f-4e46-94f9-d98afe02567c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:30.302258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33ca39-72bc-43a4-8608-ddbd604fcef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:30.303040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33ca39-72bc-43a4-8608-ddbd604fcef2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:30.303322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33ca39-72bc-43a4-8608-ddbd604fcef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:30.303732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33ca39-72bc-43a4-8608-ddbd604fcef2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:30.304412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33ca39-72bc-43a4-8608-ddbd604fcef2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:30.306334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33ca39-72bc-43a4-8608-ddbd604fcef2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-0f33ca39-72bc-43a4-8608-ddbd604fcef2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:30.321893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:30.322946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:30.322946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:30.322946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:30.322946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:30.322946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:30.322946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:30.322946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:30.322946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:30.322946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:30.322946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:30.322946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:30.322946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:30.322946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:30.322946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:30.322946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:30.322946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:30.324318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:30.324318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:30.324318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:30.324318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:30.324318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:30.324318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:30.324318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:30.324318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:30.324318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:30.324318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:30.324318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:30.324318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:30.324318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:30:30.324318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:30.324318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 489/962] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:30.329115 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33ca39-72bc-43a4-8608-ddbd604fcef2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:30.396759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f987eb5-b48f-4e46-94f9-d98afe02567c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:30.432355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2b820-cd09-4296-bb1f-dc3f6d5930d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:30.434053 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2b820-cd09-4296-bb1f-dc3f6d5930d4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:30.434370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2b820-cd09-4296-bb1f-dc3f6d5930d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:30.434592 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2b820-cd09-4296-bb1f-dc3f6d5930d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:30.445533 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2b820-cd09-4296-bb1f-dc3f6d5930d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:30.448396 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2b820-cd09-4296-bb1f-dc3f6d5930d4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:30.452951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33ca39-72bc-43a4-8608-ddbd604fcef2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:30.470879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a3e2b820-cd09-4296-bb1f-dc3f6d5930d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:30.470879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:30.470879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:30.470879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:30.470879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:30.470879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:30.470879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:30.470879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:30.470879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:30.470879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:30.470879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:30.470879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:30.470879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:30.470879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:30.470879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:30.471841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:30.477362 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:30.477362 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:30.477362 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:30.477362 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:30.477362 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 474/963] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:30.479104 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2b820-cd09-4296-bb1f-dc3f6d5930d4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:30.498338 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065da14-15df-4d71-9351-cc83eb9fef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:30.498936 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065da14-15df-4d71-9351-cc83eb9fef5f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:30.499214 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065da14-15df-4d71-9351-cc83eb9fef5f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:30.499486 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065da14-15df-4d71-9351-cc83eb9fef5f None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:30.500246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065da14-15df-4d71-9351-cc83eb9fef5f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:30.500580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065da14-15df-4d71-9351-cc83eb9fef5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:30.502520 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065da14-15df-4d71-9351-cc83eb9fef5f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:30.508381 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 490/964] 10.222.0.81 () {56 vars in 1112 bytes} [Wed May 4 17:30:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:30.513931 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065da14-15df-4d71-9351-cc83eb9fef5f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:30.606188 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2b820-cd09-4296-bb1f-dc3f6d5930d4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:30.634201 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065da14-15df-4d71-9351-cc83eb9fef5f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:30.646991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82125388-95fd-47e1-a251-b0d4064d6202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:30.647790 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82125388-95fd-47e1-a251-b0d4064d6202 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:30.648190 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82125388-95fd-47e1-a251-b0d4064d6202 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:30.648610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82125388-95fd-47e1-a251-b0d4064d6202 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:30.649428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82125388-95fd-47e1-a251-b0d4064d6202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:30.649846 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82125388-95fd-47e1-a251-b0d4064d6202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:30.651383 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82125388-95fd-47e1-a251-b0d4064d6202 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:30.665080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 475/965] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:30.670143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82125388-95fd-47e1-a251-b0d4064d6202 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:30.688060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c3e40-96cf-445c-ad80-846e1c612d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:30.689400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c3e40-96cf-445c-ad80-846e1c612d95 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:30.689859 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c3e40-96cf-445c-ad80-846e1c612d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:30.690545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c3e40-96cf-445c-ad80-846e1c612d95 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:30.691409 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c3e40-96cf-445c-ad80-846e1c612d95 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:30.692027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c3e40-96cf-445c-ad80-846e1c612d95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:30.693891 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c3e40-96cf-445c-ad80-846e1c612d95 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:30.701131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 491/966] 10.222.0.81 () {56 vars in 1112 bytes} [Wed May 4 17:30:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:30.785798 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82125388-95fd-47e1-a251-b0d4064d6202 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:30.824623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd28565-4fa6-4041-b4ad-eebf0c3d51bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:30.825645 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd28565-4fa6-4041-b4ad-eebf0c3d51bb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:30.826199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd28565-4fa6-4041-b4ad-eebf0c3d51bb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:30.826566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd28565-4fa6-4041-b4ad-eebf0c3d51bb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:30.835074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd28565-4fa6-4041-b4ad-eebf0c3d51bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:30.836748 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd28565-4fa6-4041-b4ad-eebf0c3d51bb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:30.853782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0bd28565-4fa6-4041-b4ad-eebf0c3d51bb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:30:30.853782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:30.853782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:30.853782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:30.853782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:30.853782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:30.853782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:30.853782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:30.853782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:30.853782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:30.853782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:30.853782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:30.853782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:30:30.853782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:30:30.853782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:30:30.853782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:30.855662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:30.856827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:30.856827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:30.856827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:30:30.856827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:30:30.856827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:30:30.856827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:30:30.856827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:30:30.856827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:30:30.856827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 17:30:30.856827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:30.859534 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 476/967] 10.222.0.81 () {56 vars in 1117 bytes} [Wed May 4 17:30:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:30.864893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c3e40-96cf-445c-ad80-846e1c612d95 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:30.978615 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c3e40-96cf-445c-ad80-846e1c612d95 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:31.020467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd93ecd-3fa5-4b89-9542-673d02ed19df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:31.020467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd93ecd-3fa5-4b89-9542-673d02ed19df None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:31.020467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd93ecd-3fa5-4b89-9542-673d02ed19df None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:31.020467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd93ecd-3fa5-4b89-9542-673d02ed19df None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:31.020915 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd93ecd-3fa5-4b89-9542-673d02ed19df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:31.021220 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd93ecd-3fa5-4b89-9542-673d02ed19df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:31.022656 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd93ecd-3fa5-4b89-9542-673d02ed19df None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:31.041404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 492/968] 10.222.0.81 () {56 vars in 1149 bytes} [Wed May 4 17:30:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:31.048108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd28565-4fa6-4041-b4ad-eebf0c3d51bb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:31.158106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd28565-4fa6-4041-b4ad-eebf0c3d51bb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:31.195215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e93a3-ebb9-4e10-b479-05e5c41beb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:31.195865 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e93a3-ebb9-4e10-b479-05e5c41beb3b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:31.196143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e93a3-ebb9-4e10-b479-05e5c41beb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:31.196417 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e93a3-ebb9-4e10-b479-05e5c41beb3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:31.247216 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523c263-a718-40ad-8783-2047791b483c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:31.247532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523c263-a718-40ad-8783-2047791b483c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:31.247778 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523c263-a718-40ad-8783-2047791b483c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:31.249913 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 493/969] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:30:31.255074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc84a4-bd88-4d13-8d6a-1b0f30e4d18a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:31.255972 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc84a4-bd88-4d13-8d6a-1b0f30e4d18a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:31.255972 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc84a4-bd88-4d13-8d6a-1b0f30e4d18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:31.270849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e93a3-ebb9-4e10-b479-05e5c41beb3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:31.272311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e93a3-ebb9-4e10-b479-05e5c41beb3b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:31.279673 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-10bc84a4-bd88-4d13-8d6a-1b0f30e4d18a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:31.281872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-10bc84a4-bd88-4d13-8d6a-1b0f30e4d18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:31.365346 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 494/970] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:30:31.392632 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc84a4-bd88-4d13-8d6a-1b0f30e4d18a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:31.392952 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 477/971] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:30:31 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:30:31.394458 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e93a3-ebb9-4e10-b479-05e5c41beb3b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:31.494759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc84a4-bd88-4d13-8d6a-1b0f30e4d18a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:31.499453 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e93a3-ebb9-4e10-b479-05e5c41beb3b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:31.530507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580207b-3dcc-4abe-b8d4-851346bbec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:31.531182 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580207b-3dcc-4abe-b8d4-851346bbec17 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:31.531463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580207b-3dcc-4abe-b8d4-851346bbec17 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:31.531736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580207b-3dcc-4abe-b8d4-851346bbec17 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:31.532454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580207b-3dcc-4abe-b8d4-851346bbec17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:31.533897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580207b-3dcc-4abe-b8d4-851346bbec17 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:31.534018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9157c-ea55-43e5-9aa6-cf109c058b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:31.534843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9157c-ea55-43e5-9aa6-cf109c058b52 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:31.535197 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9157c-ea55-43e5-9aa6-cf109c058b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:31.535572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9157c-ea55-43e5-9aa6-cf109c058b52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:31.546544 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9157c-ea55-43e5-9aa6-cf109c058b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:31.547911 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9157c-ea55-43e5-9aa6-cf109c058b52 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:31.566630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-29c9157c-ea55-43e5-9aa6-cf109c058b52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:31.566630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:31.566630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:31.566630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:31.566630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:31.566630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:31.566630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:31.566630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:31.566630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:31.566630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:31.566630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:31.566630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:31.566630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:31.566630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:31.566630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:31.567632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:31.568635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:31.568635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:31.568635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:31.568635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:31.572558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 478/972] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:31.574342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9157c-ea55-43e5-9aa6-cf109c058b52 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:31.580408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.sql.core [None req-4580207b-3dcc-4abe-b8d4-851346bbec17 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 17:30:31.580408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 17:30:31.580408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [parameters: {'user_id': 'aa1aea1eac424eefb3412a4ae2fc77fa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 17:30:31.580408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80386) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 17:30:31.590929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-4580207b-3dcc-4abe-b8d4-851346bbec17 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 17:30:31.590929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:31.590929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 17:30:31.590929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 17:30:31.590929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 17:30:31.590929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 17:30:31.590929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 17:30:31.590929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application result = self._query(query) May 04 17:30:31.590929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 17:30:31.590929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application conn.query(q) May 04 17:30:31.590929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 17:30:31.590929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 17:30:31.590929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 17:30:31.590929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application result.read() May 04 17:30:31.590929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 17:30:31.591883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application next(self.gen) May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application yield resource May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application next(self.gen) May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.session.rollback() May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.force_reraise() May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise self.value May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application session.commit() May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 17:30:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._prepare_impl() May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.session.flush() May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._flush(objects) May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application compat.raise_( May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application flush_context.execute() May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rec.execute(self) May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 17:30:31.593779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 17:30:31.596057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 17:30:31.596057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 17:30:31.596057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 04 17:30:31.596057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application result = connection._execute_20( May 04 17:30:31.596057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 17:30:31.596057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 17:30:31.596057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 17:30:31.596057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 17:30:31.596057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 17:30:31.596057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 17:30:31.596057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 17:30:31.596057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 17:30:31.596057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 17:30:31.596057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 17:30:31.596057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 17:30:31.596057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception May 04 17:30:31.606890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 17:30:31.606890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 17:30:31.606890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 17:30:31.606890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 17:30:31.606890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 17:30:31.606890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application result = self._query(query) May 04 17:30:31.606890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 17:30:31.606890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application conn.query(q) May 04 17:30:31.606890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 17:30:31.606890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 17:30:31.606890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 17:30:31.606890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application result.read() May 04 17:30:31.606890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 17:30:31.606890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 17:30:31.606890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 17:30:31.606890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 17:30:31.607744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 17:30:31.607744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 17:30:31.607744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 17:30:31.607744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 17:30:31.607744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 17:30:31.607744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 17:30:31.607744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [parameters: {'user_id': 'aa1aea1eac424eefb3412a4ae2fc77fa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 17:30:31.607744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 17:30:31.607744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:31.607744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:31.607744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:31.607744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:31.607744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:31.607744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:31.607744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 04 17:30:31.608570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 04 17:30:31.609479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 04 17:30:31.609479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 04 17:30:31.609479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 17:30:31.609479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 17:30:31.609479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 17:30:31.609479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:31.609479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 495/973] 10.222.0.81 () {60 vars in 1131 bytes} [Wed May 4 17:30:31 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:31.609479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580207b-3dcc-4abe-b8d4-851346bbec17 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:31.712469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9157c-ea55-43e5-9aa6-cf109c058b52 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:31.724900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580207b-3dcc-4abe-b8d4-851346bbec17 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:31.752839 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aee4a1-a293-444a-9df0-cc0d5448ef04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:31.753830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aee4a1-a293-444a-9df0-cc0d5448ef04 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:31.753830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aee4a1-a293-444a-9df0-cc0d5448ef04 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:31.753830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aee4a1-a293-444a-9df0-cc0d5448ef04 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:31.754535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aee4a1-a293-444a-9df0-cc0d5448ef04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:31.754878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aee4a1-a293-444a-9df0-cc0d5448ef04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:31.756593 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aee4a1-a293-444a-9df0-cc0d5448ef04 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:31.769521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 479/974] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:31.771921 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bb9f2-ad79-4b2c-93a4-17cf67e7ee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:31.776826 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bb9f2-ad79-4b2c-93a4-17cf67e7ee9d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:31.776826 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bb9f2-ad79-4b2c-93a4-17cf67e7ee9d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:31.776826 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bb9f2-ad79-4b2c-93a4-17cf67e7ee9d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:31.777095 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aee4a1-a293-444a-9df0-cc0d5448ef04 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:31.785730 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bb9f2-ad79-4b2c-93a4-17cf67e7ee9d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:31.787478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bb9f2-ad79-4b2c-93a4-17cf67e7ee9d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:31.803428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-670bb9f2-ad79-4b2c-93a4-17cf67e7ee9d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 17:30:31.803428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:31.803428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:31.803428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:31.803428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:31.803428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:31.803428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:31.803428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:31.803428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:31.803428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:31.803428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:31.803428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:31.803428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:30:31.803428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:30:31.803428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:30:31.803428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:31.804430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:31.805402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:31.805402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:31.805402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:30:31.805402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:30:31.805402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:30:31.805402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:30:31.805402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:30:31.805402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:30:31.805402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 17:30:31.805402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:31.810832 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 496/975] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:30:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:31.811735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bb9f2-ad79-4b2c-93a4-17cf67e7ee9d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:31.887238 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aee4a1-a293-444a-9df0-cc0d5448ef04 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:31.921141 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bb9f2-ad79-4b2c-93a4-17cf67e7ee9d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:31.927613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf8fe1-b009-4f03-a167-6e1b7522e1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:31.929216 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf8fe1-b009-4f03-a167-6e1b7522e1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:31.929720 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf8fe1-b009-4f03-a167-6e1b7522e1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:31.930227 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf8fe1-b009-4f03-a167-6e1b7522e1d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:31.939830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf8fe1-b009-4f03-a167-6e1b7522e1d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:31.942005 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf8fe1-b009-4f03-a167-6e1b7522e1d4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:31.959679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51734942-3054-4e65-b730-944024feb3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:31.960013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d1bf8fe1-b009-4f03-a167-6e1b7522e1d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:31.960013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:31.960013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:31.960013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:31.960013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:31.960013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:31.960013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:31.960013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:31.960013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:31.960013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:31.960013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:31.960013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:31.960013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:30:31.960013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:30:31.960013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:31.961192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:31.962286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:30:31.962286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:30:31.962286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:30:31.962286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:30:31.962286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:30:31.962286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:30:31.962286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:31.962286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:31.965184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51734942-3054-4e65-b730-944024feb3db None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:31.965300 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 480/976] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:31.965376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51734942-3054-4e65-b730-944024feb3db None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:31.965376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51734942-3054-4e65-b730-944024feb3db None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:31.968472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51734942-3054-4e65-b730-944024feb3db None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:31.968472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51734942-3054-4e65-b730-944024feb3db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:31.968472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51734942-3054-4e65-b730-944024feb3db None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:31.971019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf8fe1-b009-4f03-a167-6e1b7522e1d4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:32.028747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 497/977] 10.222.0.81 () {56 vars in 1101 bytes} [Wed May 4 17:30:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:32.091176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf8fe1-b009-4f03-a167-6e1b7522e1d4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:32.130858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef98d6e-6db5-4789-bcb7-b0734a8e6c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:32.131888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef98d6e-6db5-4789-bcb7-b0734a8e6c82 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:32.132401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef98d6e-6db5-4789-bcb7-b0734a8e6c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:32.132899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef98d6e-6db5-4789-bcb7-b0734a8e6c82 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:32.133920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef98d6e-6db5-4789-bcb7-b0734a8e6c82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:32.134467 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef98d6e-6db5-4789-bcb7-b0734a8e6c82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:32.136286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef98d6e-6db5-4789-bcb7-b0734a8e6c82 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:32.156627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 481/978] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:30:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:32.159316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51734942-3054-4e65-b730-944024feb3db None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:32.302577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51734942-3054-4e65-b730-944024feb3db None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:32.356210 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198be595-0b05-45c6-ad2a-dc44d67aa5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:32.356922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198be595-0b05-45c6-ad2a-dc44d67aa5ea None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:32.357204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198be595-0b05-45c6-ad2a-dc44d67aa5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:32.357479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198be595-0b05-45c6-ad2a-dc44d67aa5ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:32.358598 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198be595-0b05-45c6-ad2a-dc44d67aa5ea None admin] RBAC: Adding query filter params (role.id=ca2ed1519dea4a5f9b31d465765c20a4, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=ef7da67b09104f4991befeb14cd0581b) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:32.358598 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198be595-0b05-45c6-ad2a-dc44d67aa5ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:32.360349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198be595-0b05-45c6-ad2a-dc44d67aa5ea None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:32.367315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 498/979] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:30:32 2022] GET /identity/v3/role_assignments?user.id=ef7da67b09104f4991befeb14cd0581b&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=ca2ed1519dea4a5f9b31d465765c20a4 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:32.431146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc456ae-316a-4059-80d3-0b1882877c4b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:32.431690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc456ae-316a-4059-80d3-0b1882877c4b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:32.431690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc456ae-316a-4059-80d3-0b1882877c4b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:32.434155 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 482/980] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:32.439870 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cf73c-3cde-46c7-9f38-1e8a90321e44 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:32.440203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cf73c-3cde-46c7-9f38-1e8a90321e44 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:32.440451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cf73c-3cde-46c7-9f38-1e8a90321e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:32.458899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1e6cf73c-3cde-46c7-9f38-1e8a90321e44 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:32.460489 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1e6cf73c-3cde-46c7-9f38-1e8a90321e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:32.532811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 499/981] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:32.555672 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc456ae-316a-4059-80d3-0b1882877c4b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:32.676310 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc456ae-316a-4059-80d3-0b1882877c4b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:32.712111 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09749cac-822a-4bcf-9fde-520ba4941cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:32.712870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09749cac-822a-4bcf-9fde-520ba4941cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:32.713152 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09749cac-822a-4bcf-9fde-520ba4941cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:32.713426 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09749cac-822a-4bcf-9fde-520ba4941cc6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:32.714758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09749cac-822a-4bcf-9fde-520ba4941cc6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:32.716943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09749cac-822a-4bcf-9fde-520ba4941cc6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-09749cac-822a-4bcf-9fde-520ba4941cc6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:32.729278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:32.730431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:32.730431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:32.730431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:32.730431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:32.730431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:32.730431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:32.730431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:32.730431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:32.730431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:32.730431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:32.730431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:32.730431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:32.730431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:32.730431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:32.730431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:32.730431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:32.731704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:32.731704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:32.731704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:32.731704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:32.731704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:32.731704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:32.731704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:32.731704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:32.731704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:32.731704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:32.731704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:32.731704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:32.731704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:30:32.731704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:32.731704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 483/982] 10.222.0.81 () {56 vars in 1126 bytes} [Wed May 4 17:30:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:32.736774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cf73c-3cde-46c7-9f38-1e8a90321e44 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:32.838840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cf73c-3cde-46c7-9f38-1e8a90321e44 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:32.872048 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e760a-e162-4dbf-9d02-1577b5760775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:32.872736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e760a-e162-4dbf-9d02-1577b5760775 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:32.873264 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e760a-e162-4dbf-9d02-1577b5760775 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:32.873550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e760a-e162-4dbf-9d02-1577b5760775 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:32.874256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e760a-e162-4dbf-9d02-1577b5760775 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:32.874564 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e760a-e162-4dbf-9d02-1577b5760775 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:32.875932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e760a-e162-4dbf-9d02-1577b5760775 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:32.886094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 500/983] 10.222.0.81 () {56 vars in 1122 bytes} [Wed May 4 17:30:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:32.887237 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09749cac-822a-4bcf-9fde-520ba4941cc6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:32.992875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09749cac-822a-4bcf-9fde-520ba4941cc6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:33.029901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5722e-df72-49fc-a6bd-720998f74944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:33.030563 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5722e-df72-49fc-a6bd-720998f74944 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:33.030843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5722e-df72-49fc-a6bd-720998f74944 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:33.031115 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5722e-df72-49fc-a6bd-720998f74944 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:33.031816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5722e-df72-49fc-a6bd-720998f74944 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:33.032118 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5722e-df72-49fc-a6bd-720998f74944 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:33.033500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5722e-df72-49fc-a6bd-720998f74944 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:33.038304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 484/984] 10.222.0.81 () {56 vars in 1122 bytes} [Wed May 4 17:30:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:33.044091 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e760a-e162-4dbf-9d02-1577b5760775 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:33.094519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aa0d4-092f-43e1-88f2-ff25f8813c7a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:33.094828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aa0d4-092f-43e1-88f2-ff25f8813c7a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:33.095083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aa0d4-092f-43e1-88f2-ff25f8813c7a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:33.096470 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 485/985] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:33.101263 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbd5ee-97ee-4634-a30b-0f6ab597d51e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:33.101555 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbd5ee-97ee-4634-a30b-0f6ab597d51e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:33.101837 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbd5ee-97ee-4634-a30b-0f6ab597d51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:33.121616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f4cbd5ee-97ee-4634-a30b-0f6ab597d51e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:33.122798 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f4cbd5ee-97ee-4634-a30b-0f6ab597d51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:33.146540 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e760a-e162-4dbf-9d02-1577b5760775 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:33.182757 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce12643-e800-4c8d-b5cf-1badc8806bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:33.183563 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce12643-e800-4c8d-b5cf-1badc8806bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:33.183846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce12643-e800-4c8d-b5cf-1badc8806bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:33.184121 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce12643-e800-4c8d-b5cf-1badc8806bc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:33.184959 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce12643-e800-4c8d-b5cf-1badc8806bc1 None admin] RBAC: Adding query filter params (interface=admin, service_id=b0cab488f62a407d8f25314b219654a8, region_id=RegionOne) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:33.185275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce12643-e800-4c8d-b5cf-1badc8806bc1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:33.186640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce12643-e800-4c8d-b5cf-1badc8806bc1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:33.189895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 486/986] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:30:33.196319 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 501/987] 10.222.0.81 () {56 vars in 1249 bytes} [Wed May 4 17:30:33 2022] GET /identity/v3/endpoints?service_id=b0cab488f62a407d8f25314b219654a8&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:33.201446 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbd5ee-97ee-4634-a30b-0f6ab597d51e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:33.215130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce12643-e800-4c8d-b5cf-1badc8806bc1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:33.306045 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbd5ee-97ee-4634-a30b-0f6ab597d51e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:33.328131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce12643-e800-4c8d-b5cf-1badc8806bc1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:33.351600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab4b41-4ff5-47ce-b39e-26a78802a7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:33.352271 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab4b41-4ff5-47ce-b39e-26a78802a7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:33.352613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab4b41-4ff5-47ce-b39e-26a78802a7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:33.352893 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab4b41-4ff5-47ce-b39e-26a78802a7d1 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:33.353573 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab4b41-4ff5-47ce-b39e-26a78802a7d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:33.355728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab4b41-4ff5-47ce-b39e-26a78802a7d1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:33.361919 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 487/988] 10.222.0.81 () {56 vars in 1087 bytes} [Wed May 4 17:30:33 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:30:33.375606 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96b8f6-ad42-4151-a22e-690a7a835a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:33.376307 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96b8f6-ad42-4151-a22e-690a7a835a06 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:33.376623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96b8f6-ad42-4151-a22e-690a7a835a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:33.376924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96b8f6-ad42-4151-a22e-690a7a835a06 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:33.377705 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96b8f6-ad42-4151-a22e-690a7a835a06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:33.379129 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96b8f6-ad42-4151-a22e-690a7a835a06 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:33.480183 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 502/989] 10.222.0.81 () {60 vars in 1141 bytes} [Wed May 4 17:30:33 2022] POST /identity/v3/services => generated 242 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:30:34.705418 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5411f39-20e0-43ff-bbbd-5b4cf5680f4e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:34.705896 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5411f39-20e0-43ff-bbbd-5b4cf5680f4e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:34.705999 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5411f39-20e0-43ff-bbbd-5b4cf5680f4e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:34.707551 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 488/990] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:34.712993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3605ac-bd26-471e-b263-5d3774ee30d3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:34.713497 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3605ac-bd26-471e-b263-5d3774ee30d3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:34.713630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3605ac-bd26-471e-b263-5d3774ee30d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:34.732721 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-cf3605ac-bd26-471e-b263-5d3774ee30d3 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:34.734214 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cf3605ac-bd26-471e-b263-5d3774ee30d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:34.826650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 503/991] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:30:34.853559 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5411f39-20e0-43ff-bbbd-5b4cf5680f4e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:34.964684 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5411f39-20e0-43ff-bbbd-5b4cf5680f4e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:35.004463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06801bc-1f4d-470e-a543-7be804c68d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:35.004463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06801bc-1f4d-470e-a543-7be804c68d6c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:35.004463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06801bc-1f4d-470e-a543-7be804c68d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:35.004463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06801bc-1f4d-470e-a543-7be804c68d6c None admin] PATH_INFO: `/v3/services/image` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:35.004879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06801bc-1f4d-470e-a543-7be804c68d6c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:35.008461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06801bc-1f4d-470e-a543-7be804c68d6c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b06801bc-1f4d-470e-a543-7be804c68d6c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:35.017936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:35.019033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:35.019033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:35.019033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:35.019033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:35.019033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:35.019033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:35.019033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:35.019033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:35.019033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:35.019033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:35.019033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:35.019033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:35.019033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:35.019033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:35.019033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:35.019033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:35.020278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:35.020278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:35.020278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:35.020278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:35.020278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:35.020278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:35.020278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:35.020278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:35.020278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:35.020278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:35.020278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:35.020278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:35.020278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:30:35.020278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:35.020278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 489/992] 10.222.0.81 () {56 vars in 1105 bytes} [Wed May 4 17:30:34 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:35.025545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3605ac-bd26-471e-b263-5d3774ee30d3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:35.157647 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3605ac-bd26-471e-b263-5d3774ee30d3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:35.204463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae8b14-378c-48fd-ba4f-19d1025970e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:35.204463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae8b14-378c-48fd-ba4f-19d1025970e5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:35.204463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae8b14-378c-48fd-ba4f-19d1025970e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:35.204463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae8b14-378c-48fd-ba4f-19d1025970e5 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:35.204901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae8b14-378c-48fd-ba4f-19d1025970e5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:35.204901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae8b14-378c-48fd-ba4f-19d1025970e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:35.206144 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae8b14-378c-48fd-ba4f-19d1025970e5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:35.214294 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 504/993] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:35.221324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06801bc-1f4d-470e-a543-7be804c68d6c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:35.350070 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06801bc-1f4d-470e-a543-7be804c68d6c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:35.386318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a0192-a575-45af-8cbc-acedd93e5089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:35.387246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a0192-a575-45af-8cbc-acedd93e5089 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:35.387714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a0192-a575-45af-8cbc-acedd93e5089 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:35.388144 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a0192-a575-45af-8cbc-acedd93e5089 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:35.389238 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a0192-a575-45af-8cbc-acedd93e5089 None admin] RBAC: Adding query filter params (type=image) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:35.389703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a0192-a575-45af-8cbc-acedd93e5089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:35.391221 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a0192-a575-45af-8cbc-acedd93e5089 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:35.404826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 490/994] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:35.692909 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4495e-6820-421b-8246-4ed9a8b2fef3 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:35.693595 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4495e-6820-421b-8246-4ed9a8b2fef3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:35.694099 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4495e-6820-421b-8246-4ed9a8b2fef3 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:35.696019 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 505/995] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:35.702889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a02d99-ab93-4cec-ac56-ed21f0fa67fe None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:35.703578 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a02d99-ab93-4cec-ac56-ed21f0fa67fe None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:35.704114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a02d99-ab93-4cec-ac56-ed21f0fa67fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:35.725422 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-73a02d99-ab93-4cec-ac56-ed21f0fa67fe None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:35.727335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-73a02d99-ab93-4cec-ac56-ed21f0fa67fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:35.801892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 491/996] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:35.813999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793719a-a778-47b8-8b72-5c8b1bfc659c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:35.814488 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793719a-a778-47b8-8b72-5c8b1bfc659c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:35.814565 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793719a-a778-47b8-8b72-5c8b1bfc659c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:35.816019 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 506/997] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:35.821635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63195129-5fd8-40ff-bf95-ffe5553d746e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:35.822141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63195129-5fd8-40ff-bf95-ffe5553d746e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:35.822568 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63195129-5fd8-40ff-bf95-ffe5553d746e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:35.827943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793719a-a778-47b8-8b72-5c8b1bfc659c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:35.841786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-63195129-5fd8-40ff-bf95-ffe5553d746e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:35.843221 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-63195129-5fd8-40ff-bf95-ffe5553d746e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:35.924581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 492/998] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:35.947407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63195129-5fd8-40ff-bf95-ffe5553d746e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:35.951757 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793719a-a778-47b8-8b72-5c8b1bfc659c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:35.991959 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02044c7c-1855-4e18-b047-e1aaf74792cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:35.992923 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02044c7c-1855-4e18-b047-e1aaf74792cb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:35.993435 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02044c7c-1855-4e18-b047-e1aaf74792cb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:35.993782 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02044c7c-1855-4e18-b047-e1aaf74792cb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:35.994763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02044c7c-1855-4e18-b047-e1aaf74792cb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:35.996092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02044c7c-1855-4e18-b047-e1aaf74792cb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-02044c7c-1855-4e18-b047-e1aaf74792cb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:36.009291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:36.010355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:36.010355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:36.010355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:36.010355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:36.010355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:36.010355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:36.010355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:36.010355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:36.010355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:36.010355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:36.010355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:36.010355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:36.010355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:36.010355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:36.010355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:36.010355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:36.011256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:36.011256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:36.011256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:36.011256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:36.011256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:36.011256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:36.011256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:36.011256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:36.011256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:36.011256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:36.011256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:36.011256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:36.011256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 17:30:36.011256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:36.013362 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 507/999] 10.222.0.81 () {56 vars in 1126 bytes} [Wed May 4 17:30:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:36.019769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02044c7c-1855-4e18-b047-e1aaf74792cb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:36.094114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63195129-5fd8-40ff-bf95-ffe5553d746e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:36.137683 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f054bf-f2f9-46a9-80ad-50ee8329b89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:36.138902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f054bf-f2f9-46a9-80ad-50ee8329b89b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:36.139335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f054bf-f2f9-46a9-80ad-50ee8329b89b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:36.139753 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f054bf-f2f9-46a9-80ad-50ee8329b89b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:36.140634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f054bf-f2f9-46a9-80ad-50ee8329b89b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:36.142415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f054bf-f2f9-46a9-80ad-50ee8329b89b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:36.154323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02044c7c-1855-4e18-b047-e1aaf74792cb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e6f054bf-f2f9-46a9-80ad-50ee8329b89b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:36.157606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:36.158641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:36.158641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:36.158641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:36.158641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:36.158641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:36.158641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:36.158641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:36.158641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:36.158641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:36.158641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:36.158641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:36.158641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:36.158641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:36.158641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:36.158641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:36.158641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:36.159456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:36.159456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:36.159456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:36.159456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:36.159456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:36.159456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:36.159456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:36.159456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:36.159456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:36.159456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:36.159456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:36.159456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:36.159456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:30:36.159456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:36.163802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 493/1000] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:36.164694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f054bf-f2f9-46a9-80ad-50ee8329b89b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:36.195512 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b314e-0bf6-4b8b-89d5-930d1f7d9260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:36.196215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b314e-0bf6-4b8b-89d5-930d1f7d9260 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:36.196533 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b314e-0bf6-4b8b-89d5-930d1f7d9260 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:36.196804 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b314e-0bf6-4b8b-89d5-930d1f7d9260 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:36.198134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b314e-0bf6-4b8b-89d5-930d1f7d9260 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:36.199313 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b314e-0bf6-4b8b-89d5-930d1f7d9260 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:36.200771 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b314e-0bf6-4b8b-89d5-930d1f7d9260 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:36.206162 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 508/1001] 10.222.0.81 () {56 vars in 1122 bytes} [Wed May 4 17:30:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:36.212010 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b314e-0bf6-4b8b-89d5-930d1f7d9260 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:36.296578 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f054bf-f2f9-46a9-80ad-50ee8329b89b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:36.348593 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b314e-0bf6-4b8b-89d5-930d1f7d9260 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:36.352127 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bc675-0bc9-48cd-953a-257604cb24f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:36.353094 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bc675-0bc9-48cd-953a-257604cb24f3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:36.353580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bc675-0bc9-48cd-953a-257604cb24f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:36.354923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bc675-0bc9-48cd-953a-257604cb24f3 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:36.356008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bc675-0bc9-48cd-953a-257604cb24f3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:36.356695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bc675-0bc9-48cd-953a-257604cb24f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:36.358464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bc675-0bc9-48cd-953a-257604cb24f3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:36.364337 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 494/1002] 10.222.0.81 () {56 vars in 1112 bytes} [Wed May 4 17:30:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:36.371217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bc675-0bc9-48cd-953a-257604cb24f3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:36.406614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c0e1c-851c-49b4-817b-923536d1410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:36.407283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c0e1c-851c-49b4-817b-923536d1410a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:36.407563 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c0e1c-851c-49b4-817b-923536d1410a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:36.407829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c0e1c-851c-49b4-817b-923536d1410a None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:36.408578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c0e1c-851c-49b4-817b-923536d1410a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:36.408884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c0e1c-851c-49b4-817b-923536d1410a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:36.410289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c0e1c-851c-49b4-817b-923536d1410a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:36.420616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 509/1003] 10.222.0.81 () {56 vars in 1122 bytes} [Wed May 4 17:30:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:36.423524 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c0e1c-851c-49b4-817b-923536d1410a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:36.502698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bc675-0bc9-48cd-953a-257604cb24f3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:36.545796 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095a962-f337-4f71-b6db-80de3d64a8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:36.546473 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095a962-f337-4f71-b6db-80de3d64a8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:36.546762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095a962-f337-4f71-b6db-80de3d64a8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:36.547043 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095a962-f337-4f71-b6db-80de3d64a8d1 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:36.547764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095a962-f337-4f71-b6db-80de3d64a8d1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:36.548073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095a962-f337-4f71-b6db-80de3d64a8d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:36.551524 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095a962-f337-4f71-b6db-80de3d64a8d1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:36.560485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 495/1004] 10.222.0.81 () {56 vars in 1112 bytes} [Wed May 4 17:30:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:36.565936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095a962-f337-4f71-b6db-80de3d64a8d1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:36.575573 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c0e1c-851c-49b4-817b-923536d1410a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:36.628502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21266246-89c5-4eab-aa6b-6e60221b55ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:36.628502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21266246-89c5-4eab-aa6b-6e60221b55ad None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:36.628502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21266246-89c5-4eab-aa6b-6e60221b55ad None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:36.628502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21266246-89c5-4eab-aa6b-6e60221b55ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:36.628903 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21266246-89c5-4eab-aa6b-6e60221b55ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:36.628903 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21266246-89c5-4eab-aa6b-6e60221b55ad None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:36.684902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095a962-f337-4f71-b6db-80de3d64a8d1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:36.721403 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 510/1005] 10.222.0.81 () {60 vars in 1144 bytes} [Wed May 4 17:30:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:30:36.730326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0495a8-1696-447d-9d6f-1b96e10b29b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:36.731018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0495a8-1696-447d-9d6f-1b96e10b29b5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:36.731279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0495a8-1696-447d-9d6f-1b96e10b29b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:36.731549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0495a8-1696-447d-9d6f-1b96e10b29b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:36.732361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0495a8-1696-447d-9d6f-1b96e10b29b5 None admin] RBAC: Adding query filter params (interface=public, service_id=050808a2b0b44354b2bad3ec31d247b8, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:36.732726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0495a8-1696-447d-9d6f-1b96e10b29b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:36.734108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0495a8-1696-447d-9d6f-1b96e10b29b5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:36.740217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 496/1006] 10.222.0.81 () {56 vars in 1251 bytes} [Wed May 4 17:30:36 2022] GET /identity/v3/endpoints?service_id=050808a2b0b44354b2bad3ec31d247b8&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:36.749145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21266246-89c5-4eab-aa6b-6e60221b55ad None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:36.871408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21266246-89c5-4eab-aa6b-6e60221b55ad None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:36.912898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ebfdf-5395-49e2-8889-74da542eb8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:36.913801 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ebfdf-5395-49e2-8889-74da542eb8fc None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:36.914206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ebfdf-5395-49e2-8889-74da542eb8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:36.914527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ebfdf-5395-49e2-8889-74da542eb8fc None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:36.915216 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ebfdf-5395-49e2-8889-74da542eb8fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:36.916968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ebfdf-5395-49e2-8889-74da542eb8fc None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:36.924657 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 511/1007] 10.222.0.81 () {56 vars in 1087 bytes} [Wed May 4 17:30:36 2022] GET /identity/v3/services => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:30:37.892506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dc202-e2e7-4825-9764-3f9f8c4eacfd None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:37.892506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dc202-e2e7-4825-9764-3f9f8c4eacfd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:37.892506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dc202-e2e7-4825-9764-3f9f8c4eacfd None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:37.892506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 497/1008] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:37.896240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21d18d-951a-4481-b7ab-bb2c8877d138 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:37.896669 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21d18d-951a-4481-b7ab-bb2c8877d138 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:37.896844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21d18d-951a-4481-b7ab-bb2c8877d138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:37.915655 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4a21d18d-951a-4481-b7ab-bb2c8877d138 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:37.917846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4a21d18d-951a-4481-b7ab-bb2c8877d138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:37.993471 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 512/1009] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:37 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:38.022459 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dc202-e2e7-4825-9764-3f9f8c4eacfd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:38.131450 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dc202-e2e7-4825-9764-3f9f8c4eacfd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:38.170073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45ecb8-0680-471c-aa54-fc33f2035f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:38.170672 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45ecb8-0680-471c-aa54-fc33f2035f78 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:38.170957 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45ecb8-0680-471c-aa54-fc33f2035f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:38.171233 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45ecb8-0680-471c-aa54-fc33f2035f78 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:38.171971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45ecb8-0680-471c-aa54-fc33f2035f78 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:38.174632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45ecb8-0680-471c-aa54-fc33f2035f78 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:38.283432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 498/1010] 10.222.0.81 () {60 vars in 1141 bytes} [Wed May 4 17:30:38 2022] POST /identity/v3/services => generated 242 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:30:39.199603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1689b-9f02-45c6-aaf5-9fa22d9bb2c1 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:39.200223 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1689b-9f02-45c6-aaf5-9fa22d9bb2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:39.200223 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1689b-9f02-45c6-aaf5-9fa22d9bb2c1 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:39.201835 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 513/1011] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:39.207125 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b51a2-a543-41b7-af34-a57ace8306dc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:39.207584 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b51a2-a543-41b7-af34-a57ace8306dc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:39.207672 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b51a2-a543-41b7-af34-a57ace8306dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:39.226647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f37b51a2-a543-41b7-af34-a57ace8306dc None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:39.227827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f37b51a2-a543-41b7-af34-a57ace8306dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:39.308464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 499/1012] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:39 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:39.336474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1689b-9f02-45c6-aaf5-9fa22d9bb2c1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:39.357374 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69473c6b-3c4d-4aaf-a381-7cdb839bb4d7 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:39.357669 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69473c6b-3c4d-4aaf-a381-7cdb839bb4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:39.357953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69473c6b-3c4d-4aaf-a381-7cdb839bb4d7 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:39.359450 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 500/1013] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:30:39.364269 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c27070-9643-483d-9d0c-cbdc614b1016 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:39.364657 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c27070-9643-483d-9d0c-cbdc614b1016 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:39.365017 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c27070-9643-483d-9d0c-cbdc614b1016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:39.384944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b2c27070-9643-483d-9d0c-cbdc614b1016 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:39.386489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b2c27070-9643-483d-9d0c-cbdc614b1016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:39.462073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1689b-9f02-45c6-aaf5-9fa22d9bb2c1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:39.465469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 501/1014] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:39 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:30:39.489991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c27070-9643-483d-9d0c-cbdc614b1016 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:39.503132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee67dc-f611-4677-a902-313a622326cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:39.503931 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee67dc-f611-4677-a902-313a622326cf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:39.504209 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee67dc-f611-4677-a902-313a622326cf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:39.504602 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee67dc-f611-4677-a902-313a622326cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:39.505791 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee67dc-f611-4677-a902-313a622326cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:39.507290 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee67dc-f611-4677-a902-313a622326cf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:39.513869 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 514/1015] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:39.515076 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee67dc-f611-4677-a902-313a622326cf None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:39.613536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c27070-9643-483d-9d0c-cbdc614b1016 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:39.641824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee67dc-f611-4677-a902-313a622326cf None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:39.657863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3982f0-ddeb-4881-888a-650323dd9a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:39.658787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3982f0-ddeb-4881-888a-650323dd9a4b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:39.659274 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3982f0-ddeb-4881-888a-650323dd9a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:39.659536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3982f0-ddeb-4881-888a-650323dd9a4b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:39.660309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3982f0-ddeb-4881-888a-650323dd9a4b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:39.661884 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3982f0-ddeb-4881-888a-650323dd9a4b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-db3982f0-ddeb-4881-888a-650323dd9a4b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:39.674743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:39.675849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:39.675849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:39.675849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:39.675849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:39.675849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:39.675849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:39.675849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:39.675849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:39.675849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:39.675849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:39.675849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:39.675849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:39.675849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:39.675849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:39.675849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:39.675849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:39.676867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:39.676867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:39.676867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:39.676867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:39.676867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:39.676867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:39.676867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:39.676867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:39.676867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:39.676867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:39.676867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:39.676867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:39.676867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 17:30:39.676867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:39.676867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 502/1016] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:39.683454 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3982f0-ddeb-4881-888a-650323dd9a4b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:39.693182 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8f4d3-5cf5-43f2-83bd-f77d3de4586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:39.693916 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8f4d3-5cf5-43f2-83bd-f77d3de4586d None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:39.694550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8f4d3-5cf5-43f2-83bd-f77d3de4586d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:39.694550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8f4d3-5cf5-43f2-83bd-f77d3de4586d None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:39.695161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8f4d3-5cf5-43f2-83bd-f77d3de4586d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:39.696644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8f4d3-5cf5-43f2-83bd-f77d3de4586d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:39.800633 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3982f0-ddeb-4881-888a-650323dd9a4b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:39.800849 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 515/1017] 10.222.0.81 () {60 vars in 1141 bytes} [Wed May 4 17:30:39 2022] POST /identity/v3/projects => generated 311 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:30:39.832958 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8964e-6256-4ea3-91cf-56a232e899b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:39.834049 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8964e-6256-4ea3-91cf-56a232e899b9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:39.834640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8964e-6256-4ea3-91cf-56a232e899b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:39.835165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8964e-6256-4ea3-91cf-56a232e899b9 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:39.836133 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8964e-6256-4ea3-91cf-56a232e899b9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:39.836686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8964e-6256-4ea3-91cf-56a232e899b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:39.838351 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8964e-6256-4ea3-91cf-56a232e899b9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:39.844798 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 503/1018] 10.222.0.81 () {56 vars in 1112 bytes} [Wed May 4 17:30:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:39.853489 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8f4d3-5cf5-43f2-83bd-f77d3de4586d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:39.987437 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8f4d3-5cf5-43f2-83bd-f77d3de4586d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:40.033971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564286ec-b5e3-4f4e-92c6-3b6ab4a2a34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:40.034644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564286ec-b5e3-4f4e-92c6-3b6ab4a2a34e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:40.034924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564286ec-b5e3-4f4e-92c6-3b6ab4a2a34e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:40.035189 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564286ec-b5e3-4f4e-92c6-3b6ab4a2a34e None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:40.035905 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564286ec-b5e3-4f4e-92c6-3b6ab4a2a34e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:40.036211 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564286ec-b5e3-4f4e-92c6-3b6ab4a2a34e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:40.037726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564286ec-b5e3-4f4e-92c6-3b6ab4a2a34e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:40.044193 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 516/1019] 10.222.0.81 () {56 vars in 1112 bytes} [Wed May 4 17:30:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:40.051881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8964e-6256-4ea3-91cf-56a232e899b9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:40.168341 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8964e-6256-4ea3-91cf-56a232e899b9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:40.205840 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03850ac6-381c-4b37-83e8-bf61aaa51090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:40.206518 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03850ac6-381c-4b37-83e8-bf61aaa51090 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:40.206778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03850ac6-381c-4b37-83e8-bf61aaa51090 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:40.207048 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03850ac6-381c-4b37-83e8-bf61aaa51090 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:40.207802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03850ac6-381c-4b37-83e8-bf61aaa51090 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:40.209193 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03850ac6-381c-4b37-83e8-bf61aaa51090 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:40.319609 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 504/1020] 10.222.0.81 () {60 vars in 1144 bytes} [Wed May 4 17:30:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:30:40.763578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa450d-79f1-4bf0-b25a-3f042d947360 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:40.764135 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa450d-79f1-4bf0-b25a-3f042d947360 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:40.764135 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa450d-79f1-4bf0-b25a-3f042d947360 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:40.765838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 517/1021] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:40.771313 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98085057-e52d-40da-9d05-9a5feb8d8b97 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:40.771612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98085057-e52d-40da-9d05-9a5feb8d8b97 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:40.771897 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98085057-e52d-40da-9d05-9a5feb8d8b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:40.794086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-98085057-e52d-40da-9d05-9a5feb8d8b97 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:40.795643 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-98085057-e52d-40da-9d05-9a5feb8d8b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:40.881635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 505/1022] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:40.905095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa450d-79f1-4bf0-b25a-3f042d947360 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:41.019347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa450d-79f1-4bf0-b25a-3f042d947360 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:41.056550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2968a-b9c3-4bfc-9117-ab60a6060a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:41.058639 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2968a-b9c3-4bfc-9117-ab60a6060a90 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:41.059161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2968a-b9c3-4bfc-9117-ab60a6060a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:41.059641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2968a-b9c3-4bfc-9117-ab60a6060a90 None admin] PATH_INFO: `/v3/services/image` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:41.060538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2968a-b9c3-4bfc-9117-ab60a6060a90 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:41.062128 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2968a-b9c3-4bfc-9117-ab60a6060a90 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-1fa2968a-b9c3-4bfc-9117-ab60a6060a90 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:41.078032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:41.079075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:41.079075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:41.079075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:41.079075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:41.079075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:41.079075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:41.079075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:41.079075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:41.079075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:41.079075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:41.079075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:41.079075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:41.079075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:41.079075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:41.079075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:41.079075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:41.079902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:41.079902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:41.079902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:41.079902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:41.079902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:41.079902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:41.079902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:41.079902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:41.079902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:41.079902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:41.079902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:41.079902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:41.079902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:30:41.079902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:41.087799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 518/1023] 10.222.0.81 () {56 vars in 1105 bytes} [Wed May 4 17:30:40 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:41.089983 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98085057-e52d-40da-9d05-9a5feb8d8b97 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:41.198446 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98085057-e52d-40da-9d05-9a5feb8d8b97 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:41.234226 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a832ff-8580-48e5-b7fb-7a77f559c61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:41.235656 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a832ff-8580-48e5-b7fb-7a77f559c61e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:41.236145 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a832ff-8580-48e5-b7fb-7a77f559c61e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:41.236635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a832ff-8580-48e5-b7fb-7a77f559c61e None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:41.237580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a832ff-8580-48e5-b7fb-7a77f559c61e None admin] RBAC: Adding query filter params (name=image) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:41.238086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a832ff-8580-48e5-b7fb-7a77f559c61e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:41.239637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a832ff-8580-48e5-b7fb-7a77f559c61e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:41.250126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 506/1024] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:41.252585 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2968a-b9c3-4bfc-9117-ab60a6060a90 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:41.366399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2968a-b9c3-4bfc-9117-ab60a6060a90 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:41.403352 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c8550-c90f-407b-8e6a-56e9be0c98e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:41.404385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c8550-c90f-407b-8e6a-56e9be0c98e9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:41.404860 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c8550-c90f-407b-8e6a-56e9be0c98e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:41.405368 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c8550-c90f-407b-8e6a-56e9be0c98e9 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:41.406267 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c8550-c90f-407b-8e6a-56e9be0c98e9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:41.406761 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c8550-c90f-407b-8e6a-56e9be0c98e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:41.408346 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c8550-c90f-407b-8e6a-56e9be0c98e9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:41.419227 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 519/1025] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:41.421277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a832ff-8580-48e5-b7fb-7a77f559c61e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:41.523650 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a832ff-8580-48e5-b7fb-7a77f559c61e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:41.560560 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f18bb4-ec95-42f5-a535-b7de32cf1c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:41.561580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f18bb4-ec95-42f5-a535-b7de32cf1c5d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:41.562067 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f18bb4-ec95-42f5-a535-b7de32cf1c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:41.562552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f18bb4-ec95-42f5-a535-b7de32cf1c5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:41.563547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f18bb4-ec95-42f5-a535-b7de32cf1c5d None admin] RBAC: Adding query filter params (interface=public, service_id=928832277f484d1e8f2e246ed9557d3b, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:41.564069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f18bb4-ec95-42f5-a535-b7de32cf1c5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:41.565695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f18bb4-ec95-42f5-a535-b7de32cf1c5d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:41.576168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 507/1026] 10.222.0.81 () {56 vars in 1251 bytes} [Wed May 4 17:30:41 2022] GET /identity/v3/endpoints?service_id=928832277f484d1e8f2e246ed9557d3b&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:41.577541 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c8550-c90f-407b-8e6a-56e9be0c98e9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:41.695544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c8550-c90f-407b-8e6a-56e9be0c98e9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:41.730918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464c2a3-a710-472b-b7d8-e38850da12cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:41.731578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464c2a3-a710-472b-b7d8-e38850da12cc None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:41.731857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464c2a3-a710-472b-b7d8-e38850da12cc None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:41.732125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464c2a3-a710-472b-b7d8-e38850da12cc None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:41.732832 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464c2a3-a710-472b-b7d8-e38850da12cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:41.734182 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464c2a3-a710-472b-b7d8-e38850da12cc None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:41.746133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 520/1027] 10.222.0.81 () {56 vars in 1087 bytes} [Wed May 4 17:30:41 2022] GET /identity/v3/services => generated 1957 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:30:42.233710 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ed9e1-f2c4-4c61-b283-01c6a7b80ad4 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:42.233986 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ed9e1-f2c4-4c61-b283-01c6a7b80ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:42.234253 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ed9e1-f2c4-4c61-b283-01c6a7b80ad4 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:42.235851 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 508/1028] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:42.241170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6545460-2caa-44c2-96c1-72d01b75c39f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:42.241583 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6545460-2caa-44c2-96c1-72d01b75c39f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:42.241716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6545460-2caa-44c2-96c1-72d01b75c39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:42.261554 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f6545460-2caa-44c2-96c1-72d01b75c39f None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:42.263065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f6545460-2caa-44c2-96c1-72d01b75c39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:42.352214 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 521/1029] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:30:42.387867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ed9e1-f2c4-4c61-b283-01c6a7b80ad4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:42.516220 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ed9e1-f2c4-4c61-b283-01c6a7b80ad4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:42.551976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd805a8a-b8ff-4504-9e37-7ac824a168a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:42.553041 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd805a8a-b8ff-4504-9e37-7ac824a168a0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:42.553475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd805a8a-b8ff-4504-9e37-7ac824a168a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:42.553896 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd805a8a-b8ff-4504-9e37-7ac824a168a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:42.555245 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd805a8a-b8ff-4504-9e37-7ac824a168a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:42.557430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd805a8a-b8ff-4504-9e37-7ac824a168a0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:42.559612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 509/1030] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:42.565207 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6545460-2caa-44c2-96c1-72d01b75c39f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:42.699316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6545460-2caa-44c2-96c1-72d01b75c39f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:42.743586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0472d2-eb6a-4dae-aefb-f248faa2d291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:42.745511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0472d2-eb6a-4dae-aefb-f248faa2d291 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:42.746025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0472d2-eb6a-4dae-aefb-f248faa2d291 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:42.746517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0472d2-eb6a-4dae-aefb-f248faa2d291 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:42.747454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0472d2-eb6a-4dae-aefb-f248faa2d291 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:42.749390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0472d2-eb6a-4dae-aefb-f248faa2d291 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:42.854055 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02369d9-4f33-4f17-8c42-9ce0901aa562 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:42.854055 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02369d9-4f33-4f17-8c42-9ce0901aa562 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:42.854055 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02369d9-4f33-4f17-8c42-9ce0901aa562 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:42.859783 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 510/1031] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:42.862955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5b890-d76b-459c-a769-81369b872d8a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:42.862955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5b890-d76b-459c-a769-81369b872d8a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:42.862955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5b890-d76b-459c-a769-81369b872d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:42.867253 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 522/1032] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:30:42 2022] POST /identity/v3/users => generated 285 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:30:42.889378 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-07c5b890-d76b-459c-a769-81369b872d8a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:42.906642 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-07c5b890-d76b-459c-a769-81369b872d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:42.993240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 511/1033] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:43.030506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0472d2-eb6a-4dae-aefb-f248faa2d291 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:43.174213 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0472d2-eb6a-4dae-aefb-f248faa2d291 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:43.222974 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801236e7-604a-4a52-be3d-888ca54e6fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:43.224063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801236e7-604a-4a52-be3d-888ca54e6fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:43.224527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801236e7-604a-4a52-be3d-888ca54e6fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:43.224938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801236e7-604a-4a52-be3d-888ca54e6fb1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:43.241565 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801236e7-604a-4a52-be3d-888ca54e6fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:43.250772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-801236e7-604a-4a52-be3d-888ca54e6fb1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:30:43.250772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:43.250772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:43.250772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:43.250772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:43.250772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:43.250772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:43.250772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:43.250772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:43.250772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:43.250772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:43.250772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:43.250772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:43.250772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:43.250772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:43.250772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:43.251703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:43.251703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:43.251703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:43.251703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:43.251703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:43.251703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:43.251703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:43.251703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:43.251703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:43.251703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:43.251703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:43.251703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:43.251703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:43.251703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:43.251703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:43.251703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:43.252551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:43.252551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:43.252551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:43.252551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:43.252551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:43.252551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:43.252551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:43.252551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:43.252551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:43.252551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:43.252551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:30:43.252551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:43.256540 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 523/1034] 10.222.0.81 () {56 vars in 1120 bytes} [Wed May 4 17:30:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:43.258246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5b890-d76b-459c-a769-81369b872d8a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:43.384635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5b890-d76b-459c-a769-81369b872d8a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:43.437023 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b748a7-e451-4258-92a2-5f6b7ffee7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:43.437630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b748a7-e451-4258-92a2-5f6b7ffee7ae None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:43.437912 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b748a7-e451-4258-92a2-5f6b7ffee7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:43.438182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b748a7-e451-4258-92a2-5f6b7ffee7ae None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:43.438937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b748a7-e451-4258-92a2-5f6b7ffee7ae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:43.439239 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b748a7-e451-4258-92a2-5f6b7ffee7ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:43.440616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b748a7-e451-4258-92a2-5f6b7ffee7ae None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:43.454904 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 512/1035] 10.222.0.81 () {56 vars in 1115 bytes} [Wed May 4 17:30:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:43.456363 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801236e7-604a-4a52-be3d-888ca54e6fb1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:43.564357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801236e7-604a-4a52-be3d-888ca54e6fb1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:43.599010 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f355d93-6c48-4b7e-b831-ed3430fa35b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:43.599800 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f355d93-6c48-4b7e-b831-ed3430fa35b2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:43.600077 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f355d93-6c48-4b7e-b831-ed3430fa35b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:43.600341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f355d93-6c48-4b7e-b831-ed3430fa35b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:43.611938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f355d93-6c48-4b7e-b831-ed3430fa35b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:43.615587 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f355d93-6c48-4b7e-b831-ed3430fa35b2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:43.631230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-5f355d93-6c48-4b7e-b831-ed3430fa35b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:43.631230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:43.631230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:43.631230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:43.631230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:43.631230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:43.631230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:43.631230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:43.631230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:43.631230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:43.631230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:43.631230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:43.631230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:43.631230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:43.631230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:43.632146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:43.633103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:43.633103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:43.633103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:43.633103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:43.636646 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 524/1036] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:43.640282 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b748a7-e451-4258-92a2-5f6b7ffee7ae None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:43.774998 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b748a7-e451-4258-92a2-5f6b7ffee7ae None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:43.810008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5cb1a-e743-4128-beae-e29848d1f771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:43.810715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5cb1a-e743-4128-beae-e29848d1f771 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:43.810997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5cb1a-e743-4128-beae-e29848d1f771 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:43.811272 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5cb1a-e743-4128-beae-e29848d1f771 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:43.812001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5cb1a-e743-4128-beae-e29848d1f771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:43.812302 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5cb1a-e743-4128-beae-e29848d1f771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:43.813694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5cb1a-e743-4128-beae-e29848d1f771 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:43.837639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 513/1037] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:43.838683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f355d93-6c48-4b7e-b831-ed3430fa35b2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:43.960471 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f355d93-6c48-4b7e-b831-ed3430fa35b2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:44.001539 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a37d9-4fbd-4345-886d-d4dbb2bb346e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:44.001539 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a37d9-4fbd-4345-886d-d4dbb2bb346e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:44.001539 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a37d9-4fbd-4345-886d-d4dbb2bb346e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:44.001539 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a37d9-4fbd-4345-886d-d4dbb2bb346e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:44.008465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a37d9-4fbd-4345-886d-d4dbb2bb346e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:44.008618 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a37d9-4fbd-4345-886d-d4dbb2bb346e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:44.023385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-2e2a37d9-4fbd-4345-886d-d4dbb2bb346e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:30:44.023385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:44.023385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:44.023385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:44.023385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:44.023385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:44.023385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:44.023385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:44.023385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:44.023385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:44.023385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:44.023385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:44.023385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:30:44.023385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:30:44.023385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:30:44.023385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:44.024356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:44.025681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:44.025681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:44.025681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:30:44.025681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:30:44.025681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:30:44.025681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:30:44.025681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:30:44.025681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:30:44.025681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:30:44.025681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:44.029571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 525/1038] 10.222.0.81 () {56 vars in 1093 bytes} [Wed May 4 17:30:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:44.032467 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5cb1a-e743-4128-beae-e29848d1f771 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:44.140541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5cb1a-e743-4128-beae-e29848d1f771 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:44.157373 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a81eec-9db4-4815-a901-ce35fa6bebfa None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:44.157694 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a81eec-9db4-4815-a901-ce35fa6bebfa None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:44.158054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a81eec-9db4-4815-a901-ce35fa6bebfa None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:44.164901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 526/1039] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:44.167045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cc963-e2e4-4e2c-8102-b63babc7cb88 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:44.167330 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cc963-e2e4-4e2c-8102-b63babc7cb88 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:44.167610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cc963-e2e4-4e2c-8102-b63babc7cb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:44.177042 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c3139-e633-43c1-a98a-730e110f72ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:44.177727 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c3139-e633-43c1-a98a-730e110f72ad None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:44.178011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c3139-e633-43c1-a98a-730e110f72ad None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:44.178288 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c3139-e633-43c1-a98a-730e110f72ad None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:44.179140 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c3139-e633-43c1-a98a-730e110f72ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:44.179449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c3139-e633-43c1-a98a-730e110f72ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:44.180932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c3139-e633-43c1-a98a-730e110f72ad None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:44.189021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-395cc963-e2e4-4e2c-8102-b63babc7cb88 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:44.190625 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-395cc963-e2e4-4e2c-8102-b63babc7cb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:44.204093 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 514/1040] 10.222.0.81 () {56 vars in 1133 bytes} [Wed May 4 17:30:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:44.209889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c3139-e633-43c1-a98a-730e110f72ad None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:44.322776 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 527/1041] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:44.345751 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cc963-e2e4-4e2c-8102-b63babc7cb88 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:44.461598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c3139-e633-43c1-a98a-730e110f72ad None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:44.462345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cc963-e2e4-4e2c-8102-b63babc7cb88 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:44.495705 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9205e-c247-465a-831d-68893b4e484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:44.496348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9205e-c247-465a-831d-68893b4e484d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:44.496662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9205e-c247-465a-831d-68893b4e484d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:44.496924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9205e-c247-465a-831d-68893b4e484d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:44.498898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e00d61-ba11-46a9-bd5a-264d90d0e60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:44.499682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e00d61-ba11-46a9-bd5a-264d90d0e60e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:44.499966 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e00d61-ba11-46a9-bd5a-264d90d0e60e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:44.500230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e00d61-ba11-46a9-bd5a-264d90d0e60e None admin] PATH_INFO: `/v3/services/image` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:44.500920 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e00d61-ba11-46a9-bd5a-264d90d0e60e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:44.502293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e00d61-ba11-46a9-bd5a-264d90d0e60e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f4e00d61-ba11-46a9-bd5a-264d90d0e60e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:44.514316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:44.515298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:44.515298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:44.515298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:44.515298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:44.515298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:44.515298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:44.515298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:30:44.515298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:30:44.515298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:30:44.515298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:30:44.515298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:44.515298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:44.515298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:44.515298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:44.515298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:44.515298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:44.516275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:44.516275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:44.516275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:44.516275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:44.516275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:44.516275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:44.516275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:44.516275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:44.516275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:44.516275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:44.516275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:30:44.516275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:30:44.516275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 17:30:44.516275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:44.516275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 528/1042] 10.222.0.81 () {56 vars in 1105 bytes} [Wed May 4 17:30:44 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:44.521328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e00d61-ba11-46a9-bd5a-264d90d0e60e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:44.573459 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9205e-c247-465a-831d-68893b4e484d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:44.574820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9205e-c247-465a-831d-68893b4e484d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:44.625022 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e00d61-ba11-46a9-bd5a-264d90d0e60e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:44.660057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8d6c8-7598-4c60-a550-341964392f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:44.660737 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8d6c8-7598-4c60-a550-341964392f70 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:44.661018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8d6c8-7598-4c60-a550-341964392f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:44.661285 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8d6c8-7598-4c60-a550-341964392f70 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:44.661986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8d6c8-7598-4c60-a550-341964392f70 None admin] RBAC: Adding query filter params (name=image) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:44.662287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8d6c8-7598-4c60-a550-341964392f70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:44.663641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8d6c8-7598-4c60-a550-341964392f70 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:44.673850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 529/1043] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:44.675100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8d6c8-7598-4c60-a550-341964392f70 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:44.684953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 515/1044] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:30:44 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:30:44.686393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9205e-c247-465a-831d-68893b4e484d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:44.784871 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8d6c8-7598-4c60-a550-341964392f70 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:44.802938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9205e-c247-465a-831d-68893b4e484d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:44.826029 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86198f4-6ed8-4622-8b36-de1b2486b3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:44.826948 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86198f4-6ed8-4622-8b36-de1b2486b3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:44.827392 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86198f4-6ed8-4622-8b36-de1b2486b3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:44.827835 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86198f4-6ed8-4622-8b36-de1b2486b3f2 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:44.829097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86198f4-6ed8-4622-8b36-de1b2486b3f2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:44.829615 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86198f4-6ed8-4622-8b36-de1b2486b3f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:44.832457 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86198f4-6ed8-4622-8b36-de1b2486b3f2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:44.841464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 530/1045] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:44.846733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b56871-46b4-4d49-8121-48b8a059f212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:44.846901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86198f4-6ed8-4622-8b36-de1b2486b3f2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:44.847538 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b56871-46b4-4d49-8121-48b8a059f212 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:44.847935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b56871-46b4-4d49-8121-48b8a059f212 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:44.848212 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b56871-46b4-4d49-8121-48b8a059f212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:44.859293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b56871-46b4-4d49-8121-48b8a059f212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:44.860803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b56871-46b4-4d49-8121-48b8a059f212 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:44.879391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-06b56871-46b4-4d49-8121-48b8a059f212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:44.879391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:44.879391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:44.879391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:44.879391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:44.879391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:44.879391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:44.879391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:44.879391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:44.879391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:44.879391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:44.879391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:44.879391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:44.879391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:44.879391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:44.880601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:44.881482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:44.881482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:44.881482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:44.881482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:44.881482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 516/1046] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:44.886701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b56871-46b4-4d49-8121-48b8a059f212 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:44.957635 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86198f4-6ed8-4622-8b36-de1b2486b3f2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:45.001322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b56871-46b4-4d49-8121-48b8a059f212 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:45.002551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e741dd8-a747-4874-8d90-0a654edfa5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:45.003247 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e741dd8-a747-4874-8d90-0a654edfa5a5 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:45.003528 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e741dd8-a747-4874-8d90-0a654edfa5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:45.003798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e741dd8-a747-4874-8d90-0a654edfa5a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:45.004586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e741dd8-a747-4874-8d90-0a654edfa5a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:45.006028 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e741dd8-a747-4874-8d90-0a654edfa5a5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:45.039760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f170ade-faf7-49a8-81b4-de3f23fb52ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:45.040428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f170ade-faf7-49a8-81b4-de3f23fb52ab None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:45.040768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f170ade-faf7-49a8-81b4-de3f23fb52ab None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:45.041242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f170ade-faf7-49a8-81b4-de3f23fb52ab None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:45.042092 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f170ade-faf7-49a8-81b4-de3f23fb52ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:45.042398 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f170ade-faf7-49a8-81b4-de3f23fb52ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:45.043762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f170ade-faf7-49a8-81b4-de3f23fb52ab None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:45.055056 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 517/1047] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:45.061155 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f170ade-faf7-49a8-81b4-de3f23fb52ab None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:45.080633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 531/1048] 10.222.0.81 () {60 vars in 1144 bytes} [Wed May 4 17:30:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:30:45.185733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f170ade-faf7-49a8-81b4-de3f23fb52ab None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:45.239608 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2418b-75b7-49b9-9e22-cb99071bc8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:45.240433 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2418b-75b7-49b9-9e22-cb99071bc8cb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:45.240734 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2418b-75b7-49b9-9e22-cb99071bc8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:45.241007 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2418b-75b7-49b9-9e22-cb99071bc8cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:45.250384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2418b-75b7-49b9-9e22-cb99071bc8cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:45.251969 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2418b-75b7-49b9-9e22-cb99071bc8cb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:45.267206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-48b2418b-75b7-49b9-9e22-cb99071bc8cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:45.267206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:45.267206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:45.267206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:45.267206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:45.267206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:45.267206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:45.267206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:45.267206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:45.267206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:45.267206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:45.267206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:45.267206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:30:45.267206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:30:45.267206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:45.268258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:45.269207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:30:45.269207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:30:45.269207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:30:45.269207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:30:45.269207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:30:45.269207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:30:45.269207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:45.269207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:45.269207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 518/1049] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:45.274744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e741dd8-a747-4874-8d90-0a654edfa5a5 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:45.382717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368ac4f-d311-414e-8d48-684e71302c5c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:45.383035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368ac4f-d311-414e-8d48-684e71302c5c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:45.383119 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e741dd8-a747-4874-8d90-0a654edfa5a5 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:45.383542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368ac4f-d311-414e-8d48-684e71302c5c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:45.386356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 519/1050] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:30:45.393395 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e5947-b213-4bc7-9dc9-d0df35726288 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:45.393677 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e5947-b213-4bc7-9dc9-d0df35726288 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:45.393966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e5947-b213-4bc7-9dc9-d0df35726288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:45.411623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b33e5947-b213-4bc7-9dc9-d0df35726288 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:45.412891 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b33e5947-b213-4bc7-9dc9-d0df35726288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:45.420347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e5ebb-7543-4e0f-9cd8-823b76dff983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:45.421033 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e5ebb-7543-4e0f-9cd8-823b76dff983 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:45.421307 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e5ebb-7543-4e0f-9cd8-823b76dff983 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:45.422097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e5ebb-7543-4e0f-9cd8-823b76dff983 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:45.422378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e5ebb-7543-4e0f-9cd8-823b76dff983 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:45.422664 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e5ebb-7543-4e0f-9cd8-823b76dff983 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:45.424098 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e5ebb-7543-4e0f-9cd8-823b76dff983 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:45.437666 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 532/1051] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:30:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:45.443361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e5ebb-7543-4e0f-9cd8-823b76dff983 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:45.504582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 520/1052] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:30:45.522703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e5947-b213-4bc7-9dc9-d0df35726288 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:45.580526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e5ebb-7543-4e0f-9cd8-823b76dff983 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:45.622695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9806900-9350-4d2e-8cae-5b23314ffb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:45.623539 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9806900-9350-4d2e-8cae-5b23314ffb91 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:45.623821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9806900-9350-4d2e-8cae-5b23314ffb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:45.624093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9806900-9350-4d2e-8cae-5b23314ffb91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:45.625108 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9806900-9350-4d2e-8cae-5b23314ffb91 None admin] RBAC: Adding query filter params (role.id=ca2ed1519dea4a5f9b31d465765c20a4, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=d4a073d8f47a485cbb22db01530f3b37) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:45.625425 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9806900-9350-4d2e-8cae-5b23314ffb91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:45.626851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9806900-9350-4d2e-8cae-5b23314ffb91 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:45.631654 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e5947-b213-4bc7-9dc9-d0df35726288 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:45.633407 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 533/1053] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:30:45 2022] GET /identity/v3/role_assignments?user.id=d4a073d8f47a485cbb22db01530f3b37&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=ca2ed1519dea4a5f9b31d465765c20a4 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:45.671892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf050013-05d7-4e2f-a3c6-5b0205eb31de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:45.673277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050013-05d7-4e2f-a3c6-5b0205eb31de None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:45.673798 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050013-05d7-4e2f-a3c6-5b0205eb31de None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:45.674315 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050013-05d7-4e2f-a3c6-5b0205eb31de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:45.688074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf050013-05d7-4e2f-a3c6-5b0205eb31de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:45.696716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-bf050013-05d7-4e2f-a3c6-5b0205eb31de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:30:45.696716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:45.696716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:45.696716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:45.696716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:45.696716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:45.696716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:45.696716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:45.696716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:45.696716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:45.696716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:45.696716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:45.696716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:45.696716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:45.696716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:45.696716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:45.698116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:45.698116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:45.698116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:45.698116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:45.698116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:45.698116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:45.698116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:45.698116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:45.698116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:45.698116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:45.698116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:45.698116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:45.698116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:45.698116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:45.698116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:45.698116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:45.701728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:45.701728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:45.701728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:45.701728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:45.701728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:45.701728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:45.701728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:45.701728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:45.701728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:45.701728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:45.701728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:30:45.701728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:45.701728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 521/1054] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:30:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:45.704751 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9806900-9350-4d2e-8cae-5b23314ffb91 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:45.821829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9806900-9350-4d2e-8cae-5b23314ffb91 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:45.858596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f509b2e-2f06-4487-be31-ed23473c4ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:45.859265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f509b2e-2f06-4487-be31-ed23473c4ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:45.859547 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f509b2e-2f06-4487-be31-ed23473c4ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:45.859823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f509b2e-2f06-4487-be31-ed23473c4ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:45.860602 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f509b2e-2f06-4487-be31-ed23473c4ce6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:45.860913 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f509b2e-2f06-4487-be31-ed23473c4ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:45.862280 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f509b2e-2f06-4487-be31-ed23473c4ce6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:45.872021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 534/1055] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:30:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:45.878133 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf050013-05d7-4e2f-a3c6-5b0205eb31de None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:45.980579 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf050013-05d7-4e2f-a3c6-5b0205eb31de None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:46.013512 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9861860-578e-430b-abaa-7ce13aeedb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:46.014385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9861860-578e-430b-abaa-7ce13aeedb97 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:46.014668 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9861860-578e-430b-abaa-7ce13aeedb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:46.014947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9861860-578e-430b-abaa-7ce13aeedb97 None admin] PATH_INFO: `/v3/users/d3f9cd6e89b94fa78ad5cf892bbdb79f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:46.028135 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9861860-578e-430b-abaa-7ce13aeedb97 None admin] RBAC: Authorizing `identity:get_user(user_id=d3f9cd6e89b94fa78ad5cf892bbdb79f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:46.029635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9861860-578e-430b-abaa-7ce13aeedb97 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:46.036125 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 522/1056] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:30:45 2022] GET /identity/v3/users/d3f9cd6e89b94fa78ad5cf892bbdb79f => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:46.037890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f509b2e-2f06-4487-be31-ed23473c4ce6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:46.137112 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f509b2e-2f06-4487-be31-ed23473c4ce6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:46.169931 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7541b5b-cdd7-44ce-9aa2-a3335ce828e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:46.170570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7541b5b-cdd7-44ce-9aa2-a3335ce828e7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:46.170852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7541b5b-cdd7-44ce-9aa2-a3335ce828e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:46.171125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7541b5b-cdd7-44ce-9aa2-a3335ce828e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:46.236898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7541b5b-cdd7-44ce-9aa2-a3335ce828e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:46.238366 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7541b5b-cdd7-44ce-9aa2-a3335ce828e7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:46.348411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 535/1057] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:30:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 17:30:46.350029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9861860-578e-430b-abaa-7ce13aeedb97 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:46.463267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9861860-578e-430b-abaa-7ce13aeedb97 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:46.496348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a806b2-d7bc-4cf6-a09e-ed1d248784da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:46.497234 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a806b2-d7bc-4cf6-a09e-ed1d248784da None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:46.497520 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a806b2-d7bc-4cf6-a09e-ed1d248784da None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:46.498057 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a806b2-d7bc-4cf6-a09e-ed1d248784da None admin] PATH_INFO: `/v3/projects/9140d04e24ff4ba49053315baa587ba9` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:46.499249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a806b2-d7bc-4cf6-a09e-ed1d248784da None admin] RBAC: Authorizing `identity:get_project(project_id=9140d04e24ff4ba49053315baa587ba9)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:46.500696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a806b2-d7bc-4cf6-a09e-ed1d248784da None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:46.502591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 523/1058] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:30:46 2022] GET /identity/v3/projects/9140d04e24ff4ba49053315baa587ba9 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:46.508375 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7541b5b-cdd7-44ce-9aa2-a3335ce828e7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:46.611701 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7541b5b-cdd7-44ce-9aa2-a3335ce828e7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:46.646008 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c857b-1911-4630-8e40-bc877c06008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:46.646661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c857b-1911-4630-8e40-bc877c06008b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:46.646968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c857b-1911-4630-8e40-bc877c06008b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:46.647242 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c857b-1911-4630-8e40-bc877c06008b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:46.648059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c857b-1911-4630-8e40-bc877c06008b None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=9140d04e24ff4ba49053315baa587ba9, user.id=d3f9cd6e89b94fa78ad5cf892bbdb79f) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:46.648358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c857b-1911-4630-8e40-bc877c06008b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:46.649792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c857b-1911-4630-8e40-bc877c06008b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:46.656195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 536/1059] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:30:46 2022] GET /identity/v3/role_assignments?user.id=d3f9cd6e89b94fa78ad5cf892bbdb79f&scope.project.id=9140d04e24ff4ba49053315baa587ba9&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:47.428625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10692415-90d5-4e80-b5e5-5c45ce7a4342 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:47.429166 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10692415-90d5-4e80-b5e5-5c45ce7a4342 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:47.429166 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10692415-90d5-4e80-b5e5-5c45ce7a4342 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:47.430571 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 524/1060] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:47.437424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd4aa8-2be0-43e9-af21-e18cb3af20d3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:47.437424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd4aa8-2be0-43e9-af21-e18cb3af20d3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:47.437424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd4aa8-2be0-43e9-af21-e18cb3af20d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:47.453515 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c6fd4aa8-2be0-43e9-af21-e18cb3af20d3 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:47.454697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c6fd4aa8-2be0-43e9-af21-e18cb3af20d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:47.521348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 537/1061] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:47.544574 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10692415-90d5-4e80-b5e5-5c45ce7a4342 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:47.647366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10692415-90d5-4e80-b5e5-5c45ce7a4342 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:47.680333 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495bed9-8740-41ea-99c6-1cd2fd3425c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:47.681007 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495bed9-8740-41ea-99c6-1cd2fd3425c2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:47.681850 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495bed9-8740-41ea-99c6-1cd2fd3425c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:47.682240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495bed9-8740-41ea-99c6-1cd2fd3425c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:47.755087 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495bed9-8740-41ea-99c6-1cd2fd3425c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:47.756623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495bed9-8740-41ea-99c6-1cd2fd3425c2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:47.857942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 525/1062] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:30:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:30:47.859800 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd4aa8-2be0-43e9-af21-e18cb3af20d3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:47.920816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb7bbc-f15c-47d5-960e-2a99374a2124 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:47.921009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb7bbc-f15c-47d5-960e-2a99374a2124 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:47.921299 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb7bbc-f15c-47d5-960e-2a99374a2124 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:47.922794 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 526/1063] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:30:47.927455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffc997-6000-4227-af2d-bbb2f0bd5eab None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:47.927743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffc997-6000-4227-af2d-bbb2f0bd5eab None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:47.928018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffc997-6000-4227-af2d-bbb2f0bd5eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:47.944704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-31ffc997-6000-4227-af2d-bbb2f0bd5eab None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:47.945889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-31ffc997-6000-4227-af2d-bbb2f0bd5eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:47.961666 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd4aa8-2be0-43e9-af21-e18cb3af20d3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:48.004044 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e84636-1d52-45d7-ac15-8540e7cb0d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:48.004875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e84636-1d52-45d7-ac15-8540e7cb0d46 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:48.005153 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e84636-1d52-45d7-ac15-8540e7cb0d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:48.005433 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e84636-1d52-45d7-ac15-8540e7cb0d46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:48.019432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 527/1064] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:30:48.023873 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e84636-1d52-45d7-ac15-8540e7cb0d46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:48.025618 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e84636-1d52-45d7-ac15-8540e7cb0d46 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:48.046027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-c6e84636-1d52-45d7-ac15-8540e7cb0d46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:48.046027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:48.046027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:48.046027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:48.046027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:48.046027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:48.046027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:48.046027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:48.046027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:48.046027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:48.046027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:48.046027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:48.046027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:48.046027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:48.046027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:48.047074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:48.047955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:48.047955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:48.047955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:48.047955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:48.047955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 538/1065] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:48.049775 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffc997-6000-4227-af2d-bbb2f0bd5eab None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:48.053012 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e84636-1d52-45d7-ac15-8540e7cb0d46 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:48.152196 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffc997-6000-4227-af2d-bbb2f0bd5eab None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:48.157927 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e84636-1d52-45d7-ac15-8540e7cb0d46 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:48.185991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57645508-35ee-4a6c-a894-e085f398b111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:48.186728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57645508-35ee-4a6c-a894-e085f398b111 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:48.187015 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57645508-35ee-4a6c-a894-e085f398b111 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:48.187288 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57645508-35ee-4a6c-a894-e085f398b111 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:48.193428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800488e-d2f4-4f1f-8ca0-a445ea2fb62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:48.194110 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800488e-d2f4-4f1f-8ca0-a445ea2fb62a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:48.194390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800488e-d2f4-4f1f-8ca0-a445ea2fb62a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:48.194693 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800488e-d2f4-4f1f-8ca0-a445ea2fb62a None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:48.195529 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800488e-d2f4-4f1f-8ca0-a445ea2fb62a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:48.195698 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800488e-d2f4-4f1f-8ca0-a445ea2fb62a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:48.197593 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800488e-d2f4-4f1f-8ca0-a445ea2fb62a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:48.198813 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57645508-35ee-4a6c-a894-e085f398b111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:48.206824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-57645508-35ee-4a6c-a894-e085f398b111 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:30:48.206824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:48.206824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:48.206824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:48.206824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:48.206824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:48.206824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:48.206824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:48.206824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:48.206824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:48.206824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:48.206824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:48.206824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:48.206824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:48.206824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:48.206824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:48.207829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:48.207829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:48.207829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:48.207829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:48.207829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:48.207829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:48.207829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:48.207829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:48.207829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:48.207829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:48.207829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:48.207829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:48.207829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:48.207829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:48.207829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:48.207829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:48.208679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:48.208679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:48.208679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:48.208679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:48.208679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:48.208679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:48.208679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:48.208679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:48.208679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:48.208679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:48.208679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:30:48.208679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:48.208679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 528/1066] 10.222.0.81 () {56 vars in 1120 bytes} [Wed May 4 17:30:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:48.220691 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 539/1067] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:48.220919 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57645508-35ee-4a6c-a894-e085f398b111 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:48.328071 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57645508-35ee-4a6c-a894-e085f398b111 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:48.369695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c05c31-82c0-49e1-87a7-0758b804f055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:48.370429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c05c31-82c0-49e1-87a7-0758b804f055 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:48.370714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c05c31-82c0-49e1-87a7-0758b804f055 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:48.370986 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c05c31-82c0-49e1-87a7-0758b804f055 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:48.371752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c05c31-82c0-49e1-87a7-0758b804f055 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:48.372062 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c05c31-82c0-49e1-87a7-0758b804f055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:48.373750 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c05c31-82c0-49e1-87a7-0758b804f055 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:48.388103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 529/1068] 10.222.0.81 () {56 vars in 1115 bytes} [Wed May 4 17:30:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:48.390424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800488e-d2f4-4f1f-8ca0-a445ea2fb62a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:48.499898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800488e-d2f4-4f1f-8ca0-a445ea2fb62a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:48.535220 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77e126-b609-4107-ac84-5fcd87d23ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:48.536033 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77e126-b609-4107-ac84-5fcd87d23ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:48.536312 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77e126-b609-4107-ac84-5fcd87d23ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:48.536616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77e126-b609-4107-ac84-5fcd87d23ff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:48.548504 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77e126-b609-4107-ac84-5fcd87d23ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:48.549978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77e126-b609-4107-ac84-5fcd87d23ff6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:48.568789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-6e77e126-b609-4107-ac84-5fcd87d23ff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:48.568789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:48.568789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:48.568789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:48.568789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:48.568789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:48.568789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:48.568789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:48.568789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:48.568789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:48.568789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:48.568789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:48.568789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:48.568789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:48.568789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:48.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:48.570714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:48.570714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:48.570714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:48.570714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:48.570714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 540/1069] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:48.576701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c05c31-82c0-49e1-87a7-0758b804f055 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:48.673472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c05c31-82c0-49e1-87a7-0758b804f055 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:48.710765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9a68d-0533-4c82-8198-dfcb8ad913bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:48.711416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9a68d-0533-4c82-8198-dfcb8ad913bc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:48.711698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9a68d-0533-4c82-8198-dfcb8ad913bc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:48.711975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9a68d-0533-4c82-8198-dfcb8ad913bc None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:48.712934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9a68d-0533-4c82-8198-dfcb8ad913bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:48.713157 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9a68d-0533-4c82-8198-dfcb8ad913bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:48.714508 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9a68d-0533-4c82-8198-dfcb8ad913bc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:48.725881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 530/1070] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:48.731544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77e126-b609-4107-ac84-5fcd87d23ff6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:48.832007 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77e126-b609-4107-ac84-5fcd87d23ff6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:48.864431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d800b0e-a3e2-4b18-ab25-5edcb7af72a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:48.865230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d800b0e-a3e2-4b18-ab25-5edcb7af72a0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:48.865505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d800b0e-a3e2-4b18-ab25-5edcb7af72a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:48.865771 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d800b0e-a3e2-4b18-ab25-5edcb7af72a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:48.873650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d800b0e-a3e2-4b18-ab25-5edcb7af72a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:48.875067 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d800b0e-a3e2-4b18-ab25-5edcb7af72a0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:48.889188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-4d800b0e-a3e2-4b18-ab25-5edcb7af72a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:30:48.889188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:48.889188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:48.889188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:48.889188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:48.889188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:48.889188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:48.889188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:48.889188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:48.889188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:48.889188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:48.889188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:48.889188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:30:48.889188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:30:48.889188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:30:48.889188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:48.890321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:48.891418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:48.891418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:48.891418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:30:48.891418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:30:48.891418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:30:48.891418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:30:48.891418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:30:48.891418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:30:48.891418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:30:48.891418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:48.891418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 541/1071] 10.222.0.81 () {56 vars in 1093 bytes} [Wed May 4 17:30:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:48.896323 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9a68d-0533-4c82-8198-dfcb8ad913bc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:48.945559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f945fd9-d4a0-468f-b3f6-7ddac4138fa9 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:48.945839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f945fd9-d4a0-468f-b3f6-7ddac4138fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:48.946115 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f945fd9-d4a0-468f-b3f6-7ddac4138fa9 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:48.948128 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 542/1072] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:30:48.953973 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebceb0b6-cdf8-464b-9fb9-0480a168b855 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:48.954253 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebceb0b6-cdf8-464b-9fb9-0480a168b855 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:48.954525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebceb0b6-cdf8-464b-9fb9-0480a168b855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:48.971122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ebceb0b6-cdf8-464b-9fb9-0480a168b855 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:48.972295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ebceb0b6-cdf8-464b-9fb9-0480a168b855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:48.994701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9a68d-0533-4c82-8198-dfcb8ad913bc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:49.027190 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd682cc3-3ffc-41f1-bfc6-7842fa4163cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:49.027918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd682cc3-3ffc-41f1-bfc6-7842fa4163cb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:49.028201 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd682cc3-3ffc-41f1-bfc6-7842fa4163cb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:49.028505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd682cc3-3ffc-41f1-bfc6-7842fa4163cb None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:49.029352 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd682cc3-3ffc-41f1-bfc6-7842fa4163cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:49.029683 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd682cc3-3ffc-41f1-bfc6-7842fa4163cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:49.031147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd682cc3-3ffc-41f1-bfc6-7842fa4163cb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:49.038695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 543/1073] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:49.053175 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 531/1074] 10.222.0.81 () {56 vars in 1133 bytes} [Wed May 4 17:30:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:49.054287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebceb0b6-cdf8-464b-9fb9-0480a168b855 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:49.062180 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd682cc3-3ffc-41f1-bfc6-7842fa4163cb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:49.153249 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebceb0b6-cdf8-464b-9fb9-0480a168b855 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:49.158209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd682cc3-3ffc-41f1-bfc6-7842fa4163cb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:49.187109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d012c-a960-46c6-b09d-981fac912f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:49.187889 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d012c-a960-46c6-b09d-981fac912f99 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:49.188169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d012c-a960-46c6-b09d-981fac912f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:49.188458 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d012c-a960-46c6-b09d-981fac912f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:49.191302 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66330073-7668-402e-ae3c-a765344a3b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:49.192082 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66330073-7668-402e-ae3c-a765344a3b30 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:49.192366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66330073-7668-402e-ae3c-a765344a3b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:49.192671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66330073-7668-402e-ae3c-a765344a3b30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:49.198721 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d012c-a960-46c6-b09d-981fac912f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:49.200279 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d012c-a960-46c6-b09d-981fac912f99 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:49.203189 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66330073-7668-402e-ae3c-a765344a3b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:49.210812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-66330073-7668-402e-ae3c-a765344a3b30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:30:49.210812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:49.210812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:49.210812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:49.210812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:49.210812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:49.210812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:49.210812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:49.210812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:49.210812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:49.210812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:49.210812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:49.210812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:49.210812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:49.210812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:49.210812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:49.211830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:49.211830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:49.211830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:49.211830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:49.211830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:49.211830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:49.211830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:49.211830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:49.211830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:49.211830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:49.211830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:49.211830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:49.211830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:49.211830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:49.211830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:49.211830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:49.213370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:49.213370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:49.213370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:49.213370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:49.213370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:49.213370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:49.213370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:49.213370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:49.213370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:49.213370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:49.213370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:30:49.213370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:49.213370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 532/1075] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:30:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:49.217852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-401d012c-a960-46c6-b09d-981fac912f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:49.217852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:49.217852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:49.217852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:49.217852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:49.217852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:49.217852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:49.217852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:49.217852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:49.217852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:49.217852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:49.217852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:49.217852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:49.217852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:49.217852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:49.218991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:49.224634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:49.224634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:49.224634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:49.224634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:49.224926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66330073-7668-402e-ae3c-a765344a3b30 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:49.225103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 544/1076] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:49.225103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d012c-a960-46c6-b09d-981fac912f99 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:49.314471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66330073-7668-402e-ae3c-a765344a3b30 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:49.318841 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d012c-a960-46c6-b09d-981fac912f99 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:49.350320 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399c035-3822-4dff-9174-8c8fffdf310d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:49.350985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399c035-3822-4dff-9174-8c8fffdf310d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:49.351271 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399c035-3822-4dff-9174-8c8fffdf310d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:49.351549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399c035-3822-4dff-9174-8c8fffdf310d None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:49.352229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d38f9-a151-48af-9b77-e39fb542a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:49.352345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399c035-3822-4dff-9174-8c8fffdf310d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:49.352635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399c035-3822-4dff-9174-8c8fffdf310d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:49.352911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d38f9-a151-48af-9b77-e39fb542a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:49.353205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d38f9-a151-48af-9b77-e39fb542a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:49.353641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d38f9-a151-48af-9b77-e39fb542a6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:49.354035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399c035-3822-4dff-9174-8c8fffdf310d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:49.354178 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d38f9-a151-48af-9b77-e39fb542a6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:49.354479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d38f9-a151-48af-9b77-e39fb542a6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:49.355814 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d38f9-a151-48af-9b77-e39fb542a6e8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:49.362202 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 533/1077] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:30:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:49.366773 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 545/1078] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:49.367916 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399c035-3822-4dff-9174-8c8fffdf310d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:49.373456 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d38f9-a151-48af-9b77-e39fb542a6e8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:49.464304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399c035-3822-4dff-9174-8c8fffdf310d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:49.469939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d38f9-a151-48af-9b77-e39fb542a6e8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:49.499165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9099f0-9445-4cea-a219-cf56f0148daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:49.499991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9099f0-9445-4cea-a219-cf56f0148daa None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:49.500257 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9099f0-9445-4cea-a219-cf56f0148daa None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:49.500556 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9099f0-9445-4cea-a219-cf56f0148daa None admin] PATH_INFO: `/v3/users/d3f9cd6e89b94fa78ad5cf892bbdb79f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:49.501782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9099f0-9445-4cea-a219-cf56f0148daa None admin] RBAC: Authorizing `identity:get_user(user_id=d3f9cd6e89b94fa78ad5cf892bbdb79f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:49.503211 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9099f0-9445-4cea-a219-cf56f0148daa None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:49.504875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 534/1079] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:30:49 2022] GET /identity/v3/users/d3f9cd6e89b94fa78ad5cf892bbdb79f => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:49.505036 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd6162-3887-4d9b-8b22-a929c4292311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:49.510150 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd6162-3887-4d9b-8b22-a929c4292311 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:49.510150 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd6162-3887-4d9b-8b22-a929c4292311 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:49.510150 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd6162-3887-4d9b-8b22-a929c4292311 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:49.515641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9099f0-9445-4cea-a219-cf56f0148daa None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:49.520071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd6162-3887-4d9b-8b22-a929c4292311 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:49.521526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd6162-3887-4d9b-8b22-a929c4292311 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:49.536018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-09dd6162-3887-4d9b-8b22-a929c4292311 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:49.536018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:49.536018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:49.536018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:49.536018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:49.536018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:49.536018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:49.536018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:49.536018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:49.536018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:49.536018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:49.536018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:49.536018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:30:49.536018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:30:49.536018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:49.538234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:49.539417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:30:49.539417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:30:49.539417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:30:49.539417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:30:49.539417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:30:49.539417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:30:49.539417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:49.539417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:49.540704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 546/1080] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:49.542925 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd6162-3887-4d9b-8b22-a929c4292311 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:49.614024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9099f0-9445-4cea-a219-cf56f0148daa None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:49.647628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f00f3-77b0-43ed-aa42-1b664a8bbb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:49.673613 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd6162-3887-4d9b-8b22-a929c4292311 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:49.673781 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f00f3-77b0-43ed-aa42-1b664a8bbb8e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:49.673781 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f00f3-77b0-43ed-aa42-1b664a8bbb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:49.673781 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f00f3-77b0-43ed-aa42-1b664a8bbb8e None admin] PATH_INFO: `/v3/projects/9140d04e24ff4ba49053315baa587ba9` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:49.673781 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f00f3-77b0-43ed-aa42-1b664a8bbb8e None admin] RBAC: Authorizing `identity:get_project(project_id=9140d04e24ff4ba49053315baa587ba9)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:49.673781 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f00f3-77b0-43ed-aa42-1b664a8bbb8e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:49.673781 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 535/1081] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:30:49 2022] GET /identity/v3/projects/9140d04e24ff4ba49053315baa587ba9 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:49.674237 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f00f3-77b0-43ed-aa42-1b664a8bbb8e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:49.682021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe6e40-edb3-4e60-9d13-bf0fba8189a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:49.682677 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6e40-edb3-4e60-9d13-bf0fba8189a4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:49.682955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6e40-edb3-4e60-9d13-bf0fba8189a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:49.683229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6e40-edb3-4e60-9d13-bf0fba8189a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:49.684019 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe6e40-edb3-4e60-9d13-bf0fba8189a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:49.684324 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe6e40-edb3-4e60-9d13-bf0fba8189a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:49.685789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe6e40-edb3-4e60-9d13-bf0fba8189a4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:49.697874 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 547/1082] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:30:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:49.703779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe6e40-edb3-4e60-9d13-bf0fba8189a4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:49.755909 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f00f3-77b0-43ed-aa42-1b664a8bbb8e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:49.789800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb12d13-44c3-4bbe-9bda-eb335a10a78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:49.790718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb12d13-44c3-4bbe-9bda-eb335a10a78b None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:49.791003 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb12d13-44c3-4bbe-9bda-eb335a10a78b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:49.791278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb12d13-44c3-4bbe-9bda-eb335a10a78b None admin] PATH_INFO: `/v3/projects/9140d04e24ff4ba49053315baa587ba9/users/d3f9cd6e89b94fa78ad5cf892bbdb79f/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:49.793330 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb12d13-44c3-4bbe-9bda-eb335a10a78b None admin] RBAC: Authorizing `identity:create_grant(project_id=9140d04e24ff4ba49053315baa587ba9, user_id=d3f9cd6e89b94fa78ad5cf892bbdb79f, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:49.794760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb12d13-44c3-4bbe-9bda-eb335a10a78b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:49.805253 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe6e40-edb3-4e60-9d13-bf0fba8189a4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:49.842793 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc086e-e956-48f3-9d9c-38c924574be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:49.844146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc086e-e956-48f3-9d9c-38c924574be3 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:49.844678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc086e-e956-48f3-9d9c-38c924574be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:49.845211 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc086e-e956-48f3-9d9c-38c924574be3 None admin] PATH_INFO: `/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/d4a073d8f47a485cbb22db01530f3b37/roles/ca2ed1519dea4a5f9b31d465765c20a4` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:49.848769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc086e-e956-48f3-9d9c-38c924574be3 None admin] RBAC: Authorizing `identity:create_grant(project_id=544a56c4b97e43aea9fbb003d80af8dc, user_id=d4a073d8f47a485cbb22db01530f3b37, role_id=ca2ed1519dea4a5f9b31d465765c20a4)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:49.851478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc086e-e956-48f3-9d9c-38c924574be3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:49.870247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 536/1083] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:30:49 2022] PUT /identity/v3/projects/9140d04e24ff4ba49053315baa587ba9/users/d3f9cd6e89b94fa78ad5cf892bbdb79f/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:30:49.930016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 548/1084] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:30:49 2022] PUT /identity/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/d4a073d8f47a485cbb22db01530f3b37/roles/ca2ed1519dea4a5f9b31d465765c20a4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:30:52.298221 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ba587-d521-4e70-945f-6424b9956732 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:52.298758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ba587-d521-4e70-945f-6424b9956732 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:52.298758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ba587-d521-4e70-945f-6424b9956732 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:52.300109 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 537/1085] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:52.305398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538466c-0cf8-41e7-b44c-cc0abbc06eff None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:52.305816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538466c-0cf8-41e7-b44c-cc0abbc06eff None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:52.305954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538466c-0cf8-41e7-b44c-cc0abbc06eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:52.322289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1538466c-0cf8-41e7-b44c-cc0abbc06eff None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:52.323475 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1538466c-0cf8-41e7-b44c-cc0abbc06eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:52.357210 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e6392-fe9d-44c5-84d8-81ce0aaa8caf None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:52.357496 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e6392-fe9d-44c5-84d8-81ce0aaa8caf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:52.357772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e6392-fe9d-44c5-84d8-81ce0aaa8caf None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:52.359113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 538/1086] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:30:52.363864 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260a9b3-4829-4608-a00b-cd61b50b8e86 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:52.364153 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260a9b3-4829-4608-a00b-cd61b50b8e86 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:52.364431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260a9b3-4829-4608-a00b-cd61b50b8e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:52.381137 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8260a9b3-4829-4608-a00b-cd61b50b8e86 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:52.382319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8260a9b3-4829-4608-a00b-cd61b50b8e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:52.392151 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 549/1087] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:52.416518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538466c-0cf8-41e7-b44c-cc0abbc06eff None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:52.447778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 539/1088] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:30:52.479559 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260a9b3-4829-4608-a00b-cd61b50b8e86 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:52.520173 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538466c-0cf8-41e7-b44c-cc0abbc06eff None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:52.552420 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7679f1-290b-41d4-a428-3c4311523b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:52.553168 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7679f1-290b-41d4-a428-3c4311523b1b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:52.553449 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7679f1-290b-41d4-a428-3c4311523b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:52.553716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7679f1-290b-41d4-a428-3c4311523b1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:52.564217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7679f1-290b-41d4-a428-3c4311523b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:52.572603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7d7679f1-290b-41d4-a428-3c4311523b1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:30:52.572603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:52.572603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:52.572603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:52.572603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:52.572603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:52.572603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:52.572603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:52.572603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:52.572603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:52.572603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:52.572603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:52.572603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:52.572603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:52.572603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:52.572603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:52.573726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:52.573726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:52.573726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:52.573726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:52.573726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:52.573726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:52.573726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:52.573726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:52.573726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:52.573726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:52.573726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:52.573726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:30:52.573726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:52.573726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:52.573726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:52.573726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:52.579678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:52.579678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:52.579678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:52.579678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:52.579678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:52.579678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:52.579678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:52.579678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:52.579678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:52.579678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:52.579678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:30:52.579678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:30:52.579678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 550/1089] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:30:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:52.580356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260a9b3-4829-4608-a00b-cd61b50b8e86 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:52.580428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7679f1-290b-41d4-a428-3c4311523b1b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:52.608793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa3a13-ac3a-4147-8d2a-5dc9841fc7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:52.611543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa3a13-ac3a-4147-8d2a-5dc9841fc7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:52.611543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa3a13-ac3a-4147-8d2a-5dc9841fc7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:52.611543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa3a13-ac3a-4147-8d2a-5dc9841fc7a8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:52.619885 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa3a13-ac3a-4147-8d2a-5dc9841fc7a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:30:52.628132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-deaa3a13-ac3a-4147-8d2a-5dc9841fc7a8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:30:52.628132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:52.628132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:52.628132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:52.628132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:52.628132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:52.628132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:52.628132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:52.628132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:52.628132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:52.628132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:52.628132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:52.628132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:30:52.628132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:30:52.628132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:30:52.628132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:30:52.629128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:30:52.629128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:30:52.629128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:30:52.629128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:30:52.629128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:52.629128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:52.629128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:52.629128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:52.629128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:52.629128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:52.629128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:52.629128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:52.629128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:52.629128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:52.629128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:52.629128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:52.630019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:52.630019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:52.630019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:52.630019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:52.630019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:30:52.630019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:30:52.630019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:30:52.630019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:30:52.630019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:30:52.630019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:30:52.630019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 17:30:52.630019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:52.630019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 540/1090] 10.222.0.81 () {56 vars in 1120 bytes} [Wed May 4 17:30:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:52.636025 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa3a13-ac3a-4147-8d2a-5dc9841fc7a8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:52.676508 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7679f1-290b-41d4-a428-3c4311523b1b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:52.708991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f154686-f555-4590-9bc9-a4293626a7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:52.709644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f154686-f555-4590-9bc9-a4293626a7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:52.709922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f154686-f555-4590-9bc9-a4293626a7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:52.710191 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f154686-f555-4590-9bc9-a4293626a7f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:52.710923 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f154686-f555-4590-9bc9-a4293626a7f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:52.711225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f154686-f555-4590-9bc9-a4293626a7f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:52.713160 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f154686-f555-4590-9bc9-a4293626a7f4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:52.721183 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 551/1091] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:30:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:52.726862 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f154686-f555-4590-9bc9-a4293626a7f4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:52.734188 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa3a13-ac3a-4147-8d2a-5dc9841fc7a8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:52.766929 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e654d-0157-4023-8dd4-d0bcdfe281c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:52.767615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e654d-0157-4023-8dd4-d0bcdfe281c3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:52.767899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e654d-0157-4023-8dd4-d0bcdfe281c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:52.768178 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e654d-0157-4023-8dd4-d0bcdfe281c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:52.768958 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e654d-0157-4023-8dd4-d0bcdfe281c3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:52.769270 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e654d-0157-4023-8dd4-d0bcdfe281c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:52.770646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e654d-0157-4023-8dd4-d0bcdfe281c3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:52.778818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 541/1092] 10.222.0.81 () {56 vars in 1115 bytes} [Wed May 4 17:30:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:52.784685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e654d-0157-4023-8dd4-d0bcdfe281c3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:52.825012 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f154686-f555-4590-9bc9-a4293626a7f4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:52.868938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ea5b7-515c-4068-aed4-3389ee91d76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:52.870125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ea5b7-515c-4068-aed4-3389ee91d76f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:52.870450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ea5b7-515c-4068-aed4-3389ee91d76f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:52.870787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ea5b7-515c-4068-aed4-3389ee91d76f None admin] PATH_INFO: `/v3/users/d3f9cd6e89b94fa78ad5cf892bbdb79f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:52.872147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ea5b7-515c-4068-aed4-3389ee91d76f None admin] RBAC: Authorizing `identity:get_user(user_id=d3f9cd6e89b94fa78ad5cf892bbdb79f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:52.873897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ea5b7-515c-4068-aed4-3389ee91d76f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:52.875595 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 552/1093] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:30:52 2022] GET /identity/v3/users/d3f9cd6e89b94fa78ad5cf892bbdb79f => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:52.881422 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ea5b7-515c-4068-aed4-3389ee91d76f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:52.905933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e654d-0157-4023-8dd4-d0bcdfe281c3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:52.941449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6281a0-16f7-43af-b7c5-c8d93e4e27ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:52.942247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6281a0-16f7-43af-b7c5-c8d93e4e27ef None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:52.942530 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6281a0-16f7-43af-b7c5-c8d93e4e27ef None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:52.942806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6281a0-16f7-43af-b7c5-c8d93e4e27ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:52.957567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6281a0-16f7-43af-b7c5-c8d93e4e27ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:52.959027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6281a0-16f7-43af-b7c5-c8d93e4e27ef None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:52.976309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-6a6281a0-16f7-43af-b7c5-c8d93e4e27ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:52.976309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:52.976309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:52.976309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:52.976309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:52.976309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:52.976309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:52.976309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:52.976309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:52.976309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:52.976309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:52.976309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:52.976309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:52.976309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:52.976309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:52.977441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:52.978895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:52.978895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:52.978895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:52.978895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:52.978895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 542/1094] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:52.984018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6281a0-16f7-43af-b7c5-c8d93e4e27ef None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:52.988741 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ea5b7-515c-4068-aed4-3389ee91d76f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:53.023143 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da6b47-12c0-492f-aa92-b20e6768f97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:53.023788 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da6b47-12c0-492f-aa92-b20e6768f97b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:53.024067 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da6b47-12c0-492f-aa92-b20e6768f97b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:53.024369 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da6b47-12c0-492f-aa92-b20e6768f97b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:53.086765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6281a0-16f7-43af-b7c5-c8d93e4e27ef None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:53.093164 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da6b47-12c0-492f-aa92-b20e6768f97b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:53.094585 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da6b47-12c0-492f-aa92-b20e6768f97b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:53.122502 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17257b0a-3dff-4b65-83f0-2f198e02bf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:53.123431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17257b0a-3dff-4b65-83f0-2f198e02bf0d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:53.123717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17257b0a-3dff-4b65-83f0-2f198e02bf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:53.124000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17257b0a-3dff-4b65-83f0-2f198e02bf0d None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:53.124756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17257b0a-3dff-4b65-83f0-2f198e02bf0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:53.125066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17257b0a-3dff-4b65-83f0-2f198e02bf0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:53.126425 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17257b0a-3dff-4b65-83f0-2f198e02bf0d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:53.152576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 543/1095] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:53.154226 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17257b0a-3dff-4b65-83f0-2f198e02bf0d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:53.209041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 553/1096] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:30:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:30:53.211670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da6b47-12c0-492f-aa92-b20e6768f97b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:53.298016 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17257b0a-3dff-4b65-83f0-2f198e02bf0d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:53.310816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da6b47-12c0-492f-aa92-b20e6768f97b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:53.341015 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e71a2-1f38-4c5d-82e2-ff547fc95109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:53.341602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e71a2-1f38-4c5d-82e2-ff547fc95109 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:53.341602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e71a2-1f38-4c5d-82e2-ff547fc95109 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:53.341823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e71a2-1f38-4c5d-82e2-ff547fc95109 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:53.349352 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e71a2-1f38-4c5d-82e2-ff547fc95109 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:53.349745 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bd4ea-35b0-4501-9833-a930e05a8a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:53.350591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bd4ea-35b0-4501-9833-a930e05a8a82 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:53.350778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e71a2-1f38-4c5d-82e2-ff547fc95109 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:53.350867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bd4ea-35b0-4501-9833-a930e05a8a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:53.351125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bd4ea-35b0-4501-9833-a930e05a8a82 None admin] PATH_INFO: `/v3/projects/9140d04e24ff4ba49053315baa587ba9` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:53.352273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bd4ea-35b0-4501-9833-a930e05a8a82 None admin] RBAC: Authorizing `identity:get_project(project_id=9140d04e24ff4ba49053315baa587ba9)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:53.354558 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bd4ea-35b0-4501-9833-a930e05a8a82 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:53.356248 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 554/1097] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:30:53 2022] GET /identity/v3/projects/9140d04e24ff4ba49053315baa587ba9 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:53.362203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bd4ea-35b0-4501-9833-a930e05a8a82 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:53.365873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c95e71a2-1f38-4c5d-82e2-ff547fc95109 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 17:30:53.365873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:53.365873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:53.365873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:53.365873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:53.365873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:53.365873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:53.365873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:53.365873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:53.365873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:53.365873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:53.365873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:53.365873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:30:53.365873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:30:53.365873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:30:53.365873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:53.366853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:53.367806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:53.367806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:53.367806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:30:53.367806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:30:53.367806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:30:53.367806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:30:53.367806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:30:53.367806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:30:53.367806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 17:30:53.367806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:53.367806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 544/1098] 10.222.0.81 () {56 vars in 1093 bytes} [Wed May 4 17:30:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:30:53.372993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e71a2-1f38-4c5d-82e2-ff547fc95109 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:53.456462 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bd4ea-35b0-4501-9833-a930e05a8a82 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:53.468324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e71a2-1f38-4c5d-82e2-ff547fc95109 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:53.490092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60a949-20fb-41da-8c7d-f1a2161660d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:53.490729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60a949-20fb-41da-8c7d-f1a2161660d8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:53.491006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60a949-20fb-41da-8c7d-f1a2161660d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:53.491273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60a949-20fb-41da-8c7d-f1a2161660d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:53.492091 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60a949-20fb-41da-8c7d-f1a2161660d8 None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=9140d04e24ff4ba49053315baa587ba9, user.id=d3f9cd6e89b94fa78ad5cf892bbdb79f) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:53.492396 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60a949-20fb-41da-8c7d-f1a2161660d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:53.494264 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60a949-20fb-41da-8c7d-f1a2161660d8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:53.500212 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 555/1099] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:30:53 2022] GET /identity/v3/role_assignments?user.id=d3f9cd6e89b94fa78ad5cf892bbdb79f&scope.project.id=9140d04e24ff4ba49053315baa587ba9&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:53.503206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e04fe-b754-42db-8036-3a9276a02656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:53.503871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e04fe-b754-42db-8036-3a9276a02656 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:53.504151 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e04fe-b754-42db-8036-3a9276a02656 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:53.504423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e04fe-b754-42db-8036-3a9276a02656 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:53.505298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e04fe-b754-42db-8036-3a9276a02656 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:53.505606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e04fe-b754-42db-8036-3a9276a02656 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:53.507051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e04fe-b754-42db-8036-3a9276a02656 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:53.531480 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 545/1100] 10.222.0.81 () {56 vars in 1133 bytes} [Wed May 4 17:30:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:53.537528 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60a949-20fb-41da-8c7d-f1a2161660d8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:53.642506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60a949-20fb-41da-8c7d-f1a2161660d8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:53.678361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afc933-c780-4c9f-9516-c9f1510548bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:53.678999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afc933-c780-4c9f-9516-c9f1510548bb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:53.679281 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afc933-c780-4c9f-9516-c9f1510548bb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:53.679544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afc933-c780-4c9f-9516-c9f1510548bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:53.746609 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afc933-c780-4c9f-9516-c9f1510548bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:53.748305 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afc933-c780-4c9f-9516-c9f1510548bb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:53.841726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 556/1101] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:30:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:30:53.847967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e04fe-b754-42db-8036-3a9276a02656 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:53.943830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e04fe-b754-42db-8036-3a9276a02656 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:53.976232 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e5e49-2ce0-42af-b382-4a89822984d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:53.977037 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e5e49-2ce0-42af-b382-4a89822984d6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:53.977321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e5e49-2ce0-42af-b382-4a89822984d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:53.977597 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e5e49-2ce0-42af-b382-4a89822984d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:53.987296 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e5e49-2ce0-42af-b382-4a89822984d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:53.988757 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e5e49-2ce0-42af-b382-4a89822984d6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:54.006497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b66e5e49-2ce0-42af-b382-4a89822984d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:54.006497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:54.006497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:54.006497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:54.006497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:54.006497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:54.006497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:54.006497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:54.006497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:54.006497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:54.006497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:54.006497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:54.006497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:30:54.006497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:30:54.006497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:54.007399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:54.008562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:30:54.008562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:30:54.008562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:30:54.008562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:54.008562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 546/1102] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:54.013896 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afc933-c780-4c9f-9516-c9f1510548bb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:54.112770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afc933-c780-4c9f-9516-c9f1510548bb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:54.145542 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981f65-a40a-4267-9457-856487ac1a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:54.146182 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981f65-a40a-4267-9457-856487ac1a3d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:54.146453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981f65-a40a-4267-9457-856487ac1a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:54.146722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981f65-a40a-4267-9457-856487ac1a3d None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:54.147427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79981f65-a40a-4267-9457-856487ac1a3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:54.147723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79981f65-a40a-4267-9457-856487ac1a3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:54.149102 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79981f65-a40a-4267-9457-856487ac1a3d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:54.160212 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 557/1103] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:54.166359 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e5e49-2ce0-42af-b382-4a89822984d6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:54.268759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e5e49-2ce0-42af-b382-4a89822984d6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:54.301923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ab767-2c0e-409b-bc96-6e054e50adf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:54.302711 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ab767-2c0e-409b-bc96-6e054e50adf1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:54.302989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ab767-2c0e-409b-bc96-6e054e50adf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:54.303261 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ab767-2c0e-409b-bc96-6e054e50adf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:54.310643 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ab767-2c0e-409b-bc96-6e054e50adf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:54.312089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ab767-2c0e-409b-bc96-6e054e50adf1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:54.326809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9d0ab767-2c0e-409b-bc96-6e054e50adf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:54.326809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:30:54.326809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:30:54.326809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:30:54.326809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:30:54.326809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:30:54.326809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:30:54.326809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:30:54.326809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:30:54.326809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:30:54.326809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:30:54.326809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:30:54.326809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:30:54.326809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:30:54.326809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:30:54.327943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:30:54.333613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:30:54.333613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:30:54.333613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:30:54.333613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:30:54.333613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:30:54.333613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:30:54.333613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:30:54.333613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:30:54.333613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 547/1104] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:30:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:30:54.334392 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981f65-a40a-4267-9457-856487ac1a3d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:54.439765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981f65-a40a-4267-9457-856487ac1a3d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:54.474002 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f8937-2f3c-427a-bd05-57d436ffcd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:54.474658 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f8937-2f3c-427a-bd05-57d436ffcd9d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:54.474937 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f8937-2f3c-427a-bd05-57d436ffcd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:54.475211 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f8937-2f3c-427a-bd05-57d436ffcd9d None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:54.475994 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f8937-2f3c-427a-bd05-57d436ffcd9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:54.476301 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f8937-2f3c-427a-bd05-57d436ffcd9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:54.477800 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f8937-2f3c-427a-bd05-57d436ffcd9d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:54.495452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 558/1105] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:30:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:54.502777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ab767-2c0e-409b-bc96-6e054e50adf1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:54.618287 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ab767-2c0e-409b-bc96-6e054e50adf1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:54.653727 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386f9e2-22f7-4215-ba5a-d16bb60807b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:54.654382 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386f9e2-22f7-4215-ba5a-d16bb60807b3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:54.654665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386f9e2-22f7-4215-ba5a-d16bb60807b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:54.654943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386f9e2-22f7-4215-ba5a-d16bb60807b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:54.655779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386f9e2-22f7-4215-ba5a-d16bb60807b3 None admin] RBAC: Adding query filter params (role.id=ca2ed1519dea4a5f9b31d465765c20a4, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=d4a073d8f47a485cbb22db01530f3b37) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:54.656092 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386f9e2-22f7-4215-ba5a-d16bb60807b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:54.657554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386f9e2-22f7-4215-ba5a-d16bb60807b3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:54.663662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 548/1106] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:30:54 2022] GET /identity/v3/role_assignments?user.id=d4a073d8f47a485cbb22db01530f3b37&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=ca2ed1519dea4a5f9b31d465765c20a4 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:30:55.894499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4263a4-a02e-4e55-86bd-b8e71a002c22 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:55.895044 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4263a4-a02e-4e55-86bd-b8e71a002c22 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:55.895044 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4263a4-a02e-4e55-86bd-b8e71a002c22 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:55.896424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 559/1107] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:55.903320 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be907ba-718d-4328-82b4-6857f0873d06 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:55.903873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be907ba-718d-4328-82b4-6857f0873d06 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:55.903873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be907ba-718d-4328-82b4-6857f0873d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:55.921509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4be907ba-718d-4328-82b4-6857f0873d06 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:55.922906 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4be907ba-718d-4328-82b4-6857f0873d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:55.993195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 549/1108] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:56.018742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4263a4-a02e-4e55-86bd-b8e71a002c22 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:56.118195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4263a4-a02e-4e55-86bd-b8e71a002c22 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:56.150071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50795ae-647f-4e81-931c-e619bc2c9c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:56.151593 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50795ae-647f-4e81-931c-e619bc2c9c0d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:56.151872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50795ae-647f-4e81-931c-e619bc2c9c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:56.152146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50795ae-647f-4e81-931c-e619bc2c9c0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:56.153451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50795ae-647f-4e81-931c-e619bc2c9c0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:56.154858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50795ae-647f-4e81-931c-e619bc2c9c0d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:56.156469 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 560/1109] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:30:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:56.162230 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be907ba-718d-4328-82b4-6857f0873d06 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:56.256339 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be907ba-718d-4328-82b4-6857f0873d06 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:56.288818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba568ecd-1742-4a0c-9e22-a0f9b3e57c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:56.289478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba568ecd-1742-4a0c-9e22-a0f9b3e57c88 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:56.289759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba568ecd-1742-4a0c-9e22-a0f9b3e57c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:56.290035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba568ecd-1742-4a0c-9e22-a0f9b3e57c88 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:56.291287 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba568ecd-1742-4a0c-9e22-a0f9b3e57c88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:56.292723 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba568ecd-1742-4a0c-9e22-a0f9b3e57c88 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:56.383863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 550/1110] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:30:56 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:30:58.746853 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d6912-9c54-491d-8a6a-a4d8901d8b9a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:58.747404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d6912-9c54-491d-8a6a-a4d8901d8b9a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:58.747404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d6912-9c54-491d-8a6a-a4d8901d8b9a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:58.749160 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 561/1111] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:30:58.754416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02a871-3df8-4df8-ab6b-516cccf75270 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:58.754843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02a871-3df8-4df8-ab6b-516cccf75270 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:58.754970 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02a871-3df8-4df8-ab6b-516cccf75270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:58.772264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4c02a871-3df8-4df8-ab6b-516cccf75270 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:30:58.773452 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4c02a871-3df8-4df8-ab6b-516cccf75270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:30:58.841552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 551/1112] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:30:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:30:58.866111 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d6912-9c54-491d-8a6a-a4d8901d8b9a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:58.989809 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d6912-9c54-491d-8a6a-a4d8901d8b9a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:59.025278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21322b7d-b7a2-434d-a944-9c3bf7a48381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:59.026039 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21322b7d-b7a2-434d-a944-9c3bf7a48381 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:59.026313 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21322b7d-b7a2-434d-a944-9c3bf7a48381 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:59.026584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21322b7d-b7a2-434d-a944-9c3bf7a48381 None admin] PATH_INFO: `/v3/roles/8c1bc4243dcc46979dd8ca40186c0ca7` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:59.028040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21322b7d-b7a2-434d-a944-9c3bf7a48381 None admin] RBAC: Authorizing `identity:get_role(role_id=8c1bc4243dcc46979dd8ca40186c0ca7)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:59.029445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21322b7d-b7a2-434d-a944-9c3bf7a48381 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:59.030829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 562/1113] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:30:58 2022] GET /identity/v3/roles/8c1bc4243dcc46979dd8ca40186c0ca7 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:59.039427 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02a871-3df8-4df8-ab6b-516cccf75270 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:59.136879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02a871-3df8-4df8-ab6b-516cccf75270 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:59.169073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4a852-7bed-4d0a-8b6b-22c6a2bca1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:59.169946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4a852-7bed-4d0a-8b6b-22c6a2bca1cf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:59.170228 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4a852-7bed-4d0a-8b6b-22c6a2bca1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:59.170501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4a852-7bed-4d0a-8b6b-22c6a2bca1cf None admin] PATH_INFO: `/v3/users/27d32c408f3c492a9cbc34b3012b1102` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:59.184008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4a852-7bed-4d0a-8b6b-22c6a2bca1cf None admin] RBAC: Authorizing `identity:get_user(user_id=27d32c408f3c492a9cbc34b3012b1102)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:59.185482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4a852-7bed-4d0a-8b6b-22c6a2bca1cf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:59.187156 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 552/1114] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:30:59 2022] GET /identity/v3/users/27d32c408f3c492a9cbc34b3012b1102 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:59.193007 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21322b7d-b7a2-434d-a944-9c3bf7a48381 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:59.289875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21322b7d-b7a2-434d-a944-9c3bf7a48381 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:59.327780 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff11ce-6bce-437a-8672-5e783830af0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:59.328427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff11ce-6bce-437a-8672-5e783830af0d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:59.328726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff11ce-6bce-437a-8672-5e783830af0d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:59.328996 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff11ce-6bce-437a-8672-5e783830af0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:59.394527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff11ce-6bce-437a-8672-5e783830af0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:59.395964 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff11ce-6bce-437a-8672-5e783830af0d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:59.490533 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 563/1115] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:30:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:30:59.497315 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4a852-7bed-4d0a-8b6b-22c6a2bca1cf None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:59.592819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4a852-7bed-4d0a-8b6b-22c6a2bca1cf None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:59.630712 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bc969-45ea-445d-be48-0b364bae6461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:59.631560 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bc969-45ea-445d-be48-0b364bae6461 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:59.631838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bc969-45ea-445d-be48-0b364bae6461 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:59.632106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bc969-45ea-445d-be48-0b364bae6461 None admin] PATH_INFO: `/v3/projects/9140d04e24ff4ba49053315baa587ba9` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:59.633302 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bc969-45ea-445d-be48-0b364bae6461 None admin] RBAC: Authorizing `identity:get_project(project_id=9140d04e24ff4ba49053315baa587ba9)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:59.634818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bc969-45ea-445d-be48-0b364bae6461 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:59.636510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 553/1116] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:30:59 2022] GET /identity/v3/projects/9140d04e24ff4ba49053315baa587ba9 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:30:59.642785 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff11ce-6bce-437a-8672-5e783830af0d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:30:59.737128 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff11ce-6bce-437a-8672-5e783830af0d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:30:59.770834 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5ec96-1fba-441f-9655-903a04b067b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:30:59.771511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5ec96-1fba-441f-9655-903a04b067b4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:30:59.771744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5ec96-1fba-441f-9655-903a04b067b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:30:59.772016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5ec96-1fba-441f-9655-903a04b067b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:30:59.772869 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5ec96-1fba-441f-9655-903a04b067b4 None admin] RBAC: Adding query filter params (role.id=8c1bc4243dcc46979dd8ca40186c0ca7, scope.project.id=9140d04e24ff4ba49053315baa587ba9, user.id=27d32c408f3c492a9cbc34b3012b1102) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:30:59.773179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5ec96-1fba-441f-9655-903a04b067b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:30:59.775131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5ec96-1fba-441f-9655-903a04b067b4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:30:59.780739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 564/1117] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:30:59 2022] GET /identity/v3/role_assignments?user.id=27d32c408f3c492a9cbc34b3012b1102&scope.project.id=9140d04e24ff4ba49053315baa587ba9&role.id=8c1bc4243dcc46979dd8ca40186c0ca7 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:02.004267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49316f-432f-4eb4-b3de-37e3df7185be None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:02.004935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49316f-432f-4eb4-b3de-37e3df7185be None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:02.004935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49316f-432f-4eb4-b3de-37e3df7185be None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:02.006200 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 554/1118] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:31:02.011536 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007aae2c-fee6-4eec-976b-d7f73fc95170 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:02.011924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007aae2c-fee6-4eec-976b-d7f73fc95170 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:02.012085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007aae2c-fee6-4eec-976b-d7f73fc95170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:02.028715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-007aae2c-fee6-4eec-976b-d7f73fc95170 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:31:02.029892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-007aae2c-fee6-4eec-976b-d7f73fc95170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:31:02.094013 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 565/1119] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:31:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:31:02.116706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49316f-432f-4eb4-b3de-37e3df7185be None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:02.219200 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49316f-432f-4eb4-b3de-37e3df7185be None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:02.255450 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d5ef5-26e3-486e-b025-9f79a2a40c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:02.256220 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d5ef5-26e3-486e-b025-9f79a2a40c85 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:02.256532 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d5ef5-26e3-486e-b025-9f79a2a40c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:02.256812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d5ef5-26e3-486e-b025-9f79a2a40c85 None admin] PATH_INFO: `/v3/roles/8c1bc4243dcc46979dd8ca40186c0ca7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:02.258301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d5ef5-26e3-486e-b025-9f79a2a40c85 None admin] RBAC: Authorizing `identity:get_role(role_id=8c1bc4243dcc46979dd8ca40186c0ca7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:02.259791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d5ef5-26e3-486e-b025-9f79a2a40c85 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:02.261364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 555/1120] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:31:02 2022] GET /identity/v3/roles/8c1bc4243dcc46979dd8ca40186c0ca7 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:02.270058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007aae2c-fee6-4eec-976b-d7f73fc95170 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:02.372491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007aae2c-fee6-4eec-976b-d7f73fc95170 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:02.411595 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f7e13-ce20-415d-90f5-6ce05d9881d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:02.412480 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f7e13-ce20-415d-90f5-6ce05d9881d0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:02.412760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f7e13-ce20-415d-90f5-6ce05d9881d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:02.413033 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f7e13-ce20-415d-90f5-6ce05d9881d0 None admin] PATH_INFO: `/v3/users/27d32c408f3c492a9cbc34b3012b1102` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:02.414217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f7e13-ce20-415d-90f5-6ce05d9881d0 None admin] RBAC: Authorizing `identity:get_user(user_id=27d32c408f3c492a9cbc34b3012b1102)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:02.416379 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f7e13-ce20-415d-90f5-6ce05d9881d0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:02.418050 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 566/1121] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:31:02 2022] GET /identity/v3/users/27d32c408f3c492a9cbc34b3012b1102 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:02.424282 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d5ef5-26e3-486e-b025-9f79a2a40c85 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:02.520668 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d5ef5-26e3-486e-b025-9f79a2a40c85 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:02.554178 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98326c1e-065e-4c23-876f-9d30dae296db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:02.555037 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98326c1e-065e-4c23-876f-9d30dae296db None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:02.555320 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98326c1e-065e-4c23-876f-9d30dae296db None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:02.556313 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98326c1e-065e-4c23-876f-9d30dae296db None admin] PATH_INFO: `/v3/projects/9140d04e24ff4ba49053315baa587ba9` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:02.558509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98326c1e-065e-4c23-876f-9d30dae296db None admin] RBAC: Authorizing `identity:get_project(project_id=9140d04e24ff4ba49053315baa587ba9)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:02.558903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98326c1e-065e-4c23-876f-9d30dae296db None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:02.560612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 556/1122] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:31:02 2022] GET /identity/v3/projects/9140d04e24ff4ba49053315baa587ba9 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:02.567719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f7e13-ce20-415d-90f5-6ce05d9881d0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:02.671710 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f7e13-ce20-415d-90f5-6ce05d9881d0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:02.705166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50c804-6e4f-4282-b3ee-0a1c71208357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:02.706051 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50c804-6e4f-4282-b3ee-0a1c71208357 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:02.706331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50c804-6e4f-4282-b3ee-0a1c71208357 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:02.706605 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50c804-6e4f-4282-b3ee-0a1c71208357 None admin] PATH_INFO: `/v3/projects/9140d04e24ff4ba49053315baa587ba9/users/27d32c408f3c492a9cbc34b3012b1102/roles/8c1bc4243dcc46979dd8ca40186c0ca7` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:02.708821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50c804-6e4f-4282-b3ee-0a1c71208357 None admin] RBAC: Authorizing `identity:create_grant(project_id=9140d04e24ff4ba49053315baa587ba9, user_id=27d32c408f3c492a9cbc34b3012b1102, role_id=8c1bc4243dcc46979dd8ca40186c0ca7)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:02.710252 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50c804-6e4f-4282-b3ee-0a1c71208357 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:02.788868 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 567/1123] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:31:02 2022] PUT /identity/v3/projects/9140d04e24ff4ba49053315baa587ba9/users/27d32c408f3c492a9cbc34b3012b1102/roles/8c1bc4243dcc46979dd8ca40186c0ca7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:31:05.056003 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77757007-bc78-4aa5-b9b4-83627062e57f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:05.056566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77757007-bc78-4aa5-b9b4-83627062e57f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:05.056566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77757007-bc78-4aa5-b9b4-83627062e57f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:05.057935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 557/1124] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:31:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:31:05.063222 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f72191-f230-4372-b8da-3e2eb495e253 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:05.063619 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f72191-f230-4372-b8da-3e2eb495e253 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:05.063761 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f72191-f230-4372-b8da-3e2eb495e253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:05.080560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b0f72191-f230-4372-b8da-3e2eb495e253 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:31:05.081750 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b0f72191-f230-4372-b8da-3e2eb495e253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:31:05.143862 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 568/1125] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:31:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:31:05.166810 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77757007-bc78-4aa5-b9b4-83627062e57f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:05.264310 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77757007-bc78-4aa5-b9b4-83627062e57f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:05.296670 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71b362-894d-4b54-954d-530192cb1745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:05.297513 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71b362-894d-4b54-954d-530192cb1745 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:05.297798 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71b362-894d-4b54-954d-530192cb1745 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:05.298075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71b362-894d-4b54-954d-530192cb1745 None admin] PATH_INFO: `/v3/roles/8c1bc4243dcc46979dd8ca40186c0ca7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:05.299540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71b362-894d-4b54-954d-530192cb1745 None admin] RBAC: Authorizing `identity:get_role(role_id=8c1bc4243dcc46979dd8ca40186c0ca7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:05.300992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71b362-894d-4b54-954d-530192cb1745 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:05.302337 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 558/1126] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:31:05 2022] GET /identity/v3/roles/8c1bc4243dcc46979dd8ca40186c0ca7 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:05.308853 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f72191-f230-4372-b8da-3e2eb495e253 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:05.402999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f72191-f230-4372-b8da-3e2eb495e253 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:05.435547 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24f4e2-e2cf-454d-8f51-fedefe951b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:05.436393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24f4e2-e2cf-454d-8f51-fedefe951b06 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:05.436701 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24f4e2-e2cf-454d-8f51-fedefe951b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:05.436975 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24f4e2-e2cf-454d-8f51-fedefe951b06 None admin] PATH_INFO: `/v3/users/27d32c408f3c492a9cbc34b3012b1102` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:05.438136 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24f4e2-e2cf-454d-8f51-fedefe951b06 None admin] RBAC: Authorizing `identity:get_user(user_id=27d32c408f3c492a9cbc34b3012b1102)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:05.439539 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24f4e2-e2cf-454d-8f51-fedefe951b06 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:05.441174 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 569/1127] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:31:05 2022] GET /identity/v3/users/27d32c408f3c492a9cbc34b3012b1102 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:05.447064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71b362-894d-4b54-954d-530192cb1745 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:05.538974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71b362-894d-4b54-954d-530192cb1745 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:05.571591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baab693-0007-4485-8603-d41b75c9958c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:05.572159 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baab693-0007-4485-8603-d41b75c9958c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:05.572453 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baab693-0007-4485-8603-d41b75c9958c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:05.572744 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baab693-0007-4485-8603-d41b75c9958c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:05.635273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baab693-0007-4485-8603-d41b75c9958c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:05.636754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baab693-0007-4485-8603-d41b75c9958c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:05.729844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 559/1128] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:31:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 17:31:05.735751 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24f4e2-e2cf-454d-8f51-fedefe951b06 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:05.829116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24f4e2-e2cf-454d-8f51-fedefe951b06 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:05.861882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ed278-2843-42d3-9e3d-63169249e447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:05.862726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ed278-2843-42d3-9e3d-63169249e447 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:05.863001 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ed278-2843-42d3-9e3d-63169249e447 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:05.863272 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ed278-2843-42d3-9e3d-63169249e447 None admin] PATH_INFO: `/v3/projects/9140d04e24ff4ba49053315baa587ba9` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:05.864427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ed278-2843-42d3-9e3d-63169249e447 None admin] RBAC: Authorizing `identity:get_project(project_id=9140d04e24ff4ba49053315baa587ba9)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:05.865902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ed278-2843-42d3-9e3d-63169249e447 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:05.867580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 570/1129] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:31:05 2022] GET /identity/v3/projects/9140d04e24ff4ba49053315baa587ba9 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:05.874620 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baab693-0007-4485-8603-d41b75c9958c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:05.977745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baab693-0007-4485-8603-d41b75c9958c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:06.021447 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cf5e9-7adc-44ff-b1a6-03f79efe80c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:06.022322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cf5e9-7adc-44ff-b1a6-03f79efe80c5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:06.022604 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cf5e9-7adc-44ff-b1a6-03f79efe80c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:06.022878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cf5e9-7adc-44ff-b1a6-03f79efe80c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:06.023705 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cf5e9-7adc-44ff-b1a6-03f79efe80c5 None admin] RBAC: Adding query filter params (role.id=8c1bc4243dcc46979dd8ca40186c0ca7, scope.project.id=9140d04e24ff4ba49053315baa587ba9, user.id=27d32c408f3c492a9cbc34b3012b1102) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:31:06.024089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cf5e9-7adc-44ff-b1a6-03f79efe80c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:06.025690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cf5e9-7adc-44ff-b1a6-03f79efe80c5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:06.033730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 560/1130] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:31:05 2022] GET /identity/v3/role_assignments?user.id=27d32c408f3c492a9cbc34b3012b1102&scope.project.id=9140d04e24ff4ba49053315baa587ba9&role.id=8c1bc4243dcc46979dd8ca40186c0ca7 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:08.309615 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd47dd8-4bcb-4986-aac9-4e21710d94cf None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:08.310154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd47dd8-4bcb-4986-aac9-4e21710d94cf None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:08.310154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd47dd8-4bcb-4986-aac9-4e21710d94cf None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:08.311516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 571/1131] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:31:08.316732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86783cb1-fd6c-40b3-9a5b-33c122752387 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:08.317139 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86783cb1-fd6c-40b3-9a5b-33c122752387 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:08.317286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86783cb1-fd6c-40b3-9a5b-33c122752387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:08.334567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-86783cb1-fd6c-40b3-9a5b-33c122752387 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:31:08.335766 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-86783cb1-fd6c-40b3-9a5b-33c122752387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:31:08.406444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 561/1132] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:31:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:31:08.429630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd47dd8-4bcb-4986-aac9-4e21710d94cf None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:08.528639 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd47dd8-4bcb-4986-aac9-4e21710d94cf None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:08.561677 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383f38a-d94f-4cd4-bdde-abfc0a5b339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:08.562373 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383f38a-d94f-4cd4-bdde-abfc0a5b339a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:08.562647 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383f38a-d94f-4cd4-bdde-abfc0a5b339a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:08.562916 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383f38a-d94f-4cd4-bdde-abfc0a5b339a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:08.564065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383f38a-d94f-4cd4-bdde-abfc0a5b339a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:08.565593 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383f38a-d94f-4cd4-bdde-abfc0a5b339a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:08.567207 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 572/1133] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:31:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:31:08.573881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86783cb1-fd6c-40b3-9a5b-33c122752387 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:08.669419 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86783cb1-fd6c-40b3-9a5b-33c122752387 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:08.702936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a1b70-ef9a-41c4-8482-337e028f8a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:08.703620 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1b70-ef9a-41c4-8482-337e028f8a32 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:08.703905 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1b70-ef9a-41c4-8482-337e028f8a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:08.704182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1b70-ef9a-41c4-8482-337e028f8a32 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:08.704939 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a1b70-ef9a-41c4-8482-337e028f8a32 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:08.706456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a1b70-ef9a-41c4-8482-337e028f8a32 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:08.818742 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 562/1134] 10.222.0.81 () {60 vars in 1141 bytes} [Wed May 4 17:31:08 2022] POST /identity/v3/projects => generated 311 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:31:11.089656 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfb4b0-3a43-436c-b3d6-e3515eecec76 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:11.090251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfb4b0-3a43-436c-b3d6-e3515eecec76 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:11.090251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfb4b0-3a43-436c-b3d6-e3515eecec76 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:11.091571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 573/1135] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:31:11.096889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e15796-b991-4a01-b09e-6299d6cf6317 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:11.097365 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e15796-b991-4a01-b09e-6299d6cf6317 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:11.097463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e15796-b991-4a01-b09e-6299d6cf6317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:11.114778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-15e15796-b991-4a01-b09e-6299d6cf6317 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:31:11.115948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-15e15796-b991-4a01-b09e-6299d6cf6317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:31:11.178521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 563/1136] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:31:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:31:11.204777 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfb4b0-3a43-436c-b3d6-e3515eecec76 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:11.303002 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfb4b0-3a43-436c-b3d6-e3515eecec76 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:11.336326 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89eee59-91a3-4fb5-b260-1e51772bfd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:11.337304 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89eee59-91a3-4fb5-b260-1e51772bfd31 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:11.337589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89eee59-91a3-4fb5-b260-1e51772bfd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:11.337864 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89eee59-91a3-4fb5-b260-1e51772bfd31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:11.339039 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89eee59-91a3-4fb5-b260-1e51772bfd31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:11.340540 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89eee59-91a3-4fb5-b260-1e51772bfd31 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:11.342115 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 574/1137] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:31:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:11.347780 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e15796-b991-4a01-b09e-6299d6cf6317 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:11.441964 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e15796-b991-4a01-b09e-6299d6cf6317 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:11.473794 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ec5a9-1c45-474e-bcde-96b37d7bb9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:11.474465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ec5a9-1c45-474e-bcde-96b37d7bb9b6 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:11.474745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ec5a9-1c45-474e-bcde-96b37d7bb9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:11.475021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ec5a9-1c45-474e-bcde-96b37d7bb9b6 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:11.475753 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ec5a9-1c45-474e-bcde-96b37d7bb9b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:11.477830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ec5a9-1c45-474e-bcde-96b37d7bb9b6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:11.585017 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 564/1138] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:31:11 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:31:13.906867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf24dd-08b0-453b-910a-1ca190a9aebc None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:13.907422 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf24dd-08b0-453b-910a-1ca190a9aebc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:13.907422 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf24dd-08b0-453b-910a-1ca190a9aebc None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:13.908816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 575/1139] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:31:13.914358 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84050bb1-370c-4b07-815e-d64078afc3da None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:13.915153 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84050bb1-370c-4b07-815e-d64078afc3da None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:13.915331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84050bb1-370c-4b07-815e-d64078afc3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:13.931755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-84050bb1-370c-4b07-815e-d64078afc3da None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:31:13.932978 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-84050bb1-370c-4b07-815e-d64078afc3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:31:13.997973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 565/1140] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:31:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:31:14.021660 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf24dd-08b0-453b-910a-1ca190a9aebc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:14.122024 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf24dd-08b0-453b-910a-1ca190a9aebc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:14.155692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfc0e1-b5b3-4450-9305-5e15fd3c838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:14.156496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfc0e1-b5b3-4450-9305-5e15fd3c838b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:14.156776 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfc0e1-b5b3-4450-9305-5e15fd3c838b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:14.157093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfc0e1-b5b3-4450-9305-5e15fd3c838b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:14.167591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfc0e1-b5b3-4450-9305-5e15fd3c838b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:31:14.175158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-fbbfc0e1-b5b3-4450-9305-5e15fd3c838b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:31:14.175158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:31:14.175158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:31:14.175158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:31:14.175158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:31:14.175158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:31:14.175158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:31:14.175158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:31:14.175158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:31:14.175158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:31:14.175158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:31:14.175158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:31:14.175158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:31:14.175158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:31:14.175158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:31:14.175158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:31:14.176323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:31:14.176323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:31:14.176323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:31:14.176323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:31:14.176323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:31:14.176323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:31:14.176323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:31:14.176323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:31:14.176323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:31:14.176323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:31:14.176323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:31:14.176323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:31:14.176323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:31:14.176323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:31:14.176323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:31:14.176323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:31:14.177445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:31:14.177445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:31:14.177445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:31:14.177445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:31:14.177445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:31:14.177445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:31:14.177445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:31:14.177445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:31:14.177445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:31:14.177445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:31:14.177445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:31:14.177445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:31:14.177445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 576/1141] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:31:14.182632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84050bb1-370c-4b07-815e-d64078afc3da None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:14.278048 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84050bb1-370c-4b07-815e-d64078afc3da None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:14.310875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc61934-0f3e-4f1a-923b-b7618b5fbdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:14.311535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc61934-0f3e-4f1a-923b-b7618b5fbdc4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:14.311813 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc61934-0f3e-4f1a-923b-b7618b5fbdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:14.312084 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc61934-0f3e-4f1a-923b-b7618b5fbdc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:14.312857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc61934-0f3e-4f1a-923b-b7618b5fbdc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:31:14.313163 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc61934-0f3e-4f1a-923b-b7618b5fbdc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:14.314521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc61934-0f3e-4f1a-923b-b7618b5fbdc4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:14.323507 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 566/1142] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:31:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:14.329318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfc0e1-b5b3-4450-9305-5e15fd3c838b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:14.436698 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfc0e1-b5b3-4450-9305-5e15fd3c838b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:14.468989 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b8772-f682-4f26-9e77-0fecc104958a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:14.469858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b8772-f682-4f26-9e77-0fecc104958a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:14.470134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b8772-f682-4f26-9e77-0fecc104958a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:14.470407 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b8772-f682-4f26-9e77-0fecc104958a None admin] PATH_INFO: `/v3/users/21b0704c9ecf4db38771957b90d4fa20` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:14.484929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b8772-f682-4f26-9e77-0fecc104958a None admin] RBAC: Authorizing `identity:get_user(user_id=21b0704c9ecf4db38771957b90d4fa20)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:14.486383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b8772-f682-4f26-9e77-0fecc104958a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:14.488094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 577/1143] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:31:14 2022] GET /identity/v3/users/21b0704c9ecf4db38771957b90d4fa20 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:14.494709 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc61934-0f3e-4f1a-923b-b7618b5fbdc4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:14.600377 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc61934-0f3e-4f1a-923b-b7618b5fbdc4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:14.635022 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b009b98-4e95-4015-bd42-449a60ee2cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:14.635667 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b009b98-4e95-4015-bd42-449a60ee2cdc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:14.635952 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b009b98-4e95-4015-bd42-449a60ee2cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:14.636234 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b009b98-4e95-4015-bd42-449a60ee2cdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:14.701633 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b009b98-4e95-4015-bd42-449a60ee2cdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:14.703005 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b009b98-4e95-4015-bd42-449a60ee2cdc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:14.815875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 567/1144] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:31:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:31:14.822231 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b8772-f682-4f26-9e77-0fecc104958a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:14.924337 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b8772-f682-4f26-9e77-0fecc104958a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:14.957797 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033eadb9-a98e-4713-826e-e3f3f2daf369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:14.958566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033eadb9-a98e-4713-826e-e3f3f2daf369 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:14.958844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033eadb9-a98e-4713-826e-e3f3f2daf369 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:14.959116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033eadb9-a98e-4713-826e-e3f3f2daf369 None admin] PATH_INFO: `/v3/projects/7a74af1c55d44cc8b72abb7b4828fbef` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:14.960293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033eadb9-a98e-4713-826e-e3f3f2daf369 None admin] RBAC: Authorizing `identity:get_project(project_id=7a74af1c55d44cc8b72abb7b4828fbef)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:14.962303 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033eadb9-a98e-4713-826e-e3f3f2daf369 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:14.964025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 578/1145] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:31:14 2022] GET /identity/v3/projects/7a74af1c55d44cc8b72abb7b4828fbef => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:14.970447 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b009b98-4e95-4015-bd42-449a60ee2cdc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:15.066881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b009b98-4e95-4015-bd42-449a60ee2cdc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:15.105784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6d23f-01fb-4ff9-9bf3-f1ebf24a8f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:15.106429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6d23f-01fb-4ff9-9bf3-f1ebf24a8f14 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:15.106707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6d23f-01fb-4ff9-9bf3-f1ebf24a8f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:15.106975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6d23f-01fb-4ff9-9bf3-f1ebf24a8f14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:15.107806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6d23f-01fb-4ff9-9bf3-f1ebf24a8f14 None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=7a74af1c55d44cc8b72abb7b4828fbef, user.id=21b0704c9ecf4db38771957b90d4fa20) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:31:15.108114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6d23f-01fb-4ff9-9bf3-f1ebf24a8f14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:15.109648 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6d23f-01fb-4ff9-9bf3-f1ebf24a8f14 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:15.115532 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 568/1146] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:31:14 2022] GET /identity/v3/role_assignments?user.id=21b0704c9ecf4db38771957b90d4fa20&scope.project.id=7a74af1c55d44cc8b72abb7b4828fbef&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:17.381445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606e472-d432-42c6-af89-bc79d89c1456 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:17.382031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606e472-d432-42c6-af89-bc79d89c1456 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:17.382031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606e472-d432-42c6-af89-bc79d89c1456 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:17.383483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 579/1147] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:31:17.389049 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c6a1c-cd96-4fb1-8be5-907be7d5b6b8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:17.389444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c6a1c-cd96-4fb1-8be5-907be7d5b6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:17.389623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c6a1c-cd96-4fb1-8be5-907be7d5b6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:17.405938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2e9c6a1c-cd96-4fb1-8be5-907be7d5b6b8 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:31:17.407166 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2e9c6a1c-cd96-4fb1-8be5-907be7d5b6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:31:17.472290 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 569/1148] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:31:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:31:17.495850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606e472-d432-42c6-af89-bc79d89c1456 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:17.599712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606e472-d432-42c6-af89-bc79d89c1456 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:17.633666 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d95835-d7f7-4e63-8a15-d4153eed6f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:17.634454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d95835-d7f7-4e63-8a15-d4153eed6f70 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:17.634731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d95835-d7f7-4e63-8a15-d4153eed6f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:17.635121 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d95835-d7f7-4e63-8a15-d4153eed6f70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:17.644880 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d95835-d7f7-4e63-8a15-d4153eed6f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:31:17.652421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-29d95835-d7f7-4e63-8a15-d4153eed6f70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:31:17.652421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:31:17.652421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:31:17.652421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:31:17.652421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:31:17.652421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:31:17.652421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:31:17.652421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:31:17.652421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:31:17.652421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:31:17.652421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:31:17.652421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:31:17.652421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:31:17.652421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:31:17.652421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:31:17.652421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:31:17.654114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:31:17.654114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:31:17.654114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:31:17.654114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:31:17.654114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:31:17.654114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:31:17.654114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:31:17.654114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:31:17.654114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:31:17.654114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:31:17.654114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:31:17.654114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:31:17.654114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:31:17.654114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:31:17.654114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:31:17.654114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:31:17.655170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:31:17.655170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:31:17.655170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:31:17.655170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:31:17.655170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:31:17.655170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:31:17.655170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:31:17.655170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:31:17.655170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:31:17.655170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:31:17.655170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:31:17.655170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:31:17.655170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 580/1149] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:31:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:31:17.661012 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c6a1c-cd96-4fb1-8be5-907be7d5b6b8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:17.757329 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c6a1c-cd96-4fb1-8be5-907be7d5b6b8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:17.791497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0b460-b8a7-429c-9416-0bbf2a981e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:17.792166 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0b460-b8a7-429c-9416-0bbf2a981e53 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:17.792473 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0b460-b8a7-429c-9416-0bbf2a981e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:17.792754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0b460-b8a7-429c-9416-0bbf2a981e53 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:17.793528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0b460-b8a7-429c-9416-0bbf2a981e53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:31:17.794090 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0b460-b8a7-429c-9416-0bbf2a981e53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:17.795571 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0b460-b8a7-429c-9416-0bbf2a981e53 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:17.803863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 570/1150] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:31:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:17.811433 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d95835-d7f7-4e63-8a15-d4153eed6f70 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:17.910617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d95835-d7f7-4e63-8a15-d4153eed6f70 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:17.944969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74d8d2-1914-44b4-94f4-64526cebdfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:17.946778 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74d8d2-1914-44b4-94f4-64526cebdfc4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:17.947048 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74d8d2-1914-44b4-94f4-64526cebdfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:17.947315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74d8d2-1914-44b4-94f4-64526cebdfc4 None admin] PATH_INFO: `/v3/users/21b0704c9ecf4db38771957b90d4fa20` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:17.948509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74d8d2-1914-44b4-94f4-64526cebdfc4 None admin] RBAC: Authorizing `identity:get_user(user_id=21b0704c9ecf4db38771957b90d4fa20)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:17.949930 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74d8d2-1914-44b4-94f4-64526cebdfc4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:17.951535 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 581/1151] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:31:17 2022] GET /identity/v3/users/21b0704c9ecf4db38771957b90d4fa20 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:17.957456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0b460-b8a7-429c-9416-0bbf2a981e53 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:18.053683 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0b460-b8a7-429c-9416-0bbf2a981e53 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:18.097791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a0548-c474-4160-8f41-68f4ecab2204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:18.098676 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a0548-c474-4160-8f41-68f4ecab2204 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:18.098956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a0548-c474-4160-8f41-68f4ecab2204 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:18.099231 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a0548-c474-4160-8f41-68f4ecab2204 None admin] PATH_INFO: `/v3/projects/7a74af1c55d44cc8b72abb7b4828fbef` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:18.100418 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a0548-c474-4160-8f41-68f4ecab2204 None admin] RBAC: Authorizing `identity:get_project(project_id=7a74af1c55d44cc8b72abb7b4828fbef)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:18.103156 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a0548-c474-4160-8f41-68f4ecab2204 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:18.104871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 571/1152] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:31:17 2022] GET /identity/v3/projects/7a74af1c55d44cc8b72abb7b4828fbef => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:18.110979 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74d8d2-1914-44b4-94f4-64526cebdfc4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:18.210015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74d8d2-1914-44b4-94f4-64526cebdfc4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:18.243602 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66cea9-bdb2-4711-8039-a379ac22bb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:18.244502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66cea9-bdb2-4711-8039-a379ac22bb43 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:18.244783 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66cea9-bdb2-4711-8039-a379ac22bb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:18.245053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66cea9-bdb2-4711-8039-a379ac22bb43 None admin] PATH_INFO: `/v3/projects/7a74af1c55d44cc8b72abb7b4828fbef/users/21b0704c9ecf4db38771957b90d4fa20/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:18.247000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66cea9-bdb2-4711-8039-a379ac22bb43 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a74af1c55d44cc8b72abb7b4828fbef, user_id=21b0704c9ecf4db38771957b90d4fa20, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:18.248714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66cea9-bdb2-4711-8039-a379ac22bb43 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:18.345212 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 582/1153] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:31:18 2022] PUT /identity/v3/projects/7a74af1c55d44cc8b72abb7b4828fbef/users/21b0704c9ecf4db38771957b90d4fa20/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:31:20.616808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305d8f6-35cd-406f-af4d-df5fca05f537 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:20.617603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305d8f6-35cd-406f-af4d-df5fca05f537 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:20.617603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305d8f6-35cd-406f-af4d-df5fca05f537 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:20.618712 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 572/1154] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:31:20.624057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c857458-134b-484d-9695-8c0e99242b13 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:20.624983 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c857458-134b-484d-9695-8c0e99242b13 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:20.624983 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c857458-134b-484d-9695-8c0e99242b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:20.641562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2c857458-134b-484d-9695-8c0e99242b13 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:31:20.642744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2c857458-134b-484d-9695-8c0e99242b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:31:20.707380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 583/1155] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:31:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:31:20.731882 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305d8f6-35cd-406f-af4d-df5fca05f537 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:20.839414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305d8f6-35cd-406f-af4d-df5fca05f537 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:20.872585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d7afc-c947-40c4-99d8-f756d9f7e6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:20.873738 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d7afc-c947-40c4-99d8-f756d9f7e6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:20.874093 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d7afc-c947-40c4-99d8-f756d9f7e6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:20.874093 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d7afc-c947-40c4-99d8-f756d9f7e6b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:20.885731 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d7afc-c947-40c4-99d8-f756d9f7e6b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:31:20.893468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b45d7afc-c947-40c4-99d8-f756d9f7e6b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:31:20.893468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:31:20.893468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:31:20.893468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:31:20.893468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:31:20.893468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:31:20.893468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:31:20.893468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:31:20.893468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:31:20.893468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:31:20.893468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:31:20.893468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:31:20.893468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:31:20.893468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:31:20.893468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:31:20.893468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:31:20.894610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:31:20.894610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:31:20.894610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:31:20.894610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:31:20.894610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:31:20.894610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:31:20.894610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:31:20.894610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:31:20.894610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:31:20.894610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:31:20.894610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:31:20.894610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:31:20.894610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:31:20.894610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:31:20.894610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:31:20.894610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:31:20.900807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:31:20.900807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:31:20.900807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:31:20.900807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:31:20.900807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:31:20.900807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:31:20.900807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:31:20.900807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:31:20.900807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:31:20.900807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:31:20.900807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:31:20.900807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:31:20.900807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 573/1156] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:31:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:31:20.901814 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c857458-134b-484d-9695-8c0e99242b13 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:20.998231 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c857458-134b-484d-9695-8c0e99242b13 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:21.031688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8aee51-065f-48aa-a974-f34a914b4acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:21.032355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aee51-065f-48aa-a974-f34a914b4acc None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:21.032662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aee51-065f-48aa-a974-f34a914b4acc None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:21.032938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aee51-065f-48aa-a974-f34a914b4acc None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:21.033686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8aee51-065f-48aa-a974-f34a914b4acc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:31:21.033994 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8aee51-065f-48aa-a974-f34a914b4acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:21.035360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8aee51-065f-48aa-a974-f34a914b4acc None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:21.044129 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 584/1157] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:31:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:21.050047 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d7afc-c947-40c4-99d8-f756d9f7e6b5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:21.151276 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d7afc-c947-40c4-99d8-f756d9f7e6b5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:21.182775 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2df26f-a2df-4077-8ecd-89c65c606143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:21.183634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2df26f-a2df-4077-8ecd-89c65c606143 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:21.183915 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2df26f-a2df-4077-8ecd-89c65c606143 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:21.184186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2df26f-a2df-4077-8ecd-89c65c606143 None admin] PATH_INFO: `/v3/users/21b0704c9ecf4db38771957b90d4fa20` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:21.185389 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2df26f-a2df-4077-8ecd-89c65c606143 None admin] RBAC: Authorizing `identity:get_user(user_id=21b0704c9ecf4db38771957b90d4fa20)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:21.186810 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2df26f-a2df-4077-8ecd-89c65c606143 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:21.188434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 574/1158] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:31:21 2022] GET /identity/v3/users/21b0704c9ecf4db38771957b90d4fa20 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:21.194237 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8aee51-065f-48aa-a974-f34a914b4acc None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:21.292172 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8aee51-065f-48aa-a974-f34a914b4acc None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:21.324038 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9217db5-1823-40da-a7f8-2ed45a9248e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:21.324704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9217db5-1823-40da-a7f8-2ed45a9248e6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:21.324985 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9217db5-1823-40da-a7f8-2ed45a9248e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:21.325259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9217db5-1823-40da-a7f8-2ed45a9248e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:21.393827 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9217db5-1823-40da-a7f8-2ed45a9248e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:21.395284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9217db5-1823-40da-a7f8-2ed45a9248e6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:21.489487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 585/1159] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:31:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:31:21.496138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2df26f-a2df-4077-8ecd-89c65c606143 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:21.593410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2df26f-a2df-4077-8ecd-89c65c606143 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:21.625966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321167f6-c321-4500-9032-8ed053a7a67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:21.626818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321167f6-c321-4500-9032-8ed053a7a67d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:21.627128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321167f6-c321-4500-9032-8ed053a7a67d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:21.627403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321167f6-c321-4500-9032-8ed053a7a67d None admin] PATH_INFO: `/v3/projects/7a74af1c55d44cc8b72abb7b4828fbef` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:21.628617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321167f6-c321-4500-9032-8ed053a7a67d None admin] RBAC: Authorizing `identity:get_project(project_id=7a74af1c55d44cc8b72abb7b4828fbef)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:21.630045 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321167f6-c321-4500-9032-8ed053a7a67d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:21.631715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 575/1160] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:31:21 2022] GET /identity/v3/projects/7a74af1c55d44cc8b72abb7b4828fbef => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:21.638073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9217db5-1823-40da-a7f8-2ed45a9248e6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:21.734358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9217db5-1823-40da-a7f8-2ed45a9248e6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:21.768158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c1e4d-0d18-47e6-8e49-ffdccfecafc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:21.768763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c1e4d-0d18-47e6-8e49-ffdccfecafc6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:21.769038 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c1e4d-0d18-47e6-8e49-ffdccfecafc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:21.769311 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c1e4d-0d18-47e6-8e49-ffdccfecafc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:21.770132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c1e4d-0d18-47e6-8e49-ffdccfecafc6 None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=7a74af1c55d44cc8b72abb7b4828fbef, user.id=21b0704c9ecf4db38771957b90d4fa20) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:31:21.770438 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c1e4d-0d18-47e6-8e49-ffdccfecafc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:21.771860 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c1e4d-0d18-47e6-8e49-ffdccfecafc6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:21.778261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 586/1161] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:31:21 2022] GET /identity/v3/role_assignments?user.id=21b0704c9ecf4db38771957b90d4fa20&scope.project.id=7a74af1c55d44cc8b72abb7b4828fbef&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:24.053394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6050178-9d97-4647-b15c-1208e7d47361 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:24.053966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6050178-9d97-4647-b15c-1208e7d47361 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:24.053966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6050178-9d97-4647-b15c-1208e7d47361 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:24.055812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 576/1162] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:31:24.060926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fae6d-8c5d-4bac-b0dd-af40f5b43831 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:24.061325 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fae6d-8c5d-4bac-b0dd-af40f5b43831 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:24.061471 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fae6d-8c5d-4bac-b0dd-af40f5b43831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:24.078306 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ad5fae6d-8c5d-4bac-b0dd-af40f5b43831 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:31:24.079480 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ad5fae6d-8c5d-4bac-b0dd-af40f5b43831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:31:24.143723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 587/1163] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:31:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:31:24.165829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6050178-9d97-4647-b15c-1208e7d47361 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:24.274970 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6050178-9d97-4647-b15c-1208e7d47361 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:24.308653 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e927dea-b3d7-40bd-b431-0a4a64bdb649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:24.309219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e927dea-b3d7-40bd-b431-0a4a64bdb649 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:24.309498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e927dea-b3d7-40bd-b431-0a4a64bdb649 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:24.309769 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e927dea-b3d7-40bd-b431-0a4a64bdb649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:24.374901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e927dea-b3d7-40bd-b431-0a4a64bdb649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:24.376335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e927dea-b3d7-40bd-b431-0a4a64bdb649 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:24.469030 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 577/1164] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:31:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:31:24.475039 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fae6d-8c5d-4bac-b0dd-af40f5b43831 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:24.570405 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fae6d-8c5d-4bac-b0dd-af40f5b43831 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:24.605431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c3d6a-b1d1-4563-a7a9-bccc2cbb480d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:24.606233 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c3d6a-b1d1-4563-a7a9-bccc2cbb480d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:24.606508 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c3d6a-b1d1-4563-a7a9-bccc2cbb480d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:24.606778 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c3d6a-b1d1-4563-a7a9-bccc2cbb480d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:24.613418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c3d6a-b1d1-4563-a7a9-bccc2cbb480d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:24.614852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c3d6a-b1d1-4563-a7a9-bccc2cbb480d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-572c3d6a-b1d1-4563-a7a9-bccc2cbb480d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:31:24.628743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:31:24.629971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:31:24.629971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:31:24.629971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:31:24.629971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:31:24.629971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:31:24.629971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:31:24.629971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:31:24.629971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:31:24.629971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:31:24.629971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:31:24.629971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:31:24.629971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:31:24.629971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:31:24.629971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:31:24.629971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:31:24.629971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:31:24.630995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:31:24.630995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:31:24.630995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:31:24.630995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:31:24.630995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:31:24.630995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:31:24.630995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:31:24.630995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:31:24.630995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:31:24.630995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:31:24.630995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 04 17:31:24.630995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:31:24.630995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 17:31:24.630995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:31:24.630995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 588/1165] 10.222.0.81 () {56 vars in 1117 bytes} [Wed May 4 17:31:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:31:24.636021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e927dea-b3d7-40bd-b431-0a4a64bdb649 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:24.735804 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e927dea-b3d7-40bd-b431-0a4a64bdb649 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:24.768669 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c1e44-7738-48fa-bba7-bf7328299468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:24.769323 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c1e44-7738-48fa-bba7-bf7328299468 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:24.769602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c1e44-7738-48fa-bba7-bf7328299468 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:24.769874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c1e44-7738-48fa-bba7-bf7328299468 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:24.770584 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c1e44-7738-48fa-bba7-bf7328299468 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:31:24.770886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c1e44-7738-48fa-bba7-bf7328299468 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:24.772237 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c1e44-7738-48fa-bba7-bf7328299468 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:24.780164 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 578/1166] 10.222.0.81 () {56 vars in 1115 bytes} [Wed May 4 17:31:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:27.044947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d774e7-1da8-4ea7-9675-7f5eaecabf06 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:27.045512 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d774e7-1da8-4ea7-9675-7f5eaecabf06 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:27.045512 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d774e7-1da8-4ea7-9675-7f5eaecabf06 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:27.046853 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 589/1167] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:31:27.051962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddb0e9-1030-4295-b7a8-6cf276230c4f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:27.052381 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddb0e9-1030-4295-b7a8-6cf276230c4f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:27.052619 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddb0e9-1030-4295-b7a8-6cf276230c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:27.070040 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-acddb0e9-1030-4295-b7a8-6cf276230c4f None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:31:27.071822 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-acddb0e9-1030-4295-b7a8-6cf276230c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:31:27.135051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 579/1168] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:31:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:31:27.157884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d774e7-1da8-4ea7-9675-7f5eaecabf06 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:27.256023 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d774e7-1da8-4ea7-9675-7f5eaecabf06 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:27.288582 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2042d38-fb58-430e-8a85-3192a95d0f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:27.289268 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2042d38-fb58-430e-8a85-3192a95d0f57 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:27.289543 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2042d38-fb58-430e-8a85-3192a95d0f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:27.289812 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2042d38-fb58-430e-8a85-3192a95d0f57 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:27.290545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2042d38-fb58-430e-8a85-3192a95d0f57 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:27.291907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2042d38-fb58-430e-8a85-3192a95d0f57 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:27.363204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 590/1169] 10.222.0.81 () {60 vars in 1138 bytes} [Wed May 4 17:31:27 2022] POST /identity/v3/domains => generated 267 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:31:29.634695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b684d-776a-46f2-a47f-785d12ed5ea8 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:29.635213 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b684d-776a-46f2-a47f-785d12ed5ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:29.635213 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b684d-776a-46f2-a47f-785d12ed5ea8 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:29.636526 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 580/1170] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:31:29.641773 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5721b1-b963-49a2-afd4-edf67b163358 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:29.642177 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5721b1-b963-49a2-afd4-edf67b163358 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:29.642334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5721b1-b963-49a2-afd4-edf67b163358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:29.659422 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ab5721b1-b963-49a2-afd4-edf67b163358 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:31:29.660650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ab5721b1-b963-49a2-afd4-edf67b163358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:31:29.724867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 591/1171] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:31:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:31:29.749256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b684d-776a-46f2-a47f-785d12ed5ea8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:29.845389 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b684d-776a-46f2-a47f-785d12ed5ea8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:29.878637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e13dc-7981-47fd-bff6-7a3b6689fffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:29.879487 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e13dc-7981-47fd-bff6-7a3b6689fffa None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:29.879768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e13dc-7981-47fd-bff6-7a3b6689fffa None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:29.880041 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e13dc-7981-47fd-bff6-7a3b6689fffa None admin] PATH_INFO: `/v3/domains/97e293460d77481cbd08c75baf8fa6a3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:29.890172 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e13dc-7981-47fd-bff6-7a3b6689fffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=97e293460d77481cbd08c75baf8fa6a3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:29.891553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e13dc-7981-47fd-bff6-7a3b6689fffa None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:29.893212 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 581/1172] 10.222.0.81 () {56 vars in 1183 bytes} [Wed May 4 17:31:29 2022] GET /identity/v3/domains/97e293460d77481cbd08c75baf8fa6a3 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:31:29.899535 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5721b1-b963-49a2-afd4-edf67b163358 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:29.994460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5721b1-b963-49a2-afd4-edf67b163358 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:30.028717 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24763db1-8f93-48c2-9ec6-2a091df81d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:30.029363 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24763db1-8f93-48c2-9ec6-2a091df81d9f None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:30.029644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24763db1-8f93-48c2-9ec6-2a091df81d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:30.029920 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24763db1-8f93-48c2-9ec6-2a091df81d9f None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:30.030666 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24763db1-8f93-48c2-9ec6-2a091df81d9f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:30.032100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24763db1-8f93-48c2-9ec6-2a091df81d9f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:30.117433 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 592/1173] 10.222.0.81 () {60 vars in 1141 bytes} [Wed May 4 17:31:29 2022] POST /identity/v3/projects => generated 361 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:31:32.508467 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b4faf-068b-4a44-a8b9-9e7bb3f4ca18 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:32.509163 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b4faf-068b-4a44-a8b9-9e7bb3f4ca18 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:32.509163 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b4faf-068b-4a44-a8b9-9e7bb3f4ca18 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:32.510446 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 582/1174] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:31:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:31:32.516636 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3bdc0-7a11-4636-a244-8063c3138857 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:32.517094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3bdc0-7a11-4636-a244-8063c3138857 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:32.517196 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3bdc0-7a11-4636-a244-8063c3138857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:32.540757 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-79f3bdc0-7a11-4636-a244-8063c3138857 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:31:32.541949 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-79f3bdc0-7a11-4636-a244-8063c3138857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:31:32.612188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 593/1175] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:31:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:31:32.638922 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b4faf-068b-4a44-a8b9-9e7bb3f4ca18 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:32.741070 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b4faf-068b-4a44-a8b9-9e7bb3f4ca18 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:32.775549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41be0b6-facf-4a16-b75a-c47ef85caea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:32.776403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41be0b6-facf-4a16-b75a-c47ef85caea7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:32.776716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41be0b6-facf-4a16-b75a-c47ef85caea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:32.776991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41be0b6-facf-4a16-b75a-c47ef85caea7 None admin] PATH_INFO: `/v3/domains/97e293460d77481cbd08c75baf8fa6a3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:32.778187 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41be0b6-facf-4a16-b75a-c47ef85caea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=97e293460d77481cbd08c75baf8fa6a3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:32.779619 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41be0b6-facf-4a16-b75a-c47ef85caea7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:32.781266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 583/1176] 10.222.0.81 () {56 vars in 1183 bytes} [Wed May 4 17:31:32 2022] GET /identity/v3/domains/97e293460d77481cbd08c75baf8fa6a3 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:32.787070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3bdc0-7a11-4636-a244-8063c3138857 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:32.888072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3bdc0-7a11-4636-a244-8063c3138857 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:32.926233 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8517778-d183-4b84-8fa1-f5f762c908b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:32.926907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8517778-d183-4b84-8fa1-f5f762c908b9 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:32.927187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8517778-d183-4b84-8fa1-f5f762c908b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:32.927460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8517778-d183-4b84-8fa1-f5f762c908b9 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:32.928185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8517778-d183-4b84-8fa1-f5f762c908b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:32.929705 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8517778-d183-4b84-8fa1-f5f762c908b9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:33.043181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 594/1177] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:31:32 2022] POST /identity/v3/users => generated 311 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:31:35.381347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda02a14-bd3e-4721-b752-f51b7804a726 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:35.381903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda02a14-bd3e-4721-b752-f51b7804a726 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:35.381903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda02a14-bd3e-4721-b752-f51b7804a726 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:35.383291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 584/1178] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:31:35.388708 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668760d-afb8-477a-a8bc-454a2369d176 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:35.389187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668760d-afb8-477a-a8bc-454a2369d176 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:35.389283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668760d-afb8-477a-a8bc-454a2369d176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:35.405926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f668760d-afb8-477a-a8bc-454a2369d176 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:31:35.407127 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f668760d-afb8-477a-a8bc-454a2369d176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:31:35.473201 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 595/1179] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:31:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:31:35.501165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda02a14-bd3e-4721-b752-f51b7804a726 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:35.629858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda02a14-bd3e-4721-b752-f51b7804a726 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:35.668457 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e423d7-47ad-4000-bf6b-f1e0e83fa978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:35.669276 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e423d7-47ad-4000-bf6b-f1e0e83fa978 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:35.669562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e423d7-47ad-4000-bf6b-f1e0e83fa978 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:35.669836 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e423d7-47ad-4000-bf6b-f1e0e83fa978 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:35.679669 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e423d7-47ad-4000-bf6b-f1e0e83fa978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:31:35.687266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-68e423d7-47ad-4000-bf6b-f1e0e83fa978 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:31:35.687266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:31:35.687266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:31:35.687266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:31:35.687266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:31:35.687266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:31:35.687266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:31:35.687266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:31:35.687266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:31:35.687266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:31:35.687266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:31:35.687266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:31:35.687266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:31:35.687266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:31:35.687266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:31:35.687266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:31:35.688363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:31:35.688363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:31:35.688363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:31:35.688363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:31:35.688363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:31:35.688363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:31:35.688363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:31:35.688363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:31:35.688363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:31:35.688363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:31:35.688363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:31:35.688363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:31:35.688363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:31:35.688363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:31:35.688363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:31:35.688363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:31:35.689616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:31:35.689616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:31:35.689616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:31:35.689616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:31:35.689616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:31:35.689616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:31:35.689616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:31:35.689616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:31:35.689616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:31:35.689616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:31:35.689616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:31:35.689616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:31:35.689616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 585/1180] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:31:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:31:35.694632 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668760d-afb8-477a-a8bc-454a2369d176 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:35.792996 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668760d-afb8-477a-a8bc-454a2369d176 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:35.827448 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea858b-6421-4773-a558-b1ccfc5faa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:35.828105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea858b-6421-4773-a558-b1ccfc5faa45 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:35.828383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea858b-6421-4773-a558-b1ccfc5faa45 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:35.828683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea858b-6421-4773-a558-b1ccfc5faa45 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:35.829435 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea858b-6421-4773-a558-b1ccfc5faa45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:31:35.829731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea858b-6421-4773-a558-b1ccfc5faa45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:35.831110 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea858b-6421-4773-a558-b1ccfc5faa45 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:35.839287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 596/1181] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:31:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:35.845201 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e423d7-47ad-4000-bf6b-f1e0e83fa978 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:35.955649 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e423d7-47ad-4000-bf6b-f1e0e83fa978 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:35.988836 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fa361-e6f4-498a-b7f7-6cff41d79fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:35.989707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fa361-e6f4-498a-b7f7-6cff41d79fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:35.989991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fa361-e6f4-498a-b7f7-6cff41d79fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:35.990267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fa361-e6f4-498a-b7f7-6cff41d79fe4 None admin] PATH_INFO: `/v3/users/76f955ebb8264177a0ee99f53be9ddb4` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:36.003513 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fa361-e6f4-498a-b7f7-6cff41d79fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=76f955ebb8264177a0ee99f53be9ddb4)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:36.004988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fa361-e6f4-498a-b7f7-6cff41d79fe4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:36.006667 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 586/1182] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:31:35 2022] GET /identity/v3/users/76f955ebb8264177a0ee99f53be9ddb4 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:36.012711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea858b-6421-4773-a558-b1ccfc5faa45 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:36.110912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea858b-6421-4773-a558-b1ccfc5faa45 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:36.144792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf5352-8999-47d1-a14e-61585979ea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:36.145436 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf5352-8999-47d1-a14e-61585979ea4d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:36.145718 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf5352-8999-47d1-a14e-61585979ea4d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:36.145992 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf5352-8999-47d1-a14e-61585979ea4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:36.214083 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf5352-8999-47d1-a14e-61585979ea4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:36.215502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf5352-8999-47d1-a14e-61585979ea4d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:36.314096 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 597/1183] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:31:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:31:36.320534 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fa361-e6f4-498a-b7f7-6cff41d79fe4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:36.420780 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fa361-e6f4-498a-b7f7-6cff41d79fe4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:36.454881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece633f-d141-4772-80dc-2126a6ddf1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:36.455739 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece633f-d141-4772-80dc-2126a6ddf1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:36.456024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece633f-d141-4772-80dc-2126a6ddf1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:36.456303 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece633f-d141-4772-80dc-2126a6ddf1a6 None admin] PATH_INFO: `/v3/projects/defdfebc3eb646108a7f94a53ffa574b` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:36.457576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece633f-d141-4772-80dc-2126a6ddf1a6 None admin] RBAC: Authorizing `identity:get_project(project_id=defdfebc3eb646108a7f94a53ffa574b)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:36.458994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece633f-d141-4772-80dc-2126a6ddf1a6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:36.461307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 587/1184] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:31:36 2022] GET /identity/v3/projects/defdfebc3eb646108a7f94a53ffa574b => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:31:36.467561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf5352-8999-47d1-a14e-61585979ea4d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:36.565918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf5352-8999-47d1-a14e-61585979ea4d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:36.599387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3988659-8909-4801-8f90-a3dad60d68b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:36.600041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3988659-8909-4801-8f90-a3dad60d68b9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:36.600314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3988659-8909-4801-8f90-a3dad60d68b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:36.600617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3988659-8909-4801-8f90-a3dad60d68b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:36.601479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3988659-8909-4801-8f90-a3dad60d68b9 None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=defdfebc3eb646108a7f94a53ffa574b, user.id=76f955ebb8264177a0ee99f53be9ddb4) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:31:36.601943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3988659-8909-4801-8f90-a3dad60d68b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:36.603416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3988659-8909-4801-8f90-a3dad60d68b9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:36.609087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 598/1185] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:31:36 2022] GET /identity/v3/role_assignments?user.id=76f955ebb8264177a0ee99f53be9ddb4&scope.project.id=defdfebc3eb646108a7f94a53ffa574b&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:38.900477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4c441-8e8f-4992-af31-6e107532d456 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:38.901201 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4c441-8e8f-4992-af31-6e107532d456 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:38.901201 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4c441-8e8f-4992-af31-6e107532d456 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:38.902680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 588/1186] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:31:38.908199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3644a-bcfd-4767-9af0-15579c700ee8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:38.908731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3644a-bcfd-4767-9af0-15579c700ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:38.908833 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3644a-bcfd-4767-9af0-15579c700ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:38.928535 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-edb3644a-bcfd-4767-9af0-15579c700ee8 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:31:38.930754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-edb3644a-bcfd-4767-9af0-15579c700ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:31:39.002731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 599/1187] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:31:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:31:39.027249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4c441-8e8f-4992-af31-6e107532d456 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:39.136691 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4c441-8e8f-4992-af31-6e107532d456 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:39.171785 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b048ef-02c5-4979-b79a-9cdae3551f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:39.172612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b048ef-02c5-4979-b79a-9cdae3551f5e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:39.172891 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b048ef-02c5-4979-b79a-9cdae3551f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:39.173165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b048ef-02c5-4979-b79a-9cdae3551f5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:39.183618 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b048ef-02c5-4979-b79a-9cdae3551f5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:31:39.191393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-02b048ef-02c5-4979-b79a-9cdae3551f5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:31:39.191393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:31:39.191393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:31:39.191393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:31:39.191393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:31:39.191393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:31:39.191393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:31:39.191393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:31:39.191393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:31:39.191393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:31:39.191393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:31:39.191393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:31:39.191393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:31:39.191393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:31:39.191393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:31:39.191393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:31:39.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:31:39.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:31:39.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:31:39.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:31:39.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:31:39.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:31:39.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:31:39.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:31:39.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:31:39.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:31:39.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:31:39.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:31:39.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:31:39.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:31:39.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:31:39.192570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:31:39.193566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:31:39.193566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:31:39.193566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:31:39.193566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:31:39.193566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:31:39.193566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:31:39.193566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:31:39.193566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:31:39.193566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:31:39.193566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:31:39.193566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:31:39.193566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:31:39.193566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 589/1188] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:31:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:31:39.203747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3644a-bcfd-4767-9af0-15579c700ee8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:39.321641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3644a-bcfd-4767-9af0-15579c700ee8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:39.356224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b9141-9328-4bc3-8fc6-920a1267eb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:39.356923 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b9141-9328-4bc3-8fc6-920a1267eb24 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:39.357200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b9141-9328-4bc3-8fc6-920a1267eb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:39.357468 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b9141-9328-4bc3-8fc6-920a1267eb24 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:39.358202 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b9141-9328-4bc3-8fc6-920a1267eb24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:31:39.358501 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b9141-9328-4bc3-8fc6-920a1267eb24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:39.359849 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b9141-9328-4bc3-8fc6-920a1267eb24 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:39.368100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 600/1189] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:31:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:39.374408 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b048ef-02c5-4979-b79a-9cdae3551f5e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:39.471144 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b048ef-02c5-4979-b79a-9cdae3551f5e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:39.505045 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8082ca-0f13-4d25-b416-187c8ef9d163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:39.505918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8082ca-0f13-4d25-b416-187c8ef9d163 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:39.506199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8082ca-0f13-4d25-b416-187c8ef9d163 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:39.506472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8082ca-0f13-4d25-b416-187c8ef9d163 None admin] PATH_INFO: `/v3/users/76f955ebb8264177a0ee99f53be9ddb4` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:39.507924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8082ca-0f13-4d25-b416-187c8ef9d163 None admin] RBAC: Authorizing `identity:get_user(user_id=76f955ebb8264177a0ee99f53be9ddb4)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:39.509370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8082ca-0f13-4d25-b416-187c8ef9d163 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:39.510991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 590/1190] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:31:39 2022] GET /identity/v3/users/76f955ebb8264177a0ee99f53be9ddb4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:39.517331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b9141-9328-4bc3-8fc6-920a1267eb24 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:39.634875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b9141-9328-4bc3-8fc6-920a1267eb24 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:39.679942 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b5631-f9d4-4302-8919-13a6ec4cc2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:39.680832 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b5631-f9d4-4302-8919-13a6ec4cc2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:39.681105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b5631-f9d4-4302-8919-13a6ec4cc2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:39.681372 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b5631-f9d4-4302-8919-13a6ec4cc2e8 None admin] PATH_INFO: `/v3/projects/defdfebc3eb646108a7f94a53ffa574b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:39.682663 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b5631-f9d4-4302-8919-13a6ec4cc2e8 None admin] RBAC: Authorizing `identity:get_project(project_id=defdfebc3eb646108a7f94a53ffa574b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:39.684104 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b5631-f9d4-4302-8919-13a6ec4cc2e8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:39.685992 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 601/1191] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:31:39 2022] GET /identity/v3/projects/defdfebc3eb646108a7f94a53ffa574b => generated 361 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:39.691993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8082ca-0f13-4d25-b416-187c8ef9d163 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:39.788379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8082ca-0f13-4d25-b416-187c8ef9d163 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:39.822629 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1f717-2cc2-4323-a925-33c5be5467c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:39.823510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1f717-2cc2-4323-a925-33c5be5467c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:39.823794 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1f717-2cc2-4323-a925-33c5be5467c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:39.824069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1f717-2cc2-4323-a925-33c5be5467c0 None admin] PATH_INFO: `/v3/projects/defdfebc3eb646108a7f94a53ffa574b/users/76f955ebb8264177a0ee99f53be9ddb4/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:39.826076 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1f717-2cc2-4323-a925-33c5be5467c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=defdfebc3eb646108a7f94a53ffa574b, user_id=76f955ebb8264177a0ee99f53be9ddb4, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:39.827540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1f717-2cc2-4323-a925-33c5be5467c0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:39.906231 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 591/1192] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:31:39 2022] PUT /identity/v3/projects/defdfebc3eb646108a7f94a53ffa574b/users/76f955ebb8264177a0ee99f53be9ddb4/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:31:42.205366 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac624c-2a7d-4dc1-b0b1-8f26857e6f66 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:42.205964 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac624c-2a7d-4dc1-b0b1-8f26857e6f66 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:42.205964 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac624c-2a7d-4dc1-b0b1-8f26857e6f66 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:42.207244 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 602/1193] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:31:42.213149 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f0e9a-c399-4c0b-ae0b-203356331418 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:42.213650 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f0e9a-c399-4c0b-ae0b-203356331418 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:42.213751 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f0e9a-c399-4c0b-ae0b-203356331418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:42.229976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-762f0e9a-c399-4c0b-ae0b-203356331418 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:31:42.231155 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-762f0e9a-c399-4c0b-ae0b-203356331418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:31:42.298116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 592/1194] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:31:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 17:31:42.322961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac624c-2a7d-4dc1-b0b1-8f26857e6f66 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:42.443779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac624c-2a7d-4dc1-b0b1-8f26857e6f66 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:42.483162 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650dcd6-809f-4a00-966d-8b93b9a82823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:42.483865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650dcd6-809f-4a00-966d-8b93b9a82823 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:42.484140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650dcd6-809f-4a00-966d-8b93b9a82823 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:42.484411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650dcd6-809f-4a00-966d-8b93b9a82823 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:42.495802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650dcd6-809f-4a00-966d-8b93b9a82823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:31:42.503616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3650dcd6-809f-4a00-966d-8b93b9a82823 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:31:42.503616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:31:42.503616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:31:42.503616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:31:42.503616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:31:42.503616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:31:42.503616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:31:42.503616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:31:42.503616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:31:42.503616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:31:42.503616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:31:42.503616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:31:42.503616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:31:42.503616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:31:42.503616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:31:42.503616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:31:42.504798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:31:42.504798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:31:42.504798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:31:42.504798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:31:42.504798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:31:42.504798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:31:42.504798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:31:42.504798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:31:42.504798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:31:42.504798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:31:42.504798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:31:42.504798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:31:42.504798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:31:42.504798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:31:42.504798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:31:42.504798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:31:42.505965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:31:42.505965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:31:42.505965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:31:42.505965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:31:42.505965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:31:42.505965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:31:42.505965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:31:42.505965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:31:42.505965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:31:42.505965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:31:42.505965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:31:42.505965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:31:42.505965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 603/1195] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:31:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:31:42.511038 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f0e9a-c399-4c0b-ae0b-203356331418 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:42.605807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f0e9a-c399-4c0b-ae0b-203356331418 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:42.638629 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6195bf-87bc-447b-9295-f2b2d07255a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:42.639295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6195bf-87bc-447b-9295-f2b2d07255a5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:42.639579 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6195bf-87bc-447b-9295-f2b2d07255a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:42.639857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6195bf-87bc-447b-9295-f2b2d07255a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:42.640647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6195bf-87bc-447b-9295-f2b2d07255a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:31:42.640958 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6195bf-87bc-447b-9295-f2b2d07255a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:42.642329 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6195bf-87bc-447b-9295-f2b2d07255a5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:42.651372 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 593/1196] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:31:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:42.657184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650dcd6-809f-4a00-966d-8b93b9a82823 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:42.753710 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650dcd6-809f-4a00-966d-8b93b9a82823 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:42.786351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cfeba-bf7d-430a-997b-3777cfb85aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:42.787221 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cfeba-bf7d-430a-997b-3777cfb85aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:42.787499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cfeba-bf7d-430a-997b-3777cfb85aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:42.787768 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cfeba-bf7d-430a-997b-3777cfb85aa4 None admin] PATH_INFO: `/v3/users/76f955ebb8264177a0ee99f53be9ddb4` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:42.789369 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cfeba-bf7d-430a-997b-3777cfb85aa4 None admin] RBAC: Authorizing `identity:get_user(user_id=76f955ebb8264177a0ee99f53be9ddb4)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:42.791312 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cfeba-bf7d-430a-997b-3777cfb85aa4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:42.792968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 604/1197] 10.222.0.81 () {56 vars in 1177 bytes} [Wed May 4 17:31:42 2022] GET /identity/v3/users/76f955ebb8264177a0ee99f53be9ddb4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:42.798716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6195bf-87bc-447b-9295-f2b2d07255a5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:42.906450 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6195bf-87bc-447b-9295-f2b2d07255a5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:42.940151 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc653c-e59e-4a7a-96b5-2b687a7fcaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:42.940833 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc653c-e59e-4a7a-96b5-2b687a7fcaca None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:42.941118 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc653c-e59e-4a7a-96b5-2b687a7fcaca None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:42.941391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc653c-e59e-4a7a-96b5-2b687a7fcaca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:43.011965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc653c-e59e-4a7a-96b5-2b687a7fcaca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:43.013434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc653c-e59e-4a7a-96b5-2b687a7fcaca None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:43.112086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 594/1198] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:31:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:31:43.118911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cfeba-bf7d-430a-997b-3777cfb85aa4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:43.217590 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cfeba-bf7d-430a-997b-3777cfb85aa4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:43.252495 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab523afe-ff46-4cbe-915d-c290fd50ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:43.253350 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab523afe-ff46-4cbe-915d-c290fd50ee9c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:43.253633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab523afe-ff46-4cbe-915d-c290fd50ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:43.253909 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab523afe-ff46-4cbe-915d-c290fd50ee9c None admin] PATH_INFO: `/v3/projects/defdfebc3eb646108a7f94a53ffa574b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:43.255088 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab523afe-ff46-4cbe-915d-c290fd50ee9c None admin] RBAC: Authorizing `identity:get_project(project_id=defdfebc3eb646108a7f94a53ffa574b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:43.256577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab523afe-ff46-4cbe-915d-c290fd50ee9c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:43.258901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 605/1199] 10.222.0.81 () {56 vars in 1186 bytes} [Wed May 4 17:31:43 2022] GET /identity/v3/projects/defdfebc3eb646108a7f94a53ffa574b => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:31:43.265343 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc653c-e59e-4a7a-96b5-2b687a7fcaca None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:31:43.364576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc653c-e59e-4a7a-96b5-2b687a7fcaca None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:31:43.399636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef457f-f132-4bd5-8251-53121ec57147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:31:43.400291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef457f-f132-4bd5-8251-53121ec57147 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:31:43.400612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef457f-f132-4bd5-8251-53121ec57147 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:31:43.400881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef457f-f132-4bd5-8251-53121ec57147 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:31:43.401715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef457f-f132-4bd5-8251-53121ec57147 None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=defdfebc3eb646108a7f94a53ffa574b, user.id=76f955ebb8264177a0ee99f53be9ddb4) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:31:43.402023 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef457f-f132-4bd5-8251-53121ec57147 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:31:43.403433 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef457f-f132-4bd5-8251-53121ec57147 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:31:43.409327 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 595/1200] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:31:43 2022] GET /identity/v3/role_assignments?user.id=76f955ebb8264177a0ee99f53be9ddb4&scope.project.id=defdfebc3eb646108a7f94a53ffa574b&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:07.472262 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e4971-4976-4442-99d1-45dd8c7070bc None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:07.472913 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e4971-4976-4442-99d1-45dd8c7070bc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:07.472913 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e4971-4976-4442-99d1-45dd8c7070bc None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:07.474202 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 606/1201] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:33:07.479792 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf9eb6-b8b8-4513-a6a4-a7657ba3cc36 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:07.480244 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf9eb6-b8b8-4513-a6a4-a7657ba3cc36 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:07.480355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf9eb6-b8b8-4513-a6a4-a7657ba3cc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:07.497105 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f7cf9eb6-b8b8-4513-a6a4-a7657ba3cc36 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:33:07.498287 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f7cf9eb6-b8b8-4513-a6a4-a7657ba3cc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:33:07.563043 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 596/1202] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:33:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:33:07.588278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e4971-4976-4442-99d1-45dd8c7070bc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:07.686700 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e4971-4976-4442-99d1-45dd8c7070bc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:07.720253 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e44b85-17af-4d79-b900-198e2f1eec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:07.721053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e44b85-17af-4d79-b900-198e2f1eec7d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:07.721386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e44b85-17af-4d79-b900-198e2f1eec7d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:07.721708 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e44b85-17af-4d79-b900-198e2f1eec7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:07.732535 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e44b85-17af-4d79-b900-198e2f1eec7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:07.733970 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e44b85-17af-4d79-b900-198e2f1eec7d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:07.754743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-50e44b85-17af-4d79-b900-198e2f1eec7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:07.754743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:07.754743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:07.754743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:07.754743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:07.754743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:07.754743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:07.754743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:07.754743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:07.754743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:07.754743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:07.754743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:07.754743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:33:07.754743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:33:07.754743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:07.756187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:07.758006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:33:07.758006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:33:07.758006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:07.758006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:33:07.758006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 607/1203] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:07.763110 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf9eb6-b8b8-4513-a6a4-a7657ba3cc36 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:07.859061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf9eb6-b8b8-4513-a6a4-a7657ba3cc36 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:07.892696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644a6b1-1e4f-4b04-a3ef-7b55a1ad7130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:07.893357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644a6b1-1e4f-4b04-a3ef-7b55a1ad7130 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:07.893641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644a6b1-1e4f-4b04-a3ef-7b55a1ad7130 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:07.893918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644a6b1-1e4f-4b04-a3ef-7b55a1ad7130 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:07.894636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644a6b1-1e4f-4b04-a3ef-7b55a1ad7130 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:07.894944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644a6b1-1e4f-4b04-a3ef-7b55a1ad7130 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:07.896336 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644a6b1-1e4f-4b04-a3ef-7b55a1ad7130 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:07.908051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 597/1204] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:07.913971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e44b85-17af-4d79-b900-198e2f1eec7d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:08.010214 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e44b85-17af-4d79-b900-198e2f1eec7d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:08.043183 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a61f7-76d2-4ed9-b8bf-7d0ec1626069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:08.043839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a61f7-76d2-4ed9-b8bf-7d0ec1626069 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:08.044119 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a61f7-76d2-4ed9-b8bf-7d0ec1626069 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:08.044390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a61f7-76d2-4ed9-b8bf-7d0ec1626069 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:08.045120 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a61f7-76d2-4ed9-b8bf-7d0ec1626069 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:08.046548 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a61f7-76d2-4ed9-b8bf-7d0ec1626069 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:08.175798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 608/1205] 10.222.0.81 () {60 vars in 1132 bytes} [Wed May 4 17:33:07 2022] POST /identity/v3/users => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:33:10.437825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94be669-7069-43ff-b640-6d4266692c38 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:10.438370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94be669-7069-43ff-b640-6d4266692c38 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:10.438370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94be669-7069-43ff-b640-6d4266692c38 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:10.439768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 598/1206] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:33:10.445417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fb971-378a-4fd1-a234-cdbe291d1d89 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:10.445841 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fb971-378a-4fd1-a234-cdbe291d1d89 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:10.445968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fb971-378a-4fd1-a234-cdbe291d1d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:10.480402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-fa4fb971-378a-4fd1-a234-cdbe291d1d89 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:33:10.481668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fa4fb971-378a-4fd1-a234-cdbe291d1d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:33:10.547324 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 609/1207] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:33:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:33:10.572927 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94be669-7069-43ff-b640-6d4266692c38 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:10.670972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94be669-7069-43ff-b640-6d4266692c38 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:10.703317 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6d714-6191-4049-8b6d-4a60155b054d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:10.704103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6d714-6191-4049-8b6d-4a60155b054d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:10.704383 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6d714-6191-4049-8b6d-4a60155b054d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:10.711650 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6d714-6191-4049-8b6d-4a60155b054d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:10.714689 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6d714-6191-4049-8b6d-4a60155b054d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:33:10.722294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9bb6d714-6191-4049-8b6d-4a60155b054d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:33:10.722294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:10.722294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:10.722294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:10.722294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:10.722294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:10.722294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:10.722294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:10.722294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:10.722294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:10.722294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:10.722294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:10.722294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:33:10.722294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:33:10.722294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:33:10.722294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:33:10.723431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:33:10.723431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:33:10.723431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:33:10.723431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:33:10.723431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:10.723431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:10.723431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:10.723431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:10.723431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:10.723431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:10.723431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:10.723431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:10.723431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:10.723431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:10.723431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:10.723431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:10.724500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:10.724500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:10.724500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:10.724500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:10.724500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:33:10.724500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:33:10.724500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:33:10.724500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:33:10.724500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:33:10.724500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:33:10.724500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:33:10.724500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:10.724500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 599/1208] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:33:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:10.730153 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fb971-378a-4fd1-a234-cdbe291d1d89 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:10.833272 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fb971-378a-4fd1-a234-cdbe291d1d89 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:10.871892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9af43-707f-4f71-bb7f-9401b6dbc106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:10.872588 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9af43-707f-4f71-bb7f-9401b6dbc106 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:10.872873 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9af43-707f-4f71-bb7f-9401b6dbc106 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:10.873149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9af43-707f-4f71-bb7f-9401b6dbc106 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:10.873899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9af43-707f-4f71-bb7f-9401b6dbc106 None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:10.874205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9af43-707f-4f71-bb7f-9401b6dbc106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:10.875567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9af43-707f-4f71-bb7f-9401b6dbc106 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:10.884117 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 610/1209] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:33:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:10.889954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6d714-6191-4049-8b6d-4a60155b054d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:10.988157 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6d714-6191-4049-8b6d-4a60155b054d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:11.021203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43093eb-135a-4257-82e5-744d91570186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:11.021995 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43093eb-135a-4257-82e5-744d91570186 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:11.022281 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43093eb-135a-4257-82e5-744d91570186 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:11.023148 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43093eb-135a-4257-82e5-744d91570186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:11.033329 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43093eb-135a-4257-82e5-744d91570186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:11.034767 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43093eb-135a-4257-82e5-744d91570186 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:11.051765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e43093eb-135a-4257-82e5-744d91570186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:11.051765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:11.051765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:11.051765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:11.051765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:11.051765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:11.051765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:11.051765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:11.051765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:11.051765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:11.051765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:11.051765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:11.051765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:33:11.051765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:33:11.051765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:11.054695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:11.055778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:33:11.055778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:33:11.055778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:11.055778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:11.055778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 600/1210] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:11.058784 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9af43-707f-4f71-bb7f-9401b6dbc106 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:11.159674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9af43-707f-4f71-bb7f-9401b6dbc106 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:11.192039 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6966c1-1e9b-4f8c-a23e-5aba8b39e9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:11.192711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6966c1-1e9b-4f8c-a23e-5aba8b39e9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:11.192986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6966c1-1e9b-4f8c-a23e-5aba8b39e9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:11.193253 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6966c1-1e9b-4f8c-a23e-5aba8b39e9b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:11.193963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6966c1-1e9b-4f8c-a23e-5aba8b39e9b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:11.194261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6966c1-1e9b-4f8c-a23e-5aba8b39e9b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:11.195731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6966c1-1e9b-4f8c-a23e-5aba8b39e9b1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:11.207010 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 611/1211] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:11.213323 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43093eb-135a-4257-82e5-744d91570186 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:11.308528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43093eb-135a-4257-82e5-744d91570186 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:11.341053 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea215907-4678-44ac-8c2f-9d2690c826b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:11.345234 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea215907-4678-44ac-8c2f-9d2690c826b6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:11.345234 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea215907-4678-44ac-8c2f-9d2690c826b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:11.345234 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea215907-4678-44ac-8c2f-9d2690c826b6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:11.349917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea215907-4678-44ac-8c2f-9d2690c826b6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:11.352212 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea215907-4678-44ac-8c2f-9d2690c826b6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:11.366838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ea215907-4678-44ac-8c2f-9d2690c826b6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 17:33:11.366838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:11.366838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:11.366838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:11.366838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:11.366838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:11.366838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:11.366838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:11.366838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:11.366838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:11.366838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:11.366838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:11.366838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:33:11.366838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:33:11.366838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:33:11.366838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:11.368128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:11.369444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:11.369444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:11.369444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:33:11.369444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:33:11.369444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:33:11.369444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:33:11.369444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:33:11.369444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:33:11.369444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 17:33:11.369444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:11.369444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 601/1212] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:11.374000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6966c1-1e9b-4f8c-a23e-5aba8b39e9b1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:11.470883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6966c1-1e9b-4f8c-a23e-5aba8b39e9b1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:11.504995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94500150-aaa8-4a3f-92c9-d8ade2dfdb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:11.505655 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94500150-aaa8-4a3f-92c9-d8ade2dfdb5a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:11.505934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94500150-aaa8-4a3f-92c9-d8ade2dfdb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:11.506206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94500150-aaa8-4a3f-92c9-d8ade2dfdb5a None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:11.507132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94500150-aaa8-4a3f-92c9-d8ade2dfdb5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:11.507449 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94500150-aaa8-4a3f-92c9-d8ade2dfdb5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:11.508917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94500150-aaa8-4a3f-92c9-d8ade2dfdb5a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:11.526810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 612/1213] 10.222.0.81 () {56 vars in 1143 bytes} [Wed May 4 17:33:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:11.532610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea215907-4678-44ac-8c2f-9d2690c826b6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:11.629583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea215907-4678-44ac-8c2f-9d2690c826b6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:11.662666 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614dd6f-772a-4902-b605-351eaa6e02be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:11.663850 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614dd6f-772a-4902-b605-351eaa6e02be None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:11.664129 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614dd6f-772a-4902-b605-351eaa6e02be None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:11.664408 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614dd6f-772a-4902-b605-351eaa6e02be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:11.728157 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614dd6f-772a-4902-b605-351eaa6e02be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:11.729638 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614dd6f-772a-4902-b605-351eaa6e02be None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:11.824735 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 602/1214] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:33:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:33:11.830617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94500150-aaa8-4a3f-92c9-d8ade2dfdb5a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:11.928155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94500150-aaa8-4a3f-92c9-d8ade2dfdb5a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:11.961428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c629ae-18e8-444e-991e-2c6c7064daa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:11.962211 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c629ae-18e8-444e-991e-2c6c7064daa1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:11.962489 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c629ae-18e8-444e-991e-2c6c7064daa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:11.962761 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c629ae-18e8-444e-991e-2c6c7064daa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:11.972421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c629ae-18e8-444e-991e-2c6c7064daa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:11.973908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c629ae-18e8-444e-991e-2c6c7064daa1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:11.992518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f9c629ae-18e8-444e-991e-2c6c7064daa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:11.992518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:11.992518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:11.992518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:11.992518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:11.992518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:11.992518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:11.992518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:11.992518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:11.992518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:11.992518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:11.992518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:11.992518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:33:11.992518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:33:11.992518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:11.993611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:11.994530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:33:11.994530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:33:11.994530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:11.994530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:33:11.994530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 613/1215] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:11.999429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614dd6f-772a-4902-b605-351eaa6e02be None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:12.092803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614dd6f-772a-4902-b605-351eaa6e02be None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:12.138048 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3f7de-1ed4-4111-b0d5-1434dbfdad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:12.138718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3f7de-1ed4-4111-b0d5-1434dbfdad7c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:12.138995 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3f7de-1ed4-4111-b0d5-1434dbfdad7c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:12.139267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3f7de-1ed4-4111-b0d5-1434dbfdad7c None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:12.139986 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3f7de-1ed4-4111-b0d5-1434dbfdad7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:12.140289 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3f7de-1ed4-4111-b0d5-1434dbfdad7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:12.141670 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3f7de-1ed4-4111-b0d5-1434dbfdad7c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:12.153409 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 603/1216] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:12.159027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c629ae-18e8-444e-991e-2c6c7064daa1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:12.256076 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c629ae-18e8-444e-991e-2c6c7064daa1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:12.290454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bd64a-5e80-4ddd-bb67-a1e8afe10b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:12.291236 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bd64a-5e80-4ddd-bb67-a1e8afe10b54 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:12.291509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bd64a-5e80-4ddd-bb67-a1e8afe10b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:12.291776 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bd64a-5e80-4ddd-bb67-a1e8afe10b54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:12.298247 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bd64a-5e80-4ddd-bb67-a1e8afe10b54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:12.299676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bd64a-5e80-4ddd-bb67-a1e8afe10b54 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:12.313857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-560bd64a-5e80-4ddd-bb67-a1e8afe10b54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:33:12.313857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:12.313857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:12.313857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:12.313857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:12.313857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:12.313857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:12.313857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:12.313857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:12.313857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:12.313857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:12.313857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:12.313857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:33:12.313857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:33:12.313857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:12.315560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:12.317361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:33:12.317361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:33:12.317361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:33:12.317361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:33:12.317361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:33:12.317361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:33:12.317361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:33:12.317361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:33:12.317361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 614/1217] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:33:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:12.321571 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3f7de-1ed4-4111-b0d5-1434dbfdad7c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:12.425797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3f7de-1ed4-4111-b0d5-1434dbfdad7c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:12.459080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bc7fe-a281-4033-a01a-432f5a74083d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:12.459726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bc7fe-a281-4033-a01a-432f5a74083d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:12.460077 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bc7fe-a281-4033-a01a-432f5a74083d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:12.460946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bc7fe-a281-4033-a01a-432f5a74083d None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:12.461730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bc7fe-a281-4033-a01a-432f5a74083d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:12.462038 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bc7fe-a281-4033-a01a-432f5a74083d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:12.463477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bc7fe-a281-4033-a01a-432f5a74083d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:12.474730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 604/1218] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:33:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:12.481574 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bd64a-5e80-4ddd-bb67-a1e8afe10b54 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:12.582379 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bd64a-5e80-4ddd-bb67-a1e8afe10b54 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:12.617054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539fdb5-03f9-43b0-a7f2-6372a3da4883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:12.617707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539fdb5-03f9-43b0-a7f2-6372a3da4883 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:12.617986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539fdb5-03f9-43b0-a7f2-6372a3da4883 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:12.618257 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539fdb5-03f9-43b0-a7f2-6372a3da4883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:12.619086 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539fdb5-03f9-43b0-a7f2-6372a3da4883 None admin] RBAC: Adding query filter params (role.id=61d7286cc614424e9d7b8514b201ee21, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=4ff8c001247c43ccbc4ccb26daa17201) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:12.619394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539fdb5-03f9-43b0-a7f2-6372a3da4883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:12.620851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539fdb5-03f9-43b0-a7f2-6372a3da4883 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:12.626651 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 615/1219] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:33:12 2022] GET /identity/v3/role_assignments?user.id=4ff8c001247c43ccbc4ccb26daa17201&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=61d7286cc614424e9d7b8514b201ee21 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:14.894633 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0283a-90d3-4d44-92ad-fb22ded5e969 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:14.895191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0283a-90d3-4d44-92ad-fb22ded5e969 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:14.895191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0283a-90d3-4d44-92ad-fb22ded5e969 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:14.896564 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 605/1220] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:33:14.901869 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1858205-bb5c-4bc3-a7de-be650f429807 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:14.902290 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1858205-bb5c-4bc3-a7de-be650f429807 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:14.902415 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1858205-bb5c-4bc3-a7de-be650f429807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:14.918833 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f1858205-bb5c-4bc3-a7de-be650f429807 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:33:14.920002 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f1858205-bb5c-4bc3-a7de-be650f429807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:33:14.984993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 616/1221] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:33:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:33:15.009487 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0283a-90d3-4d44-92ad-fb22ded5e969 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:15.107849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0283a-90d3-4d44-92ad-fb22ded5e969 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:15.144000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3567a1c-55ba-4973-a550-50a7f2db7669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:15.144872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3567a1c-55ba-4973-a550-50a7f2db7669 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:15.145104 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3567a1c-55ba-4973-a550-50a7f2db7669 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:15.145379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3567a1c-55ba-4973-a550-50a7f2db7669 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:15.156347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3567a1c-55ba-4973-a550-50a7f2db7669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:33:15.164342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e3567a1c-55ba-4973-a550-50a7f2db7669 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:33:15.164342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:15.164342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:15.164342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:15.164342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:15.164342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:15.164342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:15.164342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:15.164342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:15.164342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:15.164342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:15.164342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:15.164342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:33:15.164342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:33:15.164342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:33:15.164342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:33:15.165600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:33:15.165600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:33:15.165600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:33:15.165600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:33:15.165600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:15.165600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:15.165600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:15.165600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:15.165600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:15.165600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:15.165600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:15.165600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:15.165600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:15.165600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:15.165600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:15.165600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:15.166729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:15.166729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:15.166729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:15.166729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:15.166729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:33:15.166729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:33:15.166729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:33:15.166729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:33:15.166729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:33:15.166729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:33:15.166729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:33:15.166729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:15.166729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 606/1222] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:33:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:15.172011 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1858205-bb5c-4bc3-a7de-be650f429807 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:15.270826 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1858205-bb5c-4bc3-a7de-be650f429807 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:15.304202 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8be80-9756-4de3-8b64-942011772fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:15.304881 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8be80-9756-4de3-8b64-942011772fca None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:15.305161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8be80-9756-4de3-8b64-942011772fca None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:15.305431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8be80-9756-4de3-8b64-942011772fca None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:15.306267 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8be80-9756-4de3-8b64-942011772fca None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:15.306572 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8be80-9756-4de3-8b64-942011772fca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:15.307979 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8be80-9756-4de3-8b64-942011772fca None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:15.315575 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 617/1223] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:33:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:15.322235 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3567a1c-55ba-4973-a550-50a7f2db7669 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:15.423515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3567a1c-55ba-4973-a550-50a7f2db7669 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:15.456597 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86ef33-1b4a-4737-9057-9b8e5f5ffb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:15.457385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86ef33-1b4a-4737-9057-9b8e5f5ffb04 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:15.457671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86ef33-1b4a-4737-9057-9b8e5f5ffb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:15.457949 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86ef33-1b4a-4737-9057-9b8e5f5ffb04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:15.468749 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86ef33-1b4a-4737-9057-9b8e5f5ffb04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:15.470204 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86ef33-1b4a-4737-9057-9b8e5f5ffb04 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:15.487646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-6d86ef33-1b4a-4737-9057-9b8e5f5ffb04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:15.487646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:15.487646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:15.487646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:15.487646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:15.487646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:15.487646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:15.487646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:15.487646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:15.487646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:15.487646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:15.487646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:15.487646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:33:15.487646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:33:15.487646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:15.488895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:15.489962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:33:15.489962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:33:15.489962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:15.489962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:15.489962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 607/1224] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:15.495786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8be80-9756-4de3-8b64-942011772fca None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:15.596932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8be80-9756-4de3-8b64-942011772fca None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:15.630550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c136e9-0b68-4bc8-a7d9-adf4c2544cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:15.631202 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c136e9-0b68-4bc8-a7d9-adf4c2544cad None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:15.631480 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c136e9-0b68-4bc8-a7d9-adf4c2544cad None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:15.631752 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c136e9-0b68-4bc8-a7d9-adf4c2544cad None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:15.632594 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c136e9-0b68-4bc8-a7d9-adf4c2544cad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:15.632897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c136e9-0b68-4bc8-a7d9-adf4c2544cad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:15.634271 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c136e9-0b68-4bc8-a7d9-adf4c2544cad None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:15.646192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 618/1225] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:33:15.652521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86ef33-1b4a-4737-9057-9b8e5f5ffb04 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:15.751754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86ef33-1b4a-4737-9057-9b8e5f5ffb04 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:15.786003 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4091f87-6cfa-4e91-b213-725296f7c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:15.798168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4091f87-6cfa-4e91-b213-725296f7c84e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:15.798168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4091f87-6cfa-4e91-b213-725296f7c84e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:15.798168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4091f87-6cfa-4e91-b213-725296f7c84e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:15.798168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4091f87-6cfa-4e91-b213-725296f7c84e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:15.798168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4091f87-6cfa-4e91-b213-725296f7c84e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:15.811566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b4091f87-6cfa-4e91-b213-725296f7c84e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 17:33:15.811566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:15.811566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:15.811566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:15.811566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:15.811566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:15.811566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:15.811566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:15.811566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:15.811566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:15.811566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:15.811566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:15.811566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:33:15.811566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:33:15.811566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:33:15.811566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:15.812825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:15.813779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:15.813779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:15.813779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:33:15.813779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:33:15.813779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:33:15.813779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:33:15.813779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:33:15.813779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:33:15.813779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 17:33:15.813779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:15.813779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 608/1226] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:15.818662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c136e9-0b68-4bc8-a7d9-adf4c2544cad None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:15.918910 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c136e9-0b68-4bc8-a7d9-adf4c2544cad None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:15.953050 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc18b0e-612f-4116-b417-2c96b8a6a4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:15.953710 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc18b0e-612f-4116-b417-2c96b8a6a4af None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:15.953986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc18b0e-612f-4116-b417-2c96b8a6a4af None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:15.954255 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc18b0e-612f-4116-b417-2c96b8a6a4af None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:15.955142 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc18b0e-612f-4116-b417-2c96b8a6a4af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:15.955447 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc18b0e-612f-4116-b417-2c96b8a6a4af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:15.956940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc18b0e-612f-4116-b417-2c96b8a6a4af None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:15.974398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 619/1227] 10.222.0.81 () {56 vars in 1143 bytes} [Wed May 4 17:33:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:15.980724 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4091f87-6cfa-4e91-b213-725296f7c84e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:16.081469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4091f87-6cfa-4e91-b213-725296f7c84e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:16.115042 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23490b37-2aed-4d20-91a4-1f558bea492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:16.115832 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23490b37-2aed-4d20-91a4-1f558bea492c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:16.116113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23490b37-2aed-4d20-91a4-1f558bea492c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:16.116527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23490b37-2aed-4d20-91a4-1f558bea492c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:16.127072 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23490b37-2aed-4d20-91a4-1f558bea492c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:16.128901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23490b37-2aed-4d20-91a4-1f558bea492c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:16.149644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-23490b37-2aed-4d20-91a4-1f558bea492c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:16.149644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:16.149644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:16.149644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:16.149644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:16.149644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:16.149644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:16.149644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:16.149644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:16.149644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:16.149644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:16.149644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:16.149644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:33:16.149644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:33:16.149644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:16.150752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:16.151647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:33:16.151647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:33:16.151647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:16.151647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:16.151647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 609/1228] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:33:16.156722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc18b0e-612f-4116-b417-2c96b8a6a4af None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:16.263946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc18b0e-612f-4116-b417-2c96b8a6a4af None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:16.297265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a90fd-9653-43ec-90c9-28a2da4726ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:16.297923 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a90fd-9653-43ec-90c9-28a2da4726ea None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:16.302971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a90fd-9653-43ec-90c9-28a2da4726ea None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:16.302971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a90fd-9653-43ec-90c9-28a2da4726ea None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:16.302971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a90fd-9653-43ec-90c9-28a2da4726ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:16.302971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a90fd-9653-43ec-90c9-28a2da4726ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:16.302971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a90fd-9653-43ec-90c9-28a2da4726ea None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:16.312600 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 620/1229] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:16.318208 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23490b37-2aed-4d20-91a4-1f558bea492c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:16.421269 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23490b37-2aed-4d20-91a4-1f558bea492c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:16.454174 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a5e25-c74c-41fc-bb9a-84192fc2ab5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:16.454968 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a5e25-c74c-41fc-bb9a-84192fc2ab5c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:16.455252 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a5e25-c74c-41fc-bb9a-84192fc2ab5c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:16.455524 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a5e25-c74c-41fc-bb9a-84192fc2ab5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:16.464524 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a5e25-c74c-41fc-bb9a-84192fc2ab5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:16.465969 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a5e25-c74c-41fc-bb9a-84192fc2ab5c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:16.480828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-666a5e25-c74c-41fc-bb9a-84192fc2ab5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:33:16.480828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:16.480828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:16.480828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:16.480828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:16.480828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:16.480828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:16.480828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:16.480828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:16.480828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:16.480828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:16.480828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:16.480828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:33:16.480828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:33:16.480828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:16.481863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:16.482819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:33:16.482819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:33:16.482819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:33:16.482819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:33:16.482819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:33:16.482819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:33:16.482819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:33:16.482819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:16.482819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 610/1230] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:33:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:16.488189 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a90fd-9653-43ec-90c9-28a2da4726ea None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:16.591843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a90fd-9653-43ec-90c9-28a2da4726ea None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:16.627940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9911ca8-9239-47d5-87f6-27cb96ee1e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:16.628626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9911ca8-9239-47d5-87f6-27cb96ee1e0a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:16.628908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9911ca8-9239-47d5-87f6-27cb96ee1e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:16.629284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9911ca8-9239-47d5-87f6-27cb96ee1e0a None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:16.630371 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9911ca8-9239-47d5-87f6-27cb96ee1e0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:16.630685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9911ca8-9239-47d5-87f6-27cb96ee1e0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:16.632680 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9911ca8-9239-47d5-87f6-27cb96ee1e0a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:16.645068 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 621/1231] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:33:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:16.651997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a5e25-c74c-41fc-bb9a-84192fc2ab5c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:16.752888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a5e25-c74c-41fc-bb9a-84192fc2ab5c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:16.790046 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd9aa0-a08f-4ae2-a3f8-674503c4ed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:16.790942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9aa0-a08f-4ae2-a3f8-674503c4ed5b None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:16.791228 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9aa0-a08f-4ae2-a3f8-674503c4ed5b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:16.791504 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9aa0-a08f-4ae2-a3f8-674503c4ed5b None admin] PATH_INFO: `/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/4ff8c001247c43ccbc4ccb26daa17201/roles/61d7286cc614424e9d7b8514b201ee21` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:16.806905 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd9aa0-a08f-4ae2-a3f8-674503c4ed5b None admin] RBAC: Authorizing `identity:create_grant(project_id=544a56c4b97e43aea9fbb003d80af8dc, user_id=4ff8c001247c43ccbc4ccb26daa17201, role_id=61d7286cc614424e9d7b8514b201ee21)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:16.808346 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd9aa0-a08f-4ae2-a3f8-674503c4ed5b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:16.919470 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 611/1232] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:33:16 2022] PUT /identity/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/4ff8c001247c43ccbc4ccb26daa17201/roles/61d7286cc614424e9d7b8514b201ee21 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:33:19.216862 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822af0b-b2f4-475f-be05-bebe5fcb1ff4 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:19.217424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822af0b-b2f4-475f-be05-bebe5fcb1ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:19.217518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822af0b-b2f4-475f-be05-bebe5fcb1ff4 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:19.218893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 622/1233] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:33:19.224167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098888c-3a19-42ec-beab-e79a701946a2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:19.224568 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098888c-3a19-42ec-beab-e79a701946a2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:19.224745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098888c-3a19-42ec-beab-e79a701946a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:19.241061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9098888c-3a19-42ec-beab-e79a701946a2 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:33:19.242794 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9098888c-3a19-42ec-beab-e79a701946a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:33:19.310495 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 612/1234] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:33:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:33:19.334961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822af0b-b2f4-475f-be05-bebe5fcb1ff4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:19.445526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822af0b-b2f4-475f-be05-bebe5fcb1ff4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:19.486382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d8d6f-703e-4cf4-b162-fdea0faa1495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:19.487103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d8d6f-703e-4cf4-b162-fdea0faa1495 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:19.487433 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d8d6f-703e-4cf4-b162-fdea0faa1495 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:19.487708 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d8d6f-703e-4cf4-b162-fdea0faa1495 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:19.498394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d8d6f-703e-4cf4-b162-fdea0faa1495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:33:19.506443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-296d8d6f-703e-4cf4-b162-fdea0faa1495 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 17:33:19.506443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:19.506443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:19.506443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:19.506443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:19.506443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:19.506443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:19.506443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:19.506443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:19.506443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:19.506443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:19.506443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:19.506443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:33:19.506443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:33:19.506443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:33:19.506443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:33:19.517713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:33:19.517713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:33:19.517713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:33:19.517713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:33:19.517713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:19.517713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:19.517713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:19.517713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:19.517713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:19.517713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:19.517713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:19.517713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:33:19.517713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:19.517713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:19.517713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:19.517713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:19.518659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:19.518659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:19.518659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:19.518659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:19.518659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:33:19.518659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:33:19.518659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:33:19.518659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:33:19.518659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:33:19.518659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:33:19.518659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 17:33:19.518659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:33:19.518659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 623/1235] 10.222.0.81 () {56 vars in 1102 bytes} [Wed May 4 17:33:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:19.519369 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098888c-3a19-42ec-beab-e79a701946a2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:19.612255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098888c-3a19-42ec-beab-e79a701946a2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:19.646662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83460ae4-5318-41b9-a1ee-a8a95077c2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:19.647326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83460ae4-5318-41b9-a1ee-a8a95077c2cd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:19.647617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83460ae4-5318-41b9-a1ee-a8a95077c2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:19.648477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83460ae4-5318-41b9-a1ee-a8a95077c2cd None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:19.649290 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83460ae4-5318-41b9-a1ee-a8a95077c2cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:19.649601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83460ae4-5318-41b9-a1ee-a8a95077c2cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:19.651006 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83460ae4-5318-41b9-a1ee-a8a95077c2cd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:19.659447 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 613/1236] 10.222.0.81 () {56 vars in 1103 bytes} [Wed May 4 17:33:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:19.665253 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d8d6f-703e-4cf4-b162-fdea0faa1495 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:19.767837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d8d6f-703e-4cf4-b162-fdea0faa1495 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:19.802600 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400de138-8f8c-45e7-a199-6d033094268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:19.803380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400de138-8f8c-45e7-a199-6d033094268d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:19.803658 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400de138-8f8c-45e7-a199-6d033094268d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:19.803935 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400de138-8f8c-45e7-a199-6d033094268d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:19.814976 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400de138-8f8c-45e7-a199-6d033094268d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:19.816507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400de138-8f8c-45e7-a199-6d033094268d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:19.834340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-400de138-8f8c-45e7-a199-6d033094268d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:19.834340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:19.834340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:19.834340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:19.834340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:19.834340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:19.834340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:19.834340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:19.834340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:19.834340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:19.834340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:19.834340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:19.834340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:33:19.834340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:33:19.834340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:19.835900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:19.836969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:33:19.836969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:33:19.836969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:19.836969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:33:19.836969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 624/1237] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:19.842410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83460ae4-5318-41b9-a1ee-a8a95077c2cd None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:19.941352 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83460ae4-5318-41b9-a1ee-a8a95077c2cd None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:19.975592 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419cddd-0f77-491e-8313-ab8f9252ce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:19.977124 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419cddd-0f77-491e-8313-ab8f9252ce7d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:19.977410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419cddd-0f77-491e-8313-ab8f9252ce7d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:19.977690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419cddd-0f77-491e-8313-ab8f9252ce7d None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:19.978433 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419cddd-0f77-491e-8313-ab8f9252ce7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:19.978740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419cddd-0f77-491e-8313-ab8f9252ce7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:19.980134 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419cddd-0f77-491e-8313-ab8f9252ce7d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:19.993066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 614/1238] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:33:19.998824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400de138-8f8c-45e7-a199-6d033094268d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:20.099792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400de138-8f8c-45e7-a199-6d033094268d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:20.134601 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838c40d-be7b-4611-86b5-2f7ef8067595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:20.135403 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838c40d-be7b-4611-86b5-2f7ef8067595 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:20.135680 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838c40d-be7b-4611-86b5-2f7ef8067595 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:20.135949 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838c40d-be7b-4611-86b5-2f7ef8067595 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:20.143508 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838c40d-be7b-4611-86b5-2f7ef8067595 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:20.145060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838c40d-be7b-4611-86b5-2f7ef8067595 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:20.160225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-c838c40d-be7b-4611-86b5-2f7ef8067595 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 17:33:20.160225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:20.160225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:20.160225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:20.160225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:20.160225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:20.160225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:20.160225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:20.160225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:20.160225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:20.160225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:20.160225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:20.160225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:33:20.160225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:33:20.160225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:33:20.160225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:20.161397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:20.162685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:20.162685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:20.162685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:33:20.162685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:33:20.162685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:33:20.162685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:33:20.162685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:33:20.162685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:33:20.162685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 17:33:20.162685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:33:20.162685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 625/1239] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:20.168002 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419cddd-0f77-491e-8313-ab8f9252ce7d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:20.266668 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419cddd-0f77-491e-8313-ab8f9252ce7d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:20.300509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba0d3b-83de-4602-8f49-553b1b8aa05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:20.301177 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba0d3b-83de-4602-8f49-553b1b8aa05f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:20.301458 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba0d3b-83de-4602-8f49-553b1b8aa05f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:20.301729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba0d3b-83de-4602-8f49-553b1b8aa05f None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:20.302599 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba0d3b-83de-4602-8f49-553b1b8aa05f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:20.302874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba0d3b-83de-4602-8f49-553b1b8aa05f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:20.304401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba0d3b-83de-4602-8f49-553b1b8aa05f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:20.321611 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 615/1240] 10.222.0.81 () {56 vars in 1143 bytes} [Wed May 4 17:33:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:20.327951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838c40d-be7b-4611-86b5-2f7ef8067595 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:20.433300 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838c40d-be7b-4611-86b5-2f7ef8067595 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:20.466732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7debc-66e1-4ffe-8076-d2e639caf7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:20.467376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7debc-66e1-4ffe-8076-d2e639caf7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:20.467655 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7debc-66e1-4ffe-8076-d2e639caf7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:20.467929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7debc-66e1-4ffe-8076-d2e639caf7f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:20.535506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7debc-66e1-4ffe-8076-d2e639caf7f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:20.536998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7debc-66e1-4ffe-8076-d2e639caf7f8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:20.636400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 626/1241] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:33:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:33:20.642478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba0d3b-83de-4602-8f49-553b1b8aa05f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:20.742174 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba0d3b-83de-4602-8f49-553b1b8aa05f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:20.786721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00215fed-1959-43a4-9aa7-041a67c1c498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:20.787513 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00215fed-1959-43a4-9aa7-041a67c1c498 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:20.787799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00215fed-1959-43a4-9aa7-041a67c1c498 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:20.788075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00215fed-1959-43a4-9aa7-041a67c1c498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:20.798707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00215fed-1959-43a4-9aa7-041a67c1c498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:20.800212 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00215fed-1959-43a4-9aa7-041a67c1c498 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:20.817106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-00215fed-1959-43a4-9aa7-041a67c1c498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:20.817106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:20.817106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:20.817106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:20.817106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:20.817106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:20.817106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:20.817106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:20.817106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:20.817106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:20.817106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:20.817106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:20.817106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:33:20.817106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:33:20.817106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:20.818215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:20.819243 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:33:20.819243 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:33:20.819243 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:20.819243 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:20.819243 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 616/1242] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:20.824403 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7debc-66e1-4ffe-8076-d2e639caf7f8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:20.925017 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7debc-66e1-4ffe-8076-d2e639caf7f8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:20.960453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac027ed-fbfd-44cd-9ce5-c3803ac96615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:20.961199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac027ed-fbfd-44cd-9ce5-c3803ac96615 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:20.961481 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac027ed-fbfd-44cd-9ce5-c3803ac96615 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:20.961756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac027ed-fbfd-44cd-9ce5-c3803ac96615 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:20.962490 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac027ed-fbfd-44cd-9ce5-c3803ac96615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:20.962790 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac027ed-fbfd-44cd-9ce5-c3803ac96615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:20.964280 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac027ed-fbfd-44cd-9ce5-c3803ac96615 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:20.976472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 627/1243] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:20.982389 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00215fed-1959-43a4-9aa7-041a67c1c498 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:21.087280 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00215fed-1959-43a4-9aa7-041a67c1c498 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:21.120644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341594b4-9de4-4a7c-847a-edf531b8eaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:21.121435 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341594b4-9de4-4a7c-847a-edf531b8eaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:21.121715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341594b4-9de4-4a7c-847a-edf531b8eaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:21.121986 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341594b4-9de4-4a7c-847a-edf531b8eaf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:21.129059 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341594b4-9de4-4a7c-847a-edf531b8eaf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:21.130593 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341594b4-9de4-4a7c-847a-edf531b8eaf2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:21.144353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-341594b4-9de4-4a7c-847a-edf531b8eaf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:33:21.144353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:21.144353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:21.144353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:21.144353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:21.144353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:21.144353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:21.144353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:21.144353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:21.144353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:21.144353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:21.144353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:21.144353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:33:21.144353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:33:21.144353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:21.150694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:21.151755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:33:21.151755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:33:21.151755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:33:21.151755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:33:21.151755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:33:21.151755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:33:21.151755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:33:21.151755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:21.151755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 617/1244] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:33:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:21.152378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac027ed-fbfd-44cd-9ce5-c3803ac96615 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:21.255276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac027ed-fbfd-44cd-9ce5-c3803ac96615 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:21.289466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6c72d-9f73-4573-b2b8-2b5335282634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:21.290149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6c72d-9f73-4573-b2b8-2b5335282634 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:21.290459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6c72d-9f73-4573-b2b8-2b5335282634 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:21.290784 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6c72d-9f73-4573-b2b8-2b5335282634 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:21.291568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6c72d-9f73-4573-b2b8-2b5335282634 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:21.291874 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6c72d-9f73-4573-b2b8-2b5335282634 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:21.293453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6c72d-9f73-4573-b2b8-2b5335282634 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:21.305775 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 628/1245] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:33:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:21.311963 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341594b4-9de4-4a7c-847a-edf531b8eaf2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:21.417949 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341594b4-9de4-4a7c-847a-edf531b8eaf2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:21.451629 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303c088-77c8-4b19-985b-287b126e966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:21.452284 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303c088-77c8-4b19-985b-287b126e966a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:21.452602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303c088-77c8-4b19-985b-287b126e966a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:21.452883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303c088-77c8-4b19-985b-287b126e966a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:21.453714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303c088-77c8-4b19-985b-287b126e966a None admin] RBAC: Adding query filter params (role.id=61d7286cc614424e9d7b8514b201ee21, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=4ff8c001247c43ccbc4ccb26daa17201) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:21.454035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303c088-77c8-4b19-985b-287b126e966a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:21.455497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303c088-77c8-4b19-985b-287b126e966a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:21.461615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 618/1246] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:33:21 2022] GET /identity/v3/role_assignments?user.id=4ff8c001247c43ccbc4ccb26daa17201&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=61d7286cc614424e9d7b8514b201ee21 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:23.844465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bae55-d3f3-400f-aab1-d1c614064a23 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:23.845029 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bae55-d3f3-400f-aab1-d1c614064a23 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:23.845029 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bae55-d3f3-400f-aab1-d1c614064a23 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:23.846511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 629/1247] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:33:23.852194 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121325d-9a16-459e-a40c-e9693bd5ff87 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:23.852680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121325d-9a16-459e-a40c-e9693bd5ff87 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:23.852780 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121325d-9a16-459e-a40c-e9693bd5ff87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:23.869339 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f121325d-9a16-459e-a40c-e9693bd5ff87 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:33:23.870569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f121325d-9a16-459e-a40c-e9693bd5ff87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:33:23.937279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 619/1248] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:33:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:33:23.964390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bae55-d3f3-400f-aab1-d1c614064a23 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:24.067246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bae55-d3f3-400f-aab1-d1c614064a23 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:24.103495 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb14ef-4c13-465b-8ce1-1914da3938d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:24.104170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb14ef-4c13-465b-8ce1-1914da3938d1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:24.104475 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb14ef-4c13-465b-8ce1-1914da3938d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:24.104735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb14ef-4c13-465b-8ce1-1914da3938d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:24.116485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb14ef-4c13-465b-8ce1-1914da3938d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:33:24.131124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d9cb14ef-4c13-465b-8ce1-1914da3938d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:33:24.131124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:24.131124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:24.131124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:24.131124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:24.131124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:24.131124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:24.131124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:24.131124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:24.131124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:24.131124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:24.131124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:24.131124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:33:24.131124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:33:24.131124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:33:24.131124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:33:24.132934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:33:24.132934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:33:24.132934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:33:24.132934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:33:24.132934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:24.132934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:24.132934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:24.132934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:24.132934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:24.132934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:24.132934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:24.132934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:33:24.132934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:24.132934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:24.132934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:24.132934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:24.137950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:24.137950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:24.137950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:24.137950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:24.137950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:33:24.137950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:33:24.137950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:33:24.137950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:33:24.137950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:33:24.137950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:33:24.137950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:33:24.137950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:33:24.137950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 630/1249] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:33:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:24.139118 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121325d-9a16-459e-a40c-e9693bd5ff87 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:24.237174 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121325d-9a16-459e-a40c-e9693bd5ff87 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:24.276972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e89624-8f0e-477e-ba90-85a34ee325f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:24.277647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e89624-8f0e-477e-ba90-85a34ee325f7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:24.277940 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e89624-8f0e-477e-ba90-85a34ee325f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:24.278199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e89624-8f0e-477e-ba90-85a34ee325f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:24.278953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e89624-8f0e-477e-ba90-85a34ee325f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:24.279256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e89624-8f0e-477e-ba90-85a34ee325f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:24.280642 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e89624-8f0e-477e-ba90-85a34ee325f7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:24.290043 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 620/1250] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:33:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:24.295964 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb14ef-4c13-465b-8ce1-1914da3938d1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:24.396797 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb14ef-4c13-465b-8ce1-1914da3938d1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:24.431496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a80b1-eb4d-4835-8d56-ad380796a6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:24.432283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a80b1-eb4d-4835-8d56-ad380796a6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:24.432593 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a80b1-eb4d-4835-8d56-ad380796a6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:24.432869 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a80b1-eb4d-4835-8d56-ad380796a6b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:24.443823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a80b1-eb4d-4835-8d56-ad380796a6b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:24.445798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a80b1-eb4d-4835-8d56-ad380796a6b1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:24.463662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-198a80b1-eb4d-4835-8d56-ad380796a6b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:24.463662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:24.463662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:24.463662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:24.463662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:24.463662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:24.463662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:24.463662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:24.463662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:24.463662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:24.463662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:24.463662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:24.463662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:33:24.463662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:33:24.463662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:24.464813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:24.466080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:33:24.466080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:33:24.466080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:24.466080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:33:24.466080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 631/1251] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:24.470738 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e89624-8f0e-477e-ba90-85a34ee325f7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:24.567077 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e89624-8f0e-477e-ba90-85a34ee325f7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:24.601409 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2853e8b-1c2c-4edf-bd5d-042122645b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:24.602075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2853e8b-1c2c-4edf-bd5d-042122645b26 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:24.602378 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2853e8b-1c2c-4edf-bd5d-042122645b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:24.602655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2853e8b-1c2c-4edf-bd5d-042122645b26 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:24.603380 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2853e8b-1c2c-4edf-bd5d-042122645b26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:24.603691 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2853e8b-1c2c-4edf-bd5d-042122645b26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:24.605206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2853e8b-1c2c-4edf-bd5d-042122645b26 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:24.617971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 621/1252] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:24.623831 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a80b1-eb4d-4835-8d56-ad380796a6b1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:24.725177 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a80b1-eb4d-4835-8d56-ad380796a6b1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:24.759170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5bf2c-6cd7-4470-b911-f2bb7aa2d270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:24.759989 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5bf2c-6cd7-4470-b911-f2bb7aa2d270 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:24.760262 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5bf2c-6cd7-4470-b911-f2bb7aa2d270 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:24.760556 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5bf2c-6cd7-4470-b911-f2bb7aa2d270 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:24.768383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5bf2c-6cd7-4470-b911-f2bb7aa2d270 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:24.769887 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5bf2c-6cd7-4470-b911-f2bb7aa2d270 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:24.784867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-b2c5bf2c-6cd7-4470-b911-f2bb7aa2d270 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 17:33:24.784867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:24.784867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:24.784867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:24.784867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:24.784867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:24.784867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:24.784867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:24.784867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:24.784867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:24.784867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:24.784867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:24.784867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:33:24.784867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:33:24.784867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:33:24.784867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:24.789093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:24.790243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:24.790243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:24.790243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:33:24.790243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:33:24.790243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:33:24.790243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:33:24.790243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:33:24.790243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:33:24.790243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 17:33:24.790243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:33:24.790243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 632/1253] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:24.792628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2853e8b-1c2c-4edf-bd5d-042122645b26 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:24.889070 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2853e8b-1c2c-4edf-bd5d-042122645b26 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:24.924030 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec8885-f98f-4e99-ada2-cad9231a5d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:24.924729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec8885-f98f-4e99-ada2-cad9231a5d84 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:24.925012 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec8885-f98f-4e99-ada2-cad9231a5d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:24.925285 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec8885-f98f-4e99-ada2-cad9231a5d84 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:24.926153 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec8885-f98f-4e99-ada2-cad9231a5d84 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:24.926456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec8885-f98f-4e99-ada2-cad9231a5d84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:24.927872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec8885-f98f-4e99-ada2-cad9231a5d84 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:24.946544 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 622/1254] 10.222.0.81 () {56 vars in 1143 bytes} [Wed May 4 17:33:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:24.952591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5bf2c-6cd7-4470-b911-f2bb7aa2d270 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:25.052545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5bf2c-6cd7-4470-b911-f2bb7aa2d270 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:25.086697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b8ab5-943b-40db-a96b-29ced7a6171f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:25.087346 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b8ab5-943b-40db-a96b-29ced7a6171f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:25.087622 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b8ab5-943b-40db-a96b-29ced7a6171f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:25.087889 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b8ab5-943b-40db-a96b-29ced7a6171f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:25.157041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b8ab5-943b-40db-a96b-29ced7a6171f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:25.158561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b8ab5-943b-40db-a96b-29ced7a6171f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:25.258003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 633/1255] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:33:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:33:25.264122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec8885-f98f-4e99-ada2-cad9231a5d84 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:25.358469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec8885-f98f-4e99-ada2-cad9231a5d84 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:25.391552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fa112-179e-4fbf-8edc-b982abef297a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:25.392322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fa112-179e-4fbf-8edc-b982abef297a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:25.392634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fa112-179e-4fbf-8edc-b982abef297a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:25.392909 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fa112-179e-4fbf-8edc-b982abef297a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:25.402706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fa112-179e-4fbf-8edc-b982abef297a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:25.404134 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fa112-179e-4fbf-8edc-b982abef297a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:25.421065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-902fa112-179e-4fbf-8edc-b982abef297a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:25.421065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:25.421065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:25.421065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:25.421065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:25.421065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:25.421065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:25.421065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:25.421065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:25.421065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:25.421065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:25.421065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:25.421065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:33:25.421065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:33:25.421065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:25.422138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:25.423051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:33:25.423051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:33:25.423051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:25.423051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:25.423051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 623/1256] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:25.427938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b8ab5-943b-40db-a96b-29ced7a6171f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:25.526721 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b8ab5-943b-40db-a96b-29ced7a6171f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:25.559704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271aae21-8d5a-41d5-aa66-a3428bd1c746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:25.560341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aae21-8d5a-41d5-aa66-a3428bd1c746 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:25.560648 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aae21-8d5a-41d5-aa66-a3428bd1c746 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:25.560922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aae21-8d5a-41d5-aa66-a3428bd1c746 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:25.561638 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271aae21-8d5a-41d5-aa66-a3428bd1c746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:25.561939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271aae21-8d5a-41d5-aa66-a3428bd1c746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:25.563296 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271aae21-8d5a-41d5-aa66-a3428bd1c746 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:25.574235 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 634/1257] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:25.579932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fa112-179e-4fbf-8edc-b982abef297a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:25.676405 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fa112-179e-4fbf-8edc-b982abef297a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:25.715901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e5075-92e5-4b73-8ad8-b174bbc704e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:25.716725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e5075-92e5-4b73-8ad8-b174bbc704e6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:25.717047 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e5075-92e5-4b73-8ad8-b174bbc704e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:25.717328 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e5075-92e5-4b73-8ad8-b174bbc704e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:25.724469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e5075-92e5-4b73-8ad8-b174bbc704e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:25.725939 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e5075-92e5-4b73-8ad8-b174bbc704e6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:25.739647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d29e5075-92e5-4b73-8ad8-b174bbc704e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:33:25.739647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:25.739647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:25.739647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:25.739647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:25.739647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:25.739647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:25.739647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:25.739647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:25.739647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:25.739647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:25.739647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:25.739647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:33:25.739647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:33:25.739647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:25.740772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:25.742184 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:33:25.742184 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:33:25.742184 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:33:25.742184 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:33:25.742184 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:33:25.742184 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:33:25.742184 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:33:25.742184 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:25.742184 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 624/1258] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:25.746879 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271aae21-8d5a-41d5-aa66-a3428bd1c746 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:25.848670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271aae21-8d5a-41d5-aa66-a3428bd1c746 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:25.883772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6cb5f-3236-4a3a-ade9-0216966f0971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:25.884428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6cb5f-3236-4a3a-ade9-0216966f0971 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:25.884738 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6cb5f-3236-4a3a-ade9-0216966f0971 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:25.885013 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6cb5f-3236-4a3a-ade9-0216966f0971 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:25.885839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6cb5f-3236-4a3a-ade9-0216966f0971 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:25.886109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6cb5f-3236-4a3a-ade9-0216966f0971 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:25.887547 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6cb5f-3236-4a3a-ade9-0216966f0971 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:25.899991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 635/1259] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:25.907339 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e5075-92e5-4b73-8ad8-b174bbc704e6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:26.005801 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e5075-92e5-4b73-8ad8-b174bbc704e6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:26.040566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f187c9-cae2-429d-8c67-8c65e08268a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:26.041160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f187c9-cae2-429d-8c67-8c65e08268a8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:26.041444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f187c9-cae2-429d-8c67-8c65e08268a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:26.041721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f187c9-cae2-429d-8c67-8c65e08268a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:26.042561 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f187c9-cae2-429d-8c67-8c65e08268a8 None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=4ff8c001247c43ccbc4ccb26daa17201) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:26.042875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f187c9-cae2-429d-8c67-8c65e08268a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:26.044293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f187c9-cae2-429d-8c67-8c65e08268a8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:26.049931 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 625/1260] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:33:25 2022] GET /identity/v3/role_assignments?user.id=4ff8c001247c43ccbc4ccb26daa17201&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:28.328472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a40e07-a16f-40c2-9e69-b26d337d13c3 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:28.329038 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a40e07-a16f-40c2-9e69-b26d337d13c3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:28.329038 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a40e07-a16f-40c2-9e69-b26d337d13c3 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:28.330446 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 636/1261] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:33:28.337251 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3c0bc-7de9-42f0-8090-4da286a712d2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:28.337764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3c0bc-7de9-42f0-8090-4da286a712d2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:28.337950 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3c0bc-7de9-42f0-8090-4da286a712d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:28.355631 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f3b3c0bc-7de9-42f0-8090-4da286a712d2 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:33:28.356867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f3b3c0bc-7de9-42f0-8090-4da286a712d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:33:28.424927 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 626/1262] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:33:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:33:28.448867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a40e07-a16f-40c2-9e69-b26d337d13c3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:28.551085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a40e07-a16f-40c2-9e69-b26d337d13c3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:28.590225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d5fee-63e8-40c9-9ccf-2245c1150fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:28.590943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d5fee-63e8-40c9-9ccf-2245c1150fde None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:28.591224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d5fee-63e8-40c9-9ccf-2245c1150fde None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:28.591505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d5fee-63e8-40c9-9ccf-2245c1150fde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:28.602787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d5fee-63e8-40c9-9ccf-2245c1150fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:33:28.611668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7a1d5fee-63e8-40c9-9ccf-2245c1150fde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:33:28.611668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:28.611668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:28.611668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:28.611668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:28.611668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:28.611668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:28.611668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:28.611668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:28.611668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:28.611668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:28.611668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:28.611668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:33:28.611668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:33:28.611668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:33:28.611668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:33:28.612829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:33:28.612829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:33:28.612829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:33:28.612829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:33:28.612829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:28.612829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:28.612829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:28.612829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:28.612829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:28.612829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:28.612829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:28.612829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:33:28.612829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:28.612829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:28.612829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:28.612829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:28.613907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:28.613907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:28.613907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:28.613907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:28.613907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:33:28.613907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:33:28.613907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:33:28.613907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:33:28.613907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:33:28.613907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:33:28.613907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:33:28.613907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:33:28.613907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 637/1263] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:33:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:33:28.621674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3c0bc-7de9-42f0-8090-4da286a712d2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:28.722870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3c0bc-7de9-42f0-8090-4da286a712d2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:28.758294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fdd1e-e041-47df-ad08-c8817ffed56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:28.758956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fdd1e-e041-47df-ad08-c8817ffed56a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:28.759240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fdd1e-e041-47df-ad08-c8817ffed56a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:28.759517 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fdd1e-e041-47df-ad08-c8817ffed56a None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:28.760302 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fdd1e-e041-47df-ad08-c8817ffed56a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:28.760642 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fdd1e-e041-47df-ad08-c8817ffed56a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:28.762011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fdd1e-e041-47df-ad08-c8817ffed56a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:28.770012 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 627/1264] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:33:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:28.777186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d5fee-63e8-40c9-9ccf-2245c1150fde None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:28.875178 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d5fee-63e8-40c9-9ccf-2245c1150fde None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:28.928292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65e179-f0a8-443e-aa03-1208e639d873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:28.929208 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65e179-f0a8-443e-aa03-1208e639d873 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:28.929208 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65e179-f0a8-443e-aa03-1208e639d873 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:28.929208 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65e179-f0a8-443e-aa03-1208e639d873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:28.943023 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65e179-f0a8-443e-aa03-1208e639d873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:28.945408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65e179-f0a8-443e-aa03-1208e639d873 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:28.968802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-2d65e179-f0a8-443e-aa03-1208e639d873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:28.968802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:28.968802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:28.968802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:28.968802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:28.968802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:28.968802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:28.968802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:28.968802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:28.968802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:28.968802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:28.968802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:28.968802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:33:28.968802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:33:28.968802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:28.969928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:28.971087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:33:28.971087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:33:28.971087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:28.971087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:33:28.971087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 638/1265] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:28.975942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fdd1e-e041-47df-ad08-c8817ffed56a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:29.081199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fdd1e-e041-47df-ad08-c8817ffed56a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:29.115990 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35417476-abaf-4bbc-aee4-727bf9cb9a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:29.116676 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35417476-abaf-4bbc-aee4-727bf9cb9a39 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:29.116959 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35417476-abaf-4bbc-aee4-727bf9cb9a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:29.117233 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35417476-abaf-4bbc-aee4-727bf9cb9a39 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:29.117956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35417476-abaf-4bbc-aee4-727bf9cb9a39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:29.118262 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35417476-abaf-4bbc-aee4-727bf9cb9a39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:29.119613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35417476-abaf-4bbc-aee4-727bf9cb9a39 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:29.131681 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 628/1266] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:29.137388 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65e179-f0a8-443e-aa03-1208e639d873 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:29.237113 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65e179-f0a8-443e-aa03-1208e639d873 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:29.270341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459b9f4-6577-42c4-bacb-709cc3d9e5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:29.271152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459b9f4-6577-42c4-bacb-709cc3d9e5fa None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:29.271579 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459b9f4-6577-42c4-bacb-709cc3d9e5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:29.271858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459b9f4-6577-42c4-bacb-709cc3d9e5fa None admin] PATH_INFO: `/v3/users/placement` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:29.284388 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459b9f4-6577-42c4-bacb-709cc3d9e5fa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:29.285894 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459b9f4-6577-42c4-bacb-709cc3d9e5fa None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:29.303917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7459b9f4-6577-42c4-bacb-709cc3d9e5fa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 17:33:29.303917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:29.303917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:29.303917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:29.303917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:29.303917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:29.303917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:29.303917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:29.303917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:29.303917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:29.303917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:29.303917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:29.303917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:33:29.303917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:33:29.303917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:33:29.303917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:29.305640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:29.306998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:29.306998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:29.306998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:33:29.306998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:33:29.306998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:33:29.306998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:33:29.306998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:33:29.306998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:33:29.306998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 17:33:29.306998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:33:29.306998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 639/1267] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:29.311573 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35417476-abaf-4bbc-aee4-727bf9cb9a39 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:29.417481 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35417476-abaf-4bbc-aee4-727bf9cb9a39 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:29.451195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab6326-bc6f-4f65-bade-149926a07c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:29.453305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab6326-bc6f-4f65-bade-149926a07c83 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:29.453305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab6326-bc6f-4f65-bade-149926a07c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:29.453305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab6326-bc6f-4f65-bade-149926a07c83 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:29.453305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab6326-bc6f-4f65-bade-149926a07c83 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:29.453617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab6326-bc6f-4f65-bade-149926a07c83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:29.454957 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab6326-bc6f-4f65-bade-149926a07c83 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:29.471697 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 629/1268] 10.222.0.81 () {56 vars in 1143 bytes} [Wed May 4 17:33:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:29.478301 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459b9f4-6577-42c4-bacb-709cc3d9e5fa None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:29.577898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459b9f4-6577-42c4-bacb-709cc3d9e5fa None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:29.611269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8d1d7-b588-4e47-a845-ef602534ac64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:29.612085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8d1d7-b588-4e47-a845-ef602534ac64 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:29.612359 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8d1d7-b588-4e47-a845-ef602534ac64 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:29.612686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8d1d7-b588-4e47-a845-ef602534ac64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:29.623583 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8d1d7-b588-4e47-a845-ef602534ac64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:29.625066 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8d1d7-b588-4e47-a845-ef602534ac64 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:29.643978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-8cb8d1d7-b588-4e47-a845-ef602534ac64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:29.643978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:29.643978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:29.643978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:29.643978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:29.643978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:29.643978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:29.643978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:29.643978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:29.643978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:29.643978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:29.643978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:29.643978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:33:29.643978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:33:29.643978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:29.646025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:29.647704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:33:29.647704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:33:29.647704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:29.647704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:33:29.647704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 640/1269] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:29.652770 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab6326-bc6f-4f65-bade-149926a07c83 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:29.756008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab6326-bc6f-4f65-bade-149926a07c83 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:29.794108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a551549-4435-4b32-ae39-b216e0a4d60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:29.794773 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a551549-4435-4b32-ae39-b216e0a4d60b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:29.795054 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a551549-4435-4b32-ae39-b216e0a4d60b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:29.795328 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a551549-4435-4b32-ae39-b216e0a4d60b None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:29.798644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a551549-4435-4b32-ae39-b216e0a4d60b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:29.798644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a551549-4435-4b32-ae39-b216e0a4d60b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:29.798644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a551549-4435-4b32-ae39-b216e0a4d60b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:29.809581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 630/1270] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:29.815385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8d1d7-b588-4e47-a845-ef602534ac64 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:29.915483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8d1d7-b588-4e47-a845-ef602534ac64 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:29.949021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f43c9f-4444-44e8-be1d-aea766f2c27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:29.949865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f43c9f-4444-44e8-be1d-aea766f2c27f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:29.950146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f43c9f-4444-44e8-be1d-aea766f2c27f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:29.950469 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f43c9f-4444-44e8-be1d-aea766f2c27f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:29.957276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f43c9f-4444-44e8-be1d-aea766f2c27f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:29.959194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f43c9f-4444-44e8-be1d-aea766f2c27f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:29.974145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d1f43c9f-4444-44e8-be1d-aea766f2c27f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:33:29.974145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:29.974145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:29.974145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:29.974145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:29.974145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:29.974145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:29.974145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:29.974145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:29.974145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:29.974145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:29.974145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:29.974145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:33:29.974145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:33:29.974145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:29.975230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:29.976919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:33:29.976919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:33:29.976919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:33:29.976919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:33:29.976919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:33:29.976919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:33:29.976919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:33:29.976919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:33:29.980710 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 641/1271] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:33:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:29.981993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a551549-4435-4b32-ae39-b216e0a4d60b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:30.079908 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a551549-4435-4b32-ae39-b216e0a4d60b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:30.114287 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef86f4-2483-4a4b-81d8-dc08bd8eb7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:30.114953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef86f4-2483-4a4b-81d8-dc08bd8eb7ea None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:30.115238 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef86f4-2483-4a4b-81d8-dc08bd8eb7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:30.115516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef86f4-2483-4a4b-81d8-dc08bd8eb7ea None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:30.116306 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef86f4-2483-4a4b-81d8-dc08bd8eb7ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:30.116649 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef86f4-2483-4a4b-81d8-dc08bd8eb7ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:30.118088 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef86f4-2483-4a4b-81d8-dc08bd8eb7ea None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:30.130510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 631/1272] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:33:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:30.137337 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f43c9f-4444-44e8-be1d-aea766f2c27f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:30.243751 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f43c9f-4444-44e8-be1d-aea766f2c27f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:30.277455 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2141ef5-8224-485a-8564-5c8a428de6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:30.278341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2141ef5-8224-485a-8564-5c8a428de6d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:30.278638 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2141ef5-8224-485a-8564-5c8a428de6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:30.278939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2141ef5-8224-485a-8564-5c8a428de6d4 None admin] PATH_INFO: `/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/4ff8c001247c43ccbc4ccb26daa17201/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:30.280931 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2141ef5-8224-485a-8564-5c8a428de6d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=544a56c4b97e43aea9fbb003d80af8dc, user_id=4ff8c001247c43ccbc4ccb26daa17201, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:30.282386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2141ef5-8224-485a-8564-5c8a428de6d4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:30.388255 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 642/1273] 10.222.0.81 () {58 vars in 1439 bytes} [Wed May 4 17:33:30 2022] PUT /identity/v3/projects/544a56c4b97e43aea9fbb003d80af8dc/users/4ff8c001247c43ccbc4ccb26daa17201/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:33:32.669059 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a4d00-6f2e-4969-91d8-fa376845a38b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:32.669609 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a4d00-6f2e-4969-91d8-fa376845a38b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:32.669609 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a4d00-6f2e-4969-91d8-fa376845a38b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:32.670982 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 632/1274] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:33:32.676580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756ebc4-ba39-4b50-a37a-e04806e365ff None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:32.677013 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756ebc4-ba39-4b50-a37a-e04806e365ff None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:32.684864 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756ebc4-ba39-4b50-a37a-e04806e365ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:32.694265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c756ebc4-ba39-4b50-a37a-e04806e365ff None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:33:32.695999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c756ebc4-ba39-4b50-a37a-e04806e365ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:33:32.766052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 643/1275] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:33:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:33:32.791509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a4d00-6f2e-4969-91d8-fa376845a38b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:32.904326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a4d00-6f2e-4969-91d8-fa376845a38b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:32.939335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c27b74-f873-4761-85a7-07b2bf2e48c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:32.940128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c27b74-f873-4761-85a7-07b2bf2e48c4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:32.940410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c27b74-f873-4761-85a7-07b2bf2e48c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:32.940717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c27b74-f873-4761-85a7-07b2bf2e48c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:32.951347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c27b74-f873-4761-85a7-07b2bf2e48c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 17:33:32.958956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d7c27b74-f873-4761-85a7-07b2bf2e48c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:33:32.958956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:32.958956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:32.958956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:32.958956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:32.958956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:32.958956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:32.958956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:32.958956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:32.958956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:32.958956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:32.958956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:32.958956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 17:33:32.958956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 17:33:32.958956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 17:33:32.958956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 17:33:32.960063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 17:33:32.960063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 17:33:32.960063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 17:33:32.960063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 17:33:32.960063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:32.960063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:32.960063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:32.960063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:32.960063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:32.960063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:32.960063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:32.960063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:32.960063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:32.960063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:32.960063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:32.960063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:32.961845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:32.961845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:32.961845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:32.961845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:32.961845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 17:33:32.961845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 17:33:32.961845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 17:33:32.961845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 17:33:32.961845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 17:33:32.961845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 17:33:32.961845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 17:33:32.961845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:32.961845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 633/1276] 10.222.0.81 () {56 vars in 1096 bytes} [Wed May 4 17:33:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:32.966840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756ebc4-ba39-4b50-a37a-e04806e365ff None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:33.064238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756ebc4-ba39-4b50-a37a-e04806e365ff None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:33.096636 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f255e-ed63-4549-8058-c3fe65589d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:33.097293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f255e-ed63-4549-8058-c3fe65589d58 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:33.097569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f255e-ed63-4549-8058-c3fe65589d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:33.097842 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f255e-ed63-4549-8058-c3fe65589d58 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:33.098578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f255e-ed63-4549-8058-c3fe65589d58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:33.098880 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f255e-ed63-4549-8058-c3fe65589d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:33.100232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f255e-ed63-4549-8058-c3fe65589d58 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:33.108842 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 644/1277] 10.222.0.81 () {56 vars in 1099 bytes} [Wed May 4 17:33:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:33.120238 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c27b74-f873-4761-85a7-07b2bf2e48c4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:33.219616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c27b74-f873-4761-85a7-07b2bf2e48c4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:33.252509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b484-624e-45bb-973c-6a02185900f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:33.253293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b484-624e-45bb-973c-6a02185900f2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:33.253833 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b484-624e-45bb-973c-6a02185900f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:33.254108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b484-624e-45bb-973c-6a02185900f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:33.264306 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446b484-624e-45bb-973c-6a02185900f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:33.265767 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446b484-624e-45bb-973c-6a02185900f2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:33.282069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-2446b484-624e-45bb-973c-6a02185900f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:33.282069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:33.282069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:33.282069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:33.282069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:33.282069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:33.282069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:33.282069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:33.282069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:33.282069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:33.282069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:33.282069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:33.282069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:33:33.282069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:33:33.282069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:33.283130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:33.284051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:33:33.284051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:33:33.284051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:33.284051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:33.284051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 634/1278] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 17:33:33.289918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f255e-ed63-4549-8058-c3fe65589d58 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:33.393085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f255e-ed63-4549-8058-c3fe65589d58 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:33.426430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257eede7-0c00-485c-a62c-95ecc6ef0fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:33.427093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257eede7-0c00-485c-a62c-95ecc6ef0fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:33.427373 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257eede7-0c00-485c-a62c-95ecc6ef0fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:33.427649 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257eede7-0c00-485c-a62c-95ecc6ef0fb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:33.428379 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257eede7-0c00-485c-a62c-95ecc6ef0fb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:33.428717 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257eede7-0c00-485c-a62c-95ecc6ef0fb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:33.430663 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257eede7-0c00-485c-a62c-95ecc6ef0fb2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:33.443289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 645/1279] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:33.449249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b484-624e-45bb-973c-6a02185900f2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:33.552962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b484-624e-45bb-973c-6a02185900f2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:33.591654 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28c470-91db-4eea-b762-dc8e371eda91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:33.592483 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28c470-91db-4eea-b762-dc8e371eda91 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:33.592768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28c470-91db-4eea-b762-dc8e371eda91 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:33.593051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28c470-91db-4eea-b762-dc8e371eda91 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:33.600661 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28c470-91db-4eea-b762-dc8e371eda91 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:33.602768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28c470-91db-4eea-b762-dc8e371eda91 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:33.616694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-2c28c470-91db-4eea-b762-dc8e371eda91 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 17:33:33.616694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:33.616694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:33.616694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:33.616694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:33.616694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:33.616694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:33.616694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:33.616694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:33.616694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:33.616694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:33.616694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:33.616694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 17:33:33.616694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 17:33:33.616694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 17:33:33.616694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:33.617834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:33.619112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:33.619112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:33.619112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 17:33:33.619112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 17:33:33.619112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 17:33:33.619112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 17:33:33.619112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 17:33:33.619112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 17:33:33.619112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 17:33:33.619112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:33.619112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 635/1280] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:33.623746 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257eede7-0c00-485c-a62c-95ecc6ef0fb2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:33.723734 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257eede7-0c00-485c-a62c-95ecc6ef0fb2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:33.758482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5485115-b64e-4f76-89cc-2dcbd045621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:33.759151 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5485115-b64e-4f76-89cc-2dcbd045621d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:33.759429 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5485115-b64e-4f76-89cc-2dcbd045621d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:33.759699 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5485115-b64e-4f76-89cc-2dcbd045621d None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:33.760586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5485115-b64e-4f76-89cc-2dcbd045621d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:33.760881 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5485115-b64e-4f76-89cc-2dcbd045621d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:33.762324 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5485115-b64e-4f76-89cc-2dcbd045621d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:33.780656 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 646/1281] 10.222.0.81 () {56 vars in 1143 bytes} [Wed May 4 17:33:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:33.786611 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28c470-91db-4eea-b762-dc8e371eda91 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:33.889863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28c470-91db-4eea-b762-dc8e371eda91 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:33.932232 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15f305-6677-4191-9727-965609230f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:33.932918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15f305-6677-4191-9727-965609230f52 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:33.933204 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15f305-6677-4191-9727-965609230f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:33.933480 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15f305-6677-4191-9727-965609230f52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:34.005699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15f305-6677-4191-9727-965609230f52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:34.007153 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15f305-6677-4191-9727-965609230f52 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:34.112008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 636/1282] 10.222.0.81 () {58 vars in 1282 bytes} [Wed May 4 17:33:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 17:33:34.117982 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5485115-b64e-4f76-89cc-2dcbd045621d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:34.215417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5485115-b64e-4f76-89cc-2dcbd045621d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:34.249249 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5246c6-206d-4133-9c42-14c579946476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:34.250029 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5246c6-206d-4133-9c42-14c579946476 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:34.250304 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5246c6-206d-4133-9c42-14c579946476 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:34.250574 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5246c6-206d-4133-9c42-14c579946476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:34.261112 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5246c6-206d-4133-9c42-14c579946476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:34.262569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5246c6-206d-4133-9c42-14c579946476 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:34.280634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-6d5246c6-206d-4133-9c42-14c579946476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:34.280634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:34.280634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:34.280634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:34.280634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:34.280634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:34.280634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:34.280634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:34.280634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:34.280634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:34.280634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:34.280634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:34.280634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 17:33:34.280634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 17:33:34.280634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:34.281525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:34.282428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 17:33:34.282428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 17:33:34.282428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 17:33:34.282428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:33:34.282428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 647/1283] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:34.287615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15f305-6677-4191-9727-965609230f52 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:34.384043 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15f305-6677-4191-9727-965609230f52 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:34.417786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de473cb-1c94-48da-9f89-466aea76699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:34.418472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de473cb-1c94-48da-9f89-466aea76699e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:34.418753 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de473cb-1c94-48da-9f89-466aea76699e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:34.419027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de473cb-1c94-48da-9f89-466aea76699e None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:34.419750 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de473cb-1c94-48da-9f89-466aea76699e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:34.420053 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de473cb-1c94-48da-9f89-466aea76699e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:34.421523 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de473cb-1c94-48da-9f89-466aea76699e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:34.433221 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 637/1284] 10.222.0.81 () {56 vars in 1109 bytes} [Wed May 4 17:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:34.438894 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5246c6-206d-4133-9c42-14c579946476 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:34.535786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5246c6-206d-4133-9c42-14c579946476 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:34.571824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9779df1-b122-442b-9365-f8ee684e1980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:34.572643 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9779df1-b122-442b-9365-f8ee684e1980 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:34.572922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9779df1-b122-442b-9365-f8ee684e1980 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:34.573192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9779df1-b122-442b-9365-f8ee684e1980 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:34.579932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9779df1-b122-442b-9365-f8ee684e1980 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:34.581414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9779df1-b122-442b-9365-f8ee684e1980 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:34.598719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-a9779df1-b122-442b-9365-f8ee684e1980 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:33:34.598719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:34.598719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:34.598719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:34.598719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:34.598719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:34.598719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:34.598719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:34.598719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:34.598719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:34.598719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:34.598719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:34.598719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 17:33:34.598719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 17:33:34.598719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:34.599810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:34.600863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 17:33:34.600863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 17:33:34.600863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 17:33:34.600863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 17:33:34.600863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 17:33:34.600863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 17:33:34.600863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 17:33:34.600863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 04 17:33:34.600863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 648/1285] 10.222.0.81 () {56 vars in 1111 bytes} [Wed May 4 17:33:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:34.606499 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de473cb-1c94-48da-9f89-466aea76699e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:34.704704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de473cb-1c94-48da-9f89-466aea76699e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:34.738394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864087cb-595b-4ba9-b9fb-9db331990c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:34.739042 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864087cb-595b-4ba9-b9fb-9db331990c1a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:34.739319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864087cb-595b-4ba9-b9fb-9db331990c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:34.739587 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864087cb-595b-4ba9-b9fb-9db331990c1a None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:34.740388 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864087cb-595b-4ba9-b9fb-9db331990c1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:34.740875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864087cb-595b-4ba9-b9fb-9db331990c1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:34.744396 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864087cb-595b-4ba9-b9fb-9db331990c1a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:34.756711 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 638/1286] 10.222.0.81 () {56 vars in 1148 bytes} [Wed May 4 17:33:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:34.763003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9779df1-b122-442b-9365-f8ee684e1980 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:34.864543 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9779df1-b122-442b-9365-f8ee684e1980 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:34.901647 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e1444-2399-469b-b697-9f8f7c3b599e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:34.902779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e1444-2399-469b-b697-9f8f7c3b599e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:34.903246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e1444-2399-469b-b697-9f8f7c3b599e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:34.903723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e1444-2399-469b-b697-9f8f7c3b599e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:34.905284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e1444-2399-469b-b697-9f8f7c3b599e None admin] RBAC: Adding query filter params (role.id=a2372b524c284d7882c3ca93ffbed9b0, scope.project.id=544a56c4b97e43aea9fbb003d80af8dc, user.id=4ff8c001247c43ccbc4ccb26daa17201) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:34.905829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e1444-2399-469b-b697-9f8f7c3b599e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:34.910756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e1444-2399-469b-b697-9f8f7c3b599e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:34.917927 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 649/1287] 10.222.0.81 () {56 vars in 1374 bytes} [Wed May 4 17:33:34 2022] GET /identity/v3/role_assignments?user.id=4ff8c001247c43ccbc4ccb26daa17201&scope.project.id=544a56c4b97e43aea9fbb003d80af8dc&role.id=a2372b524c284d7882c3ca93ffbed9b0 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:37.260030 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747285e7-7685-4743-be36-96da9948860a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:37.260743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747285e7-7685-4743-be36-96da9948860a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:37.260743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747285e7-7685-4743-be36-96da9948860a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:37.262117 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 639/1288] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:33:37.267516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a0d71-dba5-4689-b254-390880da646f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:37.267963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a0d71-dba5-4689-b254-390880da646f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:37.268048 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a0d71-dba5-4689-b254-390880da646f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:37.285630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7c1a0d71-dba5-4689-b254-390880da646f None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:33:37.286831 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7c1a0d71-dba5-4689-b254-390880da646f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:33:37.356012 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 650/1289] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:33:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:33:37.378733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747285e7-7685-4743-be36-96da9948860a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:37.480817 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747285e7-7685-4743-be36-96da9948860a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:37.515616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757e64e-d572-405c-a248-71c184bf2d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:37.516363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757e64e-d572-405c-a248-71c184bf2d5b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:37.516679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757e64e-d572-405c-a248-71c184bf2d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:37.516955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757e64e-d572-405c-a248-71c184bf2d5b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:37.517612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757e64e-d572-405c-a248-71c184bf2d5b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:37.518982 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757e64e-d572-405c-a248-71c184bf2d5b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a757e64e-d572-405c-a248-71c184bf2d5b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:37.531553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:37.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:37.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:37.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:37.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:37.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:37.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:37.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:33:37.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:33:37.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:33:37.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:33:37.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:37.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:37.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:37.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:37.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:37.536932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:37.537838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:37.537838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:37.537838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:37.537838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:37.537838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:37.537838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:37.537838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:37.537838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:37.537838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:37.537838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:37.537838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:33:37.537838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:33:37.537838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 17:33:37.537838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:37.537838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 640/1290] 10.222.0.81 () {56 vars in 1117 bytes} [Wed May 4 17:33:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:37.540473 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a0d71-dba5-4689-b254-390880da646f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:37.639706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a0d71-dba5-4689-b254-390880da646f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:37.674605 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6442dc-dc11-44bd-92c5-8ef0f3e312d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:37.675264 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6442dc-dc11-44bd-92c5-8ef0f3e312d9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:37.675543 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6442dc-dc11-44bd-92c5-8ef0f3e312d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:37.675814 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6442dc-dc11-44bd-92c5-8ef0f3e312d9 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:37.676553 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6442dc-dc11-44bd-92c5-8ef0f3e312d9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:37.676857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6442dc-dc11-44bd-92c5-8ef0f3e312d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:37.678224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6442dc-dc11-44bd-92c5-8ef0f3e312d9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:37.683821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 651/1291] 10.222.0.81 () {56 vars in 1116 bytes} [Wed May 4 17:33:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:37.689780 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757e64e-d572-405c-a248-71c184bf2d5b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:37.788387 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757e64e-d572-405c-a248-71c184bf2d5b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:37.823120 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cbe73-5b0b-435f-8395-a31d01b97af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:37.823786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cbe73-5b0b-435f-8395-a31d01b97af1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:37.824071 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cbe73-5b0b-435f-8395-a31d01b97af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:37.824347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cbe73-5b0b-435f-8395-a31d01b97af1 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:37.825085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cbe73-5b0b-435f-8395-a31d01b97af1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:37.825394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cbe73-5b0b-435f-8395-a31d01b97af1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:37.826770 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cbe73-5b0b-435f-8395-a31d01b97af1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:37.831125 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 641/1292] 10.222.0.81 () {56 vars in 1116 bytes} [Wed May 4 17:33:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:40.156708 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e44f2-97e3-4d3d-8192-3cea311f53cd None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:40.157247 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e44f2-97e3-4d3d-8192-3cea311f53cd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:40.157247 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e44f2-97e3-4d3d-8192-3cea311f53cd None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:40.158659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 652/1293] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:33:40.164146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c93c37-f0b1-47e0-a9d7-4f4eb982629f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:40.164647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c93c37-f0b1-47e0-a9d7-4f4eb982629f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:40.164737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c93c37-f0b1-47e0-a9d7-4f4eb982629f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:40.184170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c3c93c37-f0b1-47e0-a9d7-4f4eb982629f None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:33:40.185461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c3c93c37-f0b1-47e0-a9d7-4f4eb982629f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:33:40.253247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 642/1294] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:33:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:33:40.277537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e44f2-97e3-4d3d-8192-3cea311f53cd None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:40.390091 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e44f2-97e3-4d3d-8192-3cea311f53cd None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:40.428629 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802893e-620d-4ebc-a030-59880992f84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:40.429389 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802893e-620d-4ebc-a030-59880992f84e None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:40.429671 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802893e-620d-4ebc-a030-59880992f84e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:40.429943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802893e-620d-4ebc-a030-59880992f84e None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:40.430683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802893e-620d-4ebc-a030-59880992f84e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:40.432145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802893e-620d-4ebc-a030-59880992f84e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:40.514814 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 653/1295] 10.222.0.81 () {60 vars in 1141 bytes} [Wed May 4 17:33:40 2022] POST /identity/v3/services => generated 246 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:33:42.819473 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdf1c9-e355-4d5f-ae05-896e3d3ecaa0 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:42.820815 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdf1c9-e355-4d5f-ae05-896e3d3ecaa0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:42.820815 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdf1c9-e355-4d5f-ae05-896e3d3ecaa0 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:42.822373 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 643/1296] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:33:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:33:42.832995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab16455-d66a-4b50-9959-3d2adfa421c7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:42.833456 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab16455-d66a-4b50-9959-3d2adfa421c7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:42.833542 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab16455-d66a-4b50-9959-3d2adfa421c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:42.850180 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-cab16455-d66a-4b50-9959-3d2adfa421c7 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:33:42.853215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cab16455-d66a-4b50-9959-3d2adfa421c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:33:42.925842 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 654/1297] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:33:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:33:42.949306 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdf1c9-e355-4d5f-ae05-896e3d3ecaa0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:43.056826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdf1c9-e355-4d5f-ae05-896e3d3ecaa0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:43.106998 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec139e-f634-4633-930c-094ef672caab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:43.108283 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec139e-f634-4633-930c-094ef672caab None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:43.108606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec139e-f634-4633-930c-094ef672caab None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:43.108882 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec139e-f634-4633-930c-094ef672caab None admin] PATH_INFO: `/v3/services/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:43.109543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec139e-f634-4633-930c-094ef672caab None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:43.112170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec139e-f634-4633-930c-094ef672caab None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-adec139e-f634-4633-930c-094ef672caab None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:43.125786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:43.127465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:43.127465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:43.127465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:43.127465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:43.127465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:43.127465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:43.127465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:33:43.127465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:33:43.127465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:33:43.127465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:33:43.127465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:43.127465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:43.127465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:43.127465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:43.127465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:43.127465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:43.128721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:43.128721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:43.128721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:43.128721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:43.128721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:43.128721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:43.128721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:43.128721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:43.128721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:43.128721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:43.128721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:33:43.128721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:33:43.128721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 17:33:43.128721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:43.128721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 644/1298] 10.222.0.81 () {56 vars in 1117 bytes} [Wed May 4 17:33:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:43.134834 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab16455-d66a-4b50-9959-3d2adfa421c7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:43.232419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab16455-d66a-4b50-9959-3d2adfa421c7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:43.267244 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f89782-cdf6-4f2e-9e71-d13e589141a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:43.267906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f89782-cdf6-4f2e-9e71-d13e589141a1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:43.268182 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f89782-cdf6-4f2e-9e71-d13e589141a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:43.268478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f89782-cdf6-4f2e-9e71-d13e589141a1 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:43.269185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f89782-cdf6-4f2e-9e71-d13e589141a1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:43.269486 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f89782-cdf6-4f2e-9e71-d13e589141a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:43.270851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f89782-cdf6-4f2e-9e71-d13e589141a1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:43.276091 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 655/1299] 10.222.0.81 () {56 vars in 1116 bytes} [Wed May 4 17:33:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:43.282132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec139e-f634-4633-930c-094ef672caab None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:43.386349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec139e-f634-4633-930c-094ef672caab None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:43.420129 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb268666-5960-4f64-86b3-1ea22ab9882f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:43.420825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb268666-5960-4f64-86b3-1ea22ab9882f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:43.421105 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb268666-5960-4f64-86b3-1ea22ab9882f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:43.421376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb268666-5960-4f64-86b3-1ea22ab9882f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:43.422174 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb268666-5960-4f64-86b3-1ea22ab9882f None admin] RBAC: Adding query filter params (interface=public, service_id=af0138cc00f648c195b8dd4feb50a305, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:43.422481 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb268666-5960-4f64-86b3-1ea22ab9882f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:43.423850 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb268666-5960-4f64-86b3-1ea22ab9882f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:43.429091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 645/1300] 10.222.0.81 () {56 vars in 1251 bytes} [Wed May 4 17:33:43 2022] GET /identity/v3/endpoints?service_id=af0138cc00f648c195b8dd4feb50a305&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:43.435453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f89782-cdf6-4f2e-9e71-d13e589141a1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:43.537964 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f89782-cdf6-4f2e-9e71-d13e589141a1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:43.573455 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90581328-254d-49ef-ae78-01e06fcf9e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:43.574116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90581328-254d-49ef-ae78-01e06fcf9e53 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:43.574395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90581328-254d-49ef-ae78-01e06fcf9e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:43.574667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90581328-254d-49ef-ae78-01e06fcf9e53 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:43.575350 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90581328-254d-49ef-ae78-01e06fcf9e53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:43.576747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90581328-254d-49ef-ae78-01e06fcf9e53 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:43.583721 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 656/1301] 10.222.0.81 () {56 vars in 1087 bytes} [Wed May 4 17:33:43 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:33:45.866500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a9ed4-f509-44c6-9d69-5592b6cb9a25 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:45.867640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a9ed4-f509-44c6-9d69-5592b6cb9a25 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:45.867640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a9ed4-f509-44c6-9d69-5592b6cb9a25 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:45.869329 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 646/1302] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:33:45.874616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb53fe-6713-486f-abae-a98016d6cc69 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:45.875080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb53fe-6713-486f-abae-a98016d6cc69 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:45.875191 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb53fe-6713-486f-abae-a98016d6cc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:45.892415 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-47eb53fe-6713-486f-abae-a98016d6cc69 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:33:45.893613 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-47eb53fe-6713-486f-abae-a98016d6cc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:33:45.960149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 657/1303] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:33:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 17:33:45.984060 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a9ed4-f509-44c6-9d69-5592b6cb9a25 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:46.086489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a9ed4-f509-44c6-9d69-5592b6cb9a25 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:46.121619 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2918ac-953e-48e8-9f53-dbc6bf6bd7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:46.122349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2918ac-953e-48e8-9f53-dbc6bf6bd7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:46.122632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2918ac-953e-48e8-9f53-dbc6bf6bd7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:46.122905 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2918ac-953e-48e8-9f53-dbc6bf6bd7f5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:46.123572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2918ac-953e-48e8-9f53-dbc6bf6bd7f5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:46.125045 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2918ac-953e-48e8-9f53-dbc6bf6bd7f5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-dd2918ac-953e-48e8-9f53-dbc6bf6bd7f5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 17:33:46.138186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 17:33:46.139403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 17:33:46.139403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 17:33:46.139403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 17:33:46.139403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 17:33:46.139403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 17:33:46.139403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 17:33:46.139403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 17:33:46.139403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 17:33:46.139403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 17:33:46.139403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 17:33:46.139403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 17:33:46.139403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 17:33:46.139403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 17:33:46.139403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 17:33:46.139403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 17:33:46.139403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 04 17:33:46.140347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 17:33:46.140347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 04 17:33:46.140347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 17:33:46.140347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 04 17:33:46.140347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 17:33:46.140347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 17:33:46.140347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 17:33:46.140347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 04 17:33:46.140347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 17:33:46.140347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 04 17:33:46.140347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 17:33:46.140347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 17:33:46.140347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 17:33:46.140347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 04 17:33:46.140347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 647/1304] 10.222.0.81 () {56 vars in 1117 bytes} [Wed May 4 17:33:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 17:33:46.145606 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb53fe-6713-486f-abae-a98016d6cc69 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:46.246049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb53fe-6713-486f-abae-a98016d6cc69 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:46.279741 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7006aa0-eaa6-4afa-b06f-3d8615f96de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:46.280401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7006aa0-eaa6-4afa-b06f-3d8615f96de3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:46.280714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7006aa0-eaa6-4afa-b06f-3d8615f96de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:46.280989 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7006aa0-eaa6-4afa-b06f-3d8615f96de3 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:46.281693 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7006aa0-eaa6-4afa-b06f-3d8615f96de3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:33:46.282174 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7006aa0-eaa6-4afa-b06f-3d8615f96de3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:46.283548 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7006aa0-eaa6-4afa-b06f-3d8615f96de3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:46.288679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 658/1305] 10.222.0.81 () {56 vars in 1116 bytes} [Wed May 4 17:33:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:33:46.294691 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2918ac-953e-48e8-9f53-dbc6bf6bd7f5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:33:46.399672 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2918ac-953e-48e8-9f53-dbc6bf6bd7f5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:33:46.433980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3bd40-bffb-44d5-9022-c3f93ca04383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:33:46.434641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3bd40-bffb-44d5-9022-c3f93ca04383 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:33:46.434951 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3bd40-bffb-44d5-9022-c3f93ca04383 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:33:46.435230 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3bd40-bffb-44d5-9022-c3f93ca04383 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:33:46.435968 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3bd40-bffb-44d5-9022-c3f93ca04383 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:33:46.437387 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3bd40-bffb-44d5-9022-c3f93ca04383 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:33:46.517620 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 648/1306] 10.222.0.81 () {60 vars in 1144 bytes} [Wed May 4 17:33:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:40:43.054871 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a281-0b6e-433d-9f9e-cfb9ee73d763 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:43.055910 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a281-0b6e-433d-9f9e-cfb9ee73d763 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:43.056407 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a281-0b6e-433d-9f9e-cfb9ee73d763 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:43.063760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fae9c-ce8e-4133-adb2-65e43cf649bf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:43.064735 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fae9c-ce8e-4133-adb2-65e43cf649bf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:43.065268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fae9c-ce8e-4133-adb2-65e43cf649bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:43.067665 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 659/1307] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:40:43 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:40:43.205831 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-eb0fae9c-ce8e-4133-adb2-65e43cf649bf None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:40:43.208978 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-eb0fae9c-ce8e-4133-adb2-65e43cf649bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:43.381192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 649/1308] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:40:43.435072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d111-e289-425e-a5d9-553f7e2e679a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:43.435996 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d111-e289-425e-a5d9-553f7e2e679a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:43.437286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d111-e289-425e-a5d9-553f7e2e679a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:43.444959 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 660/1309] 10.222.0.81 () {54 vars in 964 bytes} [Wed May 4 17:40:43 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:40:43.450967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6d3db-6bab-4304-817c-ebf22454cedc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:43.451259 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6d3db-6bab-4304-817c-ebf22454cedc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:43.451540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6d3db-6bab-4304-817c-ebf22454cedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:43.550444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bfe6d3db-6bab-4304-817c-ebf22454cedc None None] MFA Rules not processed for user `96f0feac2b384b509bc9f75b92b4df95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:40:43.552000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bfe6d3db-6bab-4304-817c-ebf22454cedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:43.671778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 650/1310] 10.222.0.81 () {58 vars in 1061 bytes} [Wed May 4 17:40:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:40:43.680633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4d111-e289-425e-a5d9-553f7e2e679a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:40:43.682694 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d8a4d111-e289-425e-a5d9-553f7e2e679a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:43.821943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4d111-e289-425e-a5d9-553f7e2e679a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:40:43.915145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6aaf68-68e2-48fb-ad2b-84d662c64027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:40:43.916104 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aaf68-68e2-48fb-ad2b-84d662c64027 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:43.916574 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aaf68-68e2-48fb-ad2b-84d662c64027 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:43.916997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aaf68-68e2-48fb-ad2b-84d662c64027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:43.918948 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3e6aaf68-68e2-48fb-ad2b-84d662c64027 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:44.039065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6aaf68-68e2-48fb-ad2b-84d662c64027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:40:44.040865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6aaf68-68e2-48fb-ad2b-84d662c64027 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:40:44.077401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 661/1311] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:40:46.721056 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f9653-3104-4247-bfd3-3ca54fecfbe4 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:46.721646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f9653-3104-4247-bfd3-3ca54fecfbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:46.721646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f9653-3104-4247-bfd3-3ca54fecfbe4 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:46.722991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 651/1312] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:40:46.728567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492926cb-2eff-4e10-bd59-bc054a0ce83b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:46.729429 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492926cb-2eff-4e10-bd59-bc054a0ce83b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:46.729429 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492926cb-2eff-4e10-bd59-bc054a0ce83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:46.821429 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-492926cb-2eff-4e10-bd59-bc054a0ce83b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:40:46.828818 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-492926cb-2eff-4e10-bd59-bc054a0ce83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:46.935172 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 662/1313] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:40:46.975514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f9653-3104-4247-bfd3-3ca54fecfbe4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:40:46.977177 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c13f9653-3104-4247-bfd3-3ca54fecfbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:47.100997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f9653-3104-4247-bfd3-3ca54fecfbe4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:40:47.180701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf75192-265a-4535-83d2-c915c2520853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:40:47.181347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf75192-265a-4535-83d2-c915c2520853 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:47.181636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf75192-265a-4535-83d2-c915c2520853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:47.181915 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf75192-265a-4535-83d2-c915c2520853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:47.183608 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fbf75192-265a-4535-83d2-c915c2520853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:47.300819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf75192-265a-4535-83d2-c915c2520853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:40:47.302309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf75192-265a-4535-83d2-c915c2520853 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:40:47.328627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 652/1314] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:40:50.109018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4fd18-2561-45d1-a97a-abe431b799cb None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:50.109589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4fd18-2561-45d1-a97a-abe431b799cb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:50.109589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4fd18-2561-45d1-a97a-abe431b799cb None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:50.110977 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 663/1315] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:40:50.116429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ab276-7c6f-43aa-98cf-782d052382cb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:50.116923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ab276-7c6f-43aa-98cf-782d052382cb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:50.117034 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ab276-7c6f-43aa-98cf-782d052382cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:50.182312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e29ab276-7c6f-43aa-98cf-782d052382cb None None] MFA Rules not processed for user `9abe5470480046e6b6be3b0a0f16332b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:40:50.184326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e29ab276-7c6f-43aa-98cf-782d052382cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:50.281324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 653/1316] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:40:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:40:50.322186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4fd18-2561-45d1-a97a-abe431b799cb None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:40:50.323760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e8b4fd18-2561-45d1-a97a-abe431b799cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:50.427588 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4fd18-2561-45d1-a97a-abe431b799cb None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:40:50.499360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e78d2-eefa-41f2-87f1-809a7537c92c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:40:50.499997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e78d2-eefa-41f2-87f1-809a7537c92c service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:50.500274 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e78d2-eefa-41f2-87f1-809a7537c92c service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:50.500577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e78d2-eefa-41f2-87f1-809a7537c92c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:50.502216 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b54e78d2-eefa-41f2-87f1-809a7537c92c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:50.607382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e78d2-eefa-41f2-87f1-809a7537c92c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:40:50.608851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e78d2-eefa-41f2-87f1-809a7537c92c service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:40:50.626980 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 664/1317] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:40:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:40:53.992567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66971a08-f2c1-416a-9b3a-e8cf69b6b3ea None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:53.993163 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66971a08-f2c1-416a-9b3a-e8cf69b6b3ea None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:53.993163 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66971a08-f2c1-416a-9b3a-e8cf69b6b3ea None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:53.994488 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 654/1318] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:40:53.999910 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e543ea2-e076-443a-84bf-abe3e21e7007 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:54.000504 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e543ea2-e076-443a-84bf-abe3e21e7007 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:54.000504 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e543ea2-e076-443a-84bf-abe3e21e7007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:54.066813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6e543ea2-e076-443a-84bf-abe3e21e7007 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:40:54.068022 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6e543ea2-e076-443a-84bf-abe3e21e7007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:54.163894 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 665/1319] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:40:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:40:54.203149 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66971a08-f2c1-416a-9b3a-e8cf69b6b3ea None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:40:54.204733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-66971a08-f2c1-416a-9b3a-e8cf69b6b3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:54.312150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66971a08-f2c1-416a-9b3a-e8cf69b6b3ea None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:40:54.388324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c639f0-0296-4947-9c95-a74d5d7302ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:40:54.389261 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c639f0-0296-4947-9c95-a74d5d7302ce service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:54.389551 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c639f0-0296-4947-9c95-a74d5d7302ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:54.389820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c639f0-0296-4947-9c95-a74d5d7302ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:54.391500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a4c639f0-0296-4947-9c95-a74d5d7302ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:54.503631 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c639f0-0296-4947-9c95-a74d5d7302ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:40:54.505102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c639f0-0296-4947-9c95-a74d5d7302ce service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:40:54.524501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 655/1320] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:40:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:40:57.946835 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41f1a9-06b7-4b62-85a2-b378a5e90fd7 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:57.947400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41f1a9-06b7-4b62-85a2-b378a5e90fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:57.947400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41f1a9-06b7-4b62-85a2-b378a5e90fd7 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:57.948838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 666/1321] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:40:57.954139 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef778e71-85d3-4b06-90d1-acf5122d8659 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:57.954628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef778e71-85d3-4b06-90d1-acf5122d8659 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:57.954720 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef778e71-85d3-4b06-90d1-acf5122d8659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:58.017645 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ef778e71-85d3-4b06-90d1-acf5122d8659 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:40:58.018867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ef778e71-85d3-4b06-90d1-acf5122d8659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:58.112771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 656/1322] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:40:58.165398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037caeb-b4ab-4207-95b2-c05531fc7785 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:58.165681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037caeb-b4ab-4207-95b2-c05531fc7785 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:58.165955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037caeb-b4ab-4207-95b2-c05531fc7785 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:58.167373 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 667/1323] 10.222.0.81 () {54 vars in 964 bytes} [Wed May 4 17:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:40:58.174547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281d0fd-6490-4670-8728-eeb615e50aab None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:58.175028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281d0fd-6490-4670-8728-eeb615e50aab None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:58.175311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281d0fd-6490-4670-8728-eeb615e50aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:58.247774 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c281d0fd-6490-4670-8728-eeb615e50aab None None] MFA Rules not processed for user `96f0feac2b384b509bc9f75b92b4df95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:40:58.248923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c281d0fd-6490-4670-8728-eeb615e50aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:58.323072 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 657/1324] 10.222.0.81 () {58 vars in 1061 bytes} [Wed May 4 17:40:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:40:58.332548 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037caeb-b4ab-4207-95b2-c05531fc7785 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:40:58.334068 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c037caeb-b4ab-4207-95b2-c05531fc7785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:58.436688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037caeb-b4ab-4207-95b2-c05531fc7785 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:40:58.508982 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a73aa9-fa7f-469d-95ac-1bd7958715ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:40:58.509542 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a73aa9-fa7f-469d-95ac-1bd7958715ae service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:40:58.509822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a73aa9-fa7f-469d-95ac-1bd7958715ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:40:58.510092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a73aa9-fa7f-469d-95ac-1bd7958715ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:40:58.512225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c8a73aa9-fa7f-469d-95ac-1bd7958715ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:40:58.620245 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a73aa9-fa7f-469d-95ac-1bd7958715ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:40:58.622048 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a73aa9-fa7f-469d-95ac-1bd7958715ae service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:40:58.644455 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 668/1325] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:41:01.394903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2e620-8f02-4f2d-84ae-64c0e7df0bd2 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:01.395429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2e620-8f02-4f2d-84ae-64c0e7df0bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:01.395537 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2e620-8f02-4f2d-84ae-64c0e7df0bd2 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:01.397114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 658/1326] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:01.402177 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e0ec8-627d-4cda-a24d-56f8ca4c7618 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:01.402846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e0ec8-627d-4cda-a24d-56f8ca4c7618 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:01.402846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e0ec8-627d-4cda-a24d-56f8ca4c7618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:01.468017 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e11e0ec8-627d-4cda-a24d-56f8ca4c7618 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:01.469256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e11e0ec8-627d-4cda-a24d-56f8ca4c7618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:01.568949 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 669/1327] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:01.604500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2e620-8f02-4f2d-84ae-64c0e7df0bd2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:41:01.607128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d9a2e620-8f02-4f2d-84ae-64c0e7df0bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:01.717829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2e620-8f02-4f2d-84ae-64c0e7df0bd2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:41:01.793171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380afc5-5254-41c6-85ea-0680c66acb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:41:01.793895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380afc5-5254-41c6-85ea-0680c66acb53 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:01.794190 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380afc5-5254-41c6-85ea-0680c66acb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:01.794470 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380afc5-5254-41c6-85ea-0680c66acb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:01.796157 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2380afc5-5254-41c6-85ea-0680c66acb53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:01.906429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380afc5-5254-41c6-85ea-0680c66acb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:41:01.907845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380afc5-5254-41c6-85ea-0680c66acb53 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:41:01.926703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 659/1328] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:41:04.287502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d549c38-7123-4e4c-b4b9-e89ba50627c7 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:04.288075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d549c38-7123-4e4c-b4b9-e89ba50627c7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:04.288075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d549c38-7123-4e4c-b4b9-e89ba50627c7 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:04.289444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 670/1329] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:04.295231 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb34335-0704-4a3c-bef0-1b2e503b147c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:04.295652 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb34335-0704-4a3c-bef0-1b2e503b147c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:04.295792 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb34335-0704-4a3c-bef0-1b2e503b147c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:04.360736 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-cdb34335-0704-4a3c-bef0-1b2e503b147c None None] MFA Rules not processed for user `9abe5470480046e6b6be3b0a0f16332b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:04.361957 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cdb34335-0704-4a3c-bef0-1b2e503b147c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:04.455693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 660/1330] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:41:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:04.499070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d549c38-7123-4e4c-b4b9-e89ba50627c7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:41:04.500678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1d549c38-7123-4e4c-b4b9-e89ba50627c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:04.606230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d549c38-7123-4e4c-b4b9-e89ba50627c7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:41:04.678443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b137bb4-08e2-4562-a8cb-cdcc2b733b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:41:04.679094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b137bb4-08e2-4562-a8cb-cdcc2b733b1b service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:04.679375 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b137bb4-08e2-4562-a8cb-cdcc2b733b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:04.679646 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b137bb4-08e2-4562-a8cb-cdcc2b733b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:04.681344 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3b137bb4-08e2-4562-a8cb-cdcc2b733b1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:04.796358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b137bb4-08e2-4562-a8cb-cdcc2b733b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:41:04.797828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b137bb4-08e2-4562-a8cb-cdcc2b733b1b service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:41:04.815537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 671/1331] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:41:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:41:07.835466 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c075252-74e5-4494-996e-ad05f48fc8ae None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:07.836101 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c075252-74e5-4494-996e-ad05f48fc8ae None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:07.836101 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c075252-74e5-4494-996e-ad05f48fc8ae None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:07.837327 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 661/1332] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:07.843097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881be4a-fa56-4064-a528-192119437edb None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:07.843577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881be4a-fa56-4064-a528-192119437edb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:07.843577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881be4a-fa56-4064-a528-192119437edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:07.913495 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3881be4a-fa56-4064-a528-192119437edb None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:07.914700 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3881be4a-fa56-4064-a528-192119437edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:08.010467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 672/1333] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:08.047420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c075252-74e5-4494-996e-ad05f48fc8ae None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:41:08.049022 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4c075252-74e5-4494-996e-ad05f48fc8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:08.150724 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c075252-74e5-4494-996e-ad05f48fc8ae None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:41:08.349900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb1286-33bf-448f-8323-dace90019b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:41:08.350547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb1286-33bf-448f-8323-dace90019b53 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:08.350829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb1286-33bf-448f-8323-dace90019b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:08.351101 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb1286-33bf-448f-8323-dace90019b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:08.352769 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ebfb1286-33bf-448f-8323-dace90019b53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:08.459707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb1286-33bf-448f-8323-dace90019b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:41:08.461201 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb1286-33bf-448f-8323-dace90019b53 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:41:08.482417 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 662/1334] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:41:10.898948 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb11459-d3a3-4e89-b082-76652fecc181 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:10.899489 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb11459-d3a3-4e89-b082-76652fecc181 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:10.899614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb11459-d3a3-4e89-b082-76652fecc181 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:10.901002 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 673/1335] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:10.907540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6af0d-50a1-4294-934f-bcb90520b16e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:10.908020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6af0d-50a1-4294-934f-bcb90520b16e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:10.908116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6af0d-50a1-4294-934f-bcb90520b16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:10.972903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6ad6af0d-50a1-4294-934f-bcb90520b16e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:10.974122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6ad6af0d-50a1-4294-934f-bcb90520b16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:11.076240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 663/1336] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:11.119645 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb11459-d3a3-4e89-b082-76652fecc181 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:41:11.121553 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9cb11459-d3a3-4e89-b082-76652fecc181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:11.226832 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb11459-d3a3-4e89-b082-76652fecc181 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:41:11.298567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6ec11-54e6-4caf-83aa-46f324e8c668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:41:11.299210 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6ec11-54e6-4caf-83aa-46f324e8c668 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:11.299491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6ec11-54e6-4caf-83aa-46f324e8c668 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:11.299767 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6ec11-54e6-4caf-83aa-46f324e8c668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:11.301450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-00c6ec11-54e6-4caf-83aa-46f324e8c668 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:11.407766 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6ec11-54e6-4caf-83aa-46f324e8c668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:41:11.409236 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6ec11-54e6-4caf-83aa-46f324e8c668 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:41:11.428005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 674/1337] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:41:14.381979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c8256-b936-419d-ba06-6797919f14b0 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:14.382486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c8256-b936-419d-ba06-6797919f14b0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:14.382579 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c8256-b936-419d-ba06-6797919f14b0 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:14.383870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 664/1338] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:14.389875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565a7ef-93ae-4506-a837-340f7291cb3e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:14.391307 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565a7ef-93ae-4506-a837-340f7291cb3e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:14.391307 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565a7ef-93ae-4506-a837-340f7291cb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:14.459664 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5565a7ef-93ae-4506-a837-340f7291cb3e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:14.460878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5565a7ef-93ae-4506-a837-340f7291cb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:14.565732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 675/1339] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:41:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:14.601924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c8256-b936-419d-ba06-6797919f14b0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:41:14.604037 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2d3c8256-b936-419d-ba06-6797919f14b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:14.698073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c8256-b936-419d-ba06-6797919f14b0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:41:14.702394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ec1c3-0f8f-4ae6-823b-0ac405ea624d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:41:14.703038 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ec1c3-0f8f-4ae6-823b-0ac405ea624d service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:14.703322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ec1c3-0f8f-4ae6-823b-0ac405ea624d service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:14.703602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ec1c3-0f8f-4ae6-823b-0ac405ea624d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:14.712425 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ec1c3-0f8f-4ae6-823b-0ac405ea624d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:41:14.713868 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ec1c3-0f8f-4ae6-823b-0ac405ea624d service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:41:14.723177 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 665/1340] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:41:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:41:19.414386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb95dcb-ef64-4e8f-807b-98bd93215a47 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:19.414962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb95dcb-ef64-4e8f-807b-98bd93215a47 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:19.414962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb95dcb-ef64-4e8f-807b-98bd93215a47 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:19.416300 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 676/1341] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:19.422173 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81e3bc-037f-4a90-82ea-d3cd1b65f944 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:19.422580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81e3bc-037f-4a90-82ea-d3cd1b65f944 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:19.422739 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81e3bc-037f-4a90-82ea-d3cd1b65f944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:19.452975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3a81e3bc-037f-4a90-82ea-d3cd1b65f944 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:19.454121 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3a81e3bc-037f-4a90-82ea-d3cd1b65f944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:19.529468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 666/1342] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:19.569837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb95dcb-ef64-4e8f-807b-98bd93215a47 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:41:19.580282 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb95dcb-ef64-4e8f-807b-98bd93215a47 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:41:19.583747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb0526-625b-4354-a5a0-0bfb59aeae58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:41:19.584366 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb0526-625b-4354-a5a0-0bfb59aeae58 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:19.584688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb0526-625b-4354-a5a0-0bfb59aeae58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:19.585017 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb0526-625b-4354-a5a0-0bfb59aeae58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:19.594058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb0526-625b-4354-a5a0-0bfb59aeae58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:41:19.595467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb0526-625b-4354-a5a0-0bfb59aeae58 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:41:19.605304 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 677/1343] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:41:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:41:22.977652 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e341a8-3f5d-42c2-97eb-195c91059b36 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:22.978224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e341a8-3f5d-42c2-97eb-195c91059b36 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:22.978224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e341a8-3f5d-42c2-97eb-195c91059b36 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:22.979661 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 667/1344] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:22.986580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8392c7-af98-4774-b111-40d6d5f69fca None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:22.987115 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8392c7-af98-4774-b111-40d6d5f69fca None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:22.987115 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8392c7-af98-4774-b111-40d6d5f69fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:23.006067 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-de8392c7-af98-4774-b111-40d6d5f69fca None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:23.007405 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-de8392c7-af98-4774-b111-40d6d5f69fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:23.016143 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 678/1345] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:41:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:23.056507 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e341a8-3f5d-42c2-97eb-195c91059b36 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:41:23.068292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e341a8-3f5d-42c2-97eb-195c91059b36 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:41:23.072979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3436d6-bbab-4b81-b74c-a8ccc3483a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:41:23.074682 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3436d6-bbab-4b81-b74c-a8ccc3483a16 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:23.075224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3436d6-bbab-4b81-b74c-a8ccc3483a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:23.075673 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3436d6-bbab-4b81-b74c-a8ccc3483a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:23.094875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3436d6-bbab-4b81-b74c-a8ccc3483a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:41:23.096348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3436d6-bbab-4b81-b74c-a8ccc3483a16 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:41:23.109924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 668/1346] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:41:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:41:27.758308 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112698a-f384-443e-bae6-a6c0992fdb84 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:27.759120 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112698a-f384-443e-bae6-a6c0992fdb84 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:27.759120 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112698a-f384-443e-bae6-a6c0992fdb84 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:27.761343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 679/1347] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:27.767933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dcb9e-bf81-4305-aba3-1aad4f2a71ac None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:27.768758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dcb9e-bf81-4305-aba3-1aad4f2a71ac None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:27.768758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dcb9e-bf81-4305-aba3-1aad4f2a71ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:27.788725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7e8dcb9e-bf81-4305-aba3-1aad4f2a71ac None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:27.789937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7e8dcb9e-bf81-4305-aba3-1aad4f2a71ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:27.798214 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 669/1348] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:27.842921 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112698a-f384-443e-bae6-a6c0992fdb84 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:41:27.846506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e112698a-f384-443e-bae6-a6c0992fdb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:27.860016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112698a-f384-443e-bae6-a6c0992fdb84 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:41:27.865485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec83050-4c15-4f60-80ba-8b537be20647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:41:27.866133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec83050-4c15-4f60-80ba-8b537be20647 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:27.866407 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec83050-4c15-4f60-80ba-8b537be20647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:27.866674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec83050-4c15-4f60-80ba-8b537be20647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:27.877183 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec83050-4c15-4f60-80ba-8b537be20647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:41:27.878619 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec83050-4c15-4f60-80ba-8b537be20647 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:41:27.889909 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 680/1349] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:41:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:41:33.667555 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e52da6-c34d-4c84-a67e-5b430d49ecc4 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:33.668465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e52da6-c34d-4c84-a67e-5b430d49ecc4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:33.668910 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e52da6-c34d-4c84-a67e-5b430d49ecc4 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:33.670473 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 670/1350] 10.222.0.81 () {54 vars in 921 bytes} [Wed May 4 17:41:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:33.677176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef048d4d-da59-457f-aae4-1f70b50f0d8e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:33.678163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef048d4d-da59-457f-aae4-1f70b50f0d8e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:33.678644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef048d4d-da59-457f-aae4-1f70b50f0d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:33.763335 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ef048d4d-da59-457f-aae4-1f70b50f0d8e None None] MFA Rules not processed for user `4ff8c001247c43ccbc4ccb26daa17201`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:33.764815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ef048d4d-da59-457f-aae4-1f70b50f0d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:33.886323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 681/1351] 10.222.0.81 () {58 vars in 1018 bytes} [Wed May 4 17:41:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:38.351628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebed6d-de4c-4e36-b25a-d8afabb93dde None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:38.352244 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebed6d-de4c-4e36-b25a-d8afabb93dde None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:38.352378 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebed6d-de4c-4e36-b25a-d8afabb93dde None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:38.355062 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 671/1352] 10.222.0.81 () {54 vars in 921 bytes} [Wed May 4 17:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:38.361262 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904a45f-99b6-401d-8996-7cee57fadd0f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:38.362096 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904a45f-99b6-401d-8996-7cee57fadd0f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:38.362527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904a45f-99b6-401d-8996-7cee57fadd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:38.386506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a904a45f-99b6-401d-8996-7cee57fadd0f None None] MFA Rules not processed for user `4ff8c001247c43ccbc4ccb26daa17201`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:38.389656 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a904a45f-99b6-401d-8996-7cee57fadd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:38.403501 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 682/1353] 10.222.0.81 () {58 vars in 1018 bytes} [Wed May 4 17:41:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:39.921723 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4869c1b-4a78-40ab-baa4-3265f84887ba None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:39.922262 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4869c1b-4a78-40ab-baa4-3265f84887ba None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:39.922262 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4869c1b-4a78-40ab-baa4-3265f84887ba None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:39.923793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 672/1354] 10.222.0.81 () {54 vars in 921 bytes} [Wed May 4 17:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:39.929401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2947c6-a568-4df0-96ec-60096134b584 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:39.929855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2947c6-a568-4df0-96ec-60096134b584 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:39.929954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2947c6-a568-4df0-96ec-60096134b584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:39.949665 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4d2947c6-a568-4df0-96ec-60096134b584 None None] MFA Rules not processed for user `4ff8c001247c43ccbc4ccb26daa17201`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:39.950865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4d2947c6-a568-4df0-96ec-60096134b584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:39.960008 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 683/1355] 10.222.0.81 () {58 vars in 1018 bytes} [Wed May 4 17:41:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:43.813369 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25d2cc-b41e-4756-a92f-8bc8668057bd None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:43.814814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25d2cc-b41e-4756-a92f-8bc8668057bd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:43.815096 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25d2cc-b41e-4756-a92f-8bc8668057bd None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:43.816859 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 673/1356] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:41:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:43.824076 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421095d5-40cf-444b-b985-5fe6a0f616ae None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:43.824659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421095d5-40cf-444b-b985-5fe6a0f616ae None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:43.825032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421095d5-40cf-444b-b985-5fe6a0f616ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:43.846501 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-421095d5-40cf-444b-b985-5fe6a0f616ae None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:43.847594 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-421095d5-40cf-444b-b985-5fe6a0f616ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:43.857323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 684/1357] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:43.907484 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfb647-e54f-4548-a0de-eefe44bb94cf None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:43.907761 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfb647-e54f-4548-a0de-eefe44bb94cf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:43.908219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfb647-e54f-4548-a0de-eefe44bb94cf None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:43.909566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 674/1358] 10.222.0.81 () {54 vars in 960 bytes} [Wed May 4 17:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:43.915222 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248d003-fb22-4691-b500-90622adc8cdb None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:43.915616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248d003-fb22-4691-b500-90622adc8cdb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:43.916132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248d003-fb22-4691-b500-90622adc8cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:43.965984 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0248d003-fb22-4691-b500-90622adc8cdb None None] MFA Rules not processed for user `d4a073d8f47a485cbb22db01530f3b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:43.967305 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0248d003-fb22-4691-b500-90622adc8cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:44.049965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 685/1359] 10.222.0.81 () {58 vars in 1057 bytes} [Wed May 4 17:41:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:44.058067 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfb647-e54f-4548-a0de-eefe44bb94cf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:41:44.074814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfb647-e54f-4548-a0de-eefe44bb94cf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:41:44.080693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b9bb5-bdcf-49b6-971c-4f8ff0df5e17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:41:44.081690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b9bb5-bdcf-49b6-971c-4f8ff0df5e17 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:44.082236 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b9bb5-bdcf-49b6-971c-4f8ff0df5e17 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:44.083108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b9bb5-bdcf-49b6-971c-4f8ff0df5e17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:44.092692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b9bb5-bdcf-49b6-971c-4f8ff0df5e17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:41:44.094960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b9bb5-bdcf-49b6-971c-4f8ff0df5e17 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:41:44.114070 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 675/1360] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:41:46.614976 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846c439-74a2-46e4-b56f-bd972df52c3b None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:46.615480 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846c439-74a2-46e4-b56f-bd972df52c3b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:46.615480 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846c439-74a2-46e4-b56f-bd972df52c3b None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:46.616835 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 686/1361] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:46.622747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b7af1-12e9-42ff-b2bb-b0f6b7cf3d43 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:46.623179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b7af1-12e9-42ff-b2bb-b0f6b7cf3d43 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:46.623294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b7af1-12e9-42ff-b2bb-b0f6b7cf3d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:46.641298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-890b7af1-12e9-42ff-b2bb-b0f6b7cf3d43 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:46.642505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-890b7af1-12e9-42ff-b2bb-b0f6b7cf3d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:46.651818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 676/1362] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:46.696921 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846c439-74a2-46e4-b56f-bd972df52c3b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:41:46.711788 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846c439-74a2-46e4-b56f-bd972df52c3b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:41:46.717968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b235ef-fe35-405d-871a-8b1fbe3306be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:41:46.718606 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b235ef-fe35-405d-871a-8b1fbe3306be service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:46.718890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b235ef-fe35-405d-871a-8b1fbe3306be service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:46.719176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b235ef-fe35-405d-871a-8b1fbe3306be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:46.727810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b235ef-fe35-405d-871a-8b1fbe3306be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:41:46.730046 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b235ef-fe35-405d-871a-8b1fbe3306be service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:41:46.740775 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 687/1363] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:41:49.465312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5936051-c5e0-4f01-9258-f79247a75b44 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:49.465312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5936051-c5e0-4f01-9258-f79247a75b44 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:49.465312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5936051-c5e0-4f01-9258-f79247a75b44 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:49.465312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 677/1364] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:49.469030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2e2a3-7c59-4ce4-9190-40a15f9cadd2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:49.469517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2e2a3-7c59-4ce4-9190-40a15f9cadd2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:49.470036 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2e2a3-7c59-4ce4-9190-40a15f9cadd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:49.490087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c6c2e2a3-7c59-4ce4-9190-40a15f9cadd2 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:49.494055 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c6c2e2a3-7c59-4ce4-9190-40a15f9cadd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:49.499890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 688/1365] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:41:49.545456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cad390-3e66-4e98-bbac-4e0ef5831989 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:49.545768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cad390-3e66-4e98-bbac-4e0ef5831989 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:49.545998 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cad390-3e66-4e98-bbac-4e0ef5831989 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:49.547315 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 678/1366] 10.222.0.81 () {54 vars in 960 bytes} [Wed May 4 17:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:49.552503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a566a-e831-44fe-931f-f1b26e473021 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:49.552796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a566a-e831-44fe-931f-f1b26e473021 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:49.553101 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a566a-e831-44fe-931f-f1b26e473021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:49.571803 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9b9a566a-e831-44fe-931f-f1b26e473021 None None] MFA Rules not processed for user `d4a073d8f47a485cbb22db01530f3b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:49.573821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9b9a566a-e831-44fe-931f-f1b26e473021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:49.582845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 689/1367] 10.222.0.81 () {58 vars in 1057 bytes} [Wed May 4 17:41:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:41:49.592050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cad390-3e66-4e98-bbac-4e0ef5831989 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:41:49.606095 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cad390-3e66-4e98-bbac-4e0ef5831989 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:41:49.611433 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2945a-14ac-485a-9025-cd55841fb777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:41:49.612052 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2945a-14ac-485a-9025-cd55841fb777 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:49.612328 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2945a-14ac-485a-9025-cd55841fb777 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:49.612631 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2945a-14ac-485a-9025-cd55841fb777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:49.620520 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2945a-14ac-485a-9025-cd55841fb777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:41:49.622074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2945a-14ac-485a-9025-cd55841fb777 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:41:49.631143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 679/1368] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:41:52.114634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6b6e7-d45a-4090-9a99-a5465f1a3d15 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:52.115533 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6b6e7-d45a-4090-9a99-a5465f1a3d15 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:52.115806 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6b6e7-d45a-4090-9a99-a5465f1a3d15 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:52.120569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 690/1369] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:41:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:52.123132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a58636-5547-46f3-9624-b3f3743f334e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:52.123889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a58636-5547-46f3-9624-b3f3743f334e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:52.124167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a58636-5547-46f3-9624-b3f3743f334e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:52.142002 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a3a58636-5547-46f3-9624-b3f3743f334e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:52.145085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a3a58636-5547-46f3-9624-b3f3743f334e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:52.152171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 680/1370] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:52.198450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6b6e7-d45a-4090-9a99-a5465f1a3d15 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:41:52.205607 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04fabe-8597-44f4-b232-d3c38054f0ca None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:52.205895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04fabe-8597-44f4-b232-d3c38054f0ca None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:52.206348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04fabe-8597-44f4-b232-d3c38054f0ca None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:52.207902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 681/1371] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:41:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:52.215129 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9e5f1-b6b5-4d0f-89c7-129a4c6c0597 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:52.215567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9e5f1-b6b5-4d0f-89c7-129a4c6c0597 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:52.215848 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9e5f1-b6b5-4d0f-89c7-129a4c6c0597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:52.218052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6b6e7-d45a-4090-9a99-a5465f1a3d15 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:41:52.223941 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c9ca7-73d8-4705-95e0-25c116e914a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:41:52.224638 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c9ca7-73d8-4705-95e0-25c116e914a5 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:52.224920 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c9ca7-73d8-4705-95e0-25c116e914a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:52.225195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c9ca7-73d8-4705-95e0-25c116e914a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:52.234975 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c9ca7-73d8-4705-95e0-25c116e914a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:41:52.235704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-13a9e5f1-b6b5-4d0f-89c7-129a4c6c0597 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:52.236642 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c9ca7-73d8-4705-95e0-25c116e914a5 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:41:52.236960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-13a9e5f1-b6b5-4d0f-89c7-129a4c6c0597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:52.245411 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 682/1372] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:41:52.248063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 691/1373] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:41:52.561872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f96f7e-652d-427e-9e77-e8288f0a6865 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:52.562165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f96f7e-652d-427e-9e77-e8288f0a6865 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:52.562440 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f96f7e-652d-427e-9e77-e8288f0a6865 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:52.563966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 683/1374] 10.222.0.81 () {54 vars in 963 bytes} [Wed May 4 17:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:52.570138 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88615bc9-a235-4062-9264-2e14e52aad88 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:52.570481 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88615bc9-a235-4062-9264-2e14e52aad88 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:52.571104 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88615bc9-a235-4062-9264-2e14e52aad88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:52.625717 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-88615bc9-a235-4062-9264-2e14e52aad88 None None] MFA Rules not processed for user `4f22b09c1ffc4006a4b47ba882c55f80`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:52.627020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-88615bc9-a235-4062-9264-2e14e52aad88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:52.688470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 692/1375] 10.222.0.81 () {58 vars in 1060 bytes} [Wed May 4 17:41:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:52.695881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f96f7e-652d-427e-9e77-e8288f0a6865 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:41:52.706933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f96f7e-652d-427e-9e77-e8288f0a6865 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:41:52.711099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4415ca8-34a8-4d73-8018-1fe2c4b9583c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:41:52.711859 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4415ca8-34a8-4d73-8018-1fe2c4b9583c service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:52.712240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4415ca8-34a8-4d73-8018-1fe2c4b9583c service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:52.713283 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4415ca8-34a8-4d73-8018-1fe2c4b9583c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:52.723685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4415ca8-34a8-4d73-8018-1fe2c4b9583c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:41:52.725523 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4415ca8-34a8-4d73-8018-1fe2c4b9583c service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:41:52.736803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 684/1376] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:41:54.684037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd65dba-5430-4517-bd59-c946e0485261 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:54.684997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd65dba-5430-4517-bd59-c946e0485261 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:54.684997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd65dba-5430-4517-bd59-c946e0485261 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:54.685990 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 693/1377] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:54.691506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd312855-dccf-472d-9ef3-676d5b016c77 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:54.691986 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd312855-dccf-472d-9ef3-676d5b016c77 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:54.692103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd312855-dccf-472d-9ef3-676d5b016c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:54.709812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fd312855-dccf-472d-9ef3-676d5b016c77 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:54.711008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fd312855-dccf-472d-9ef3-676d5b016c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:54.720629 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 685/1378] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:54.766377 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd65dba-5430-4517-bd59-c946e0485261 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:41:54.781100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd65dba-5430-4517-bd59-c946e0485261 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:41:54.786697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2607c8e-61ee-408b-af40-aab788b195d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:41:54.787338 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2607c8e-61ee-408b-af40-aab788b195d4 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:54.787616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2607c8e-61ee-408b-af40-aab788b195d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:54.787887 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2607c8e-61ee-408b-af40-aab788b195d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:54.797040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2607c8e-61ee-408b-af40-aab788b195d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:41:54.798706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2607c8e-61ee-408b-af40-aab788b195d4 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:41:54.810900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 694/1379] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:41:57.285322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f190d-23c4-4f2f-8786-19e370e2245d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:57.286395 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f190d-23c4-4f2f-8786-19e370e2245d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:57.286894 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f190d-23c4-4f2f-8786-19e370e2245d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:57.288518 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 686/1380] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:41:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:57.293653 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b680a9-f9d9-4957-99f3-8f8479070cc0 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:57.294077 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b680a9-f9d9-4957-99f3-8f8479070cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:57.294196 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b680a9-f9d9-4957-99f3-8f8479070cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:57.312602 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-39b680a9-f9d9-4957-99f3-8f8479070cc0 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:57.314016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-39b680a9-f9d9-4957-99f3-8f8479070cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:57.322671 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 695/1381] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:57.368160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f190d-23c4-4f2f-8786-19e370e2245d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:41:57.383345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f190d-23c4-4f2f-8786-19e370e2245d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:41:57.389954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21027405-9533-4c17-87a9-04c5eeff04bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:41:57.390703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21027405-9533-4c17-87a9-04c5eeff04bf service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:57.391090 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21027405-9533-4c17-87a9-04c5eeff04bf service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:57.391488 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21027405-9533-4c17-87a9-04c5eeff04bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:57.400312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21027405-9533-4c17-87a9-04c5eeff04bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:41:57.402314 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21027405-9533-4c17-87a9-04c5eeff04bf service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:41:57.412788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 687/1382] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:41:59.863302 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1787a-4d2e-4ece-94ac-972cfb880049 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:59.863871 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1787a-4d2e-4ece-94ac-972cfb880049 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:59.863871 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1787a-4d2e-4ece-94ac-972cfb880049 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:59.865242 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 696/1383] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:41:59.871327 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ccbeb-e2be-4d3b-87c1-3b08577ba88a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:59.871781 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ccbeb-e2be-4d3b-87c1-3b08577ba88a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:59.871878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ccbeb-e2be-4d3b-87c1-3b08577ba88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:59.890746 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ff9ccbeb-e2be-4d3b-87c1-3b08577ba88a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:41:59.892868 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ff9ccbeb-e2be-4d3b-87c1-3b08577ba88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:41:59.903681 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 688/1384] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:41:59.958381 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1787a-4d2e-4ece-94ac-972cfb880049 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:41:59.974026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1787a-4d2e-4ece-94ac-972cfb880049 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:41:59.985511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb5d7-f8c9-442e-a300-337bbac70323 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:41:59.986220 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb5d7-f8c9-442e-a300-337bbac70323 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:41:59.986555 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb5d7-f8c9-442e-a300-337bbac70323 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:41:59.986888 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb5d7-f8c9-442e-a300-337bbac70323 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:41:59.999394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971eb5d7-f8c9-442e-a300-337bbac70323 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:00.001215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971eb5d7-f8c9-442e-a300-337bbac70323 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:00.015580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 697/1385] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:02.387805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f30ed4-0a11-4f6e-aac0-b5882fe3f667 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:02.388334 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f30ed4-0a11-4f6e-aac0-b5882fe3f667 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:02.388537 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f30ed4-0a11-4f6e-aac0-b5882fe3f667 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:02.390673 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 689/1386] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:42:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:02.395979 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e3614-233f-437f-b228-d00b52368d0c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:02.396702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e3614-233f-437f-b228-d00b52368d0c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:02.396702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e3614-233f-437f-b228-d00b52368d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:02.414760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-509e3614-233f-437f-b228-d00b52368d0c None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:02.416279 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-509e3614-233f-437f-b228-d00b52368d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:02.424045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 698/1387] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:02.469437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f30ed4-0a11-4f6e-aac0-b5882fe3f667 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:02.487650 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f30ed4-0a11-4f6e-aac0-b5882fe3f667 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:02.495283 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b6426-0ca1-4f70-8e6b-77c1e520b11a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:02.496153 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b6426-0ca1-4f70-8e6b-77c1e520b11a service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:02.496540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b6426-0ca1-4f70-8e6b-77c1e520b11a service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:02.496909 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b6426-0ca1-4f70-8e6b-77c1e520b11a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:02.507628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b6426-0ca1-4f70-8e6b-77c1e520b11a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:02.510431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b6426-0ca1-4f70-8e6b-77c1e520b11a service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:02.522193 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 690/1388] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:05.554200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5ca5b-621c-4d7f-8b3c-d12902c6bdc0 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:05.554871 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5ca5b-621c-4d7f-8b3c-d12902c6bdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:05.554871 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5ca5b-621c-4d7f-8b3c-d12902c6bdc0 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:05.556982 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 699/1389] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:05.564040 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99497ae-3fcb-48d3-b69b-fa2b963fe880 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:05.564577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99497ae-3fcb-48d3-b69b-fa2b963fe880 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:05.564680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99497ae-3fcb-48d3-b69b-fa2b963fe880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:05.587371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b99497ae-3fcb-48d3-b69b-fa2b963fe880 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:05.588841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b99497ae-3fcb-48d3-b69b-fa2b963fe880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:05.597636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 691/1390] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:05.646766 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5ca5b-621c-4d7f-8b3c-d12902c6bdc0 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:05.661968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5ca5b-621c-4d7f-8b3c-d12902c6bdc0 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:05.667641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def62f1-9fe6-4c9e-bdcf-1cfbdab56c2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:05.668454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def62f1-9fe6-4c9e-bdcf-1cfbdab56c2e service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:05.668748 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def62f1-9fe6-4c9e-bdcf-1cfbdab56c2e service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:05.669024 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def62f1-9fe6-4c9e-bdcf-1cfbdab56c2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:05.677589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def62f1-9fe6-4c9e-bdcf-1cfbdab56c2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:05.679216 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def62f1-9fe6-4c9e-bdcf-1cfbdab56c2e service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:05.689222 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 700/1391] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:08.192462 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc6cbd-b8bc-4a5f-8ab6-84a15332057d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:08.193067 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc6cbd-b8bc-4a5f-8ab6-84a15332057d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:08.193067 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc6cbd-b8bc-4a5f-8ab6-84a15332057d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:08.194363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 692/1392] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:08.200083 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c211cd-533f-4ed6-99a4-3495cec46647 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:08.200536 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c211cd-533f-4ed6-99a4-3495cec46647 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:08.200688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c211cd-533f-4ed6-99a4-3495cec46647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:08.218684 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b0c211cd-533f-4ed6-99a4-3495cec46647 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:08.219874 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b0c211cd-533f-4ed6-99a4-3495cec46647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:08.227773 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 701/1393] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:08.272403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc6cbd-b8bc-4a5f-8ab6-84a15332057d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:08.287270 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc6cbd-b8bc-4a5f-8ab6-84a15332057d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:08.293345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3e156-81c9-4dec-ab45-df98ded53324 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:08.293995 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3e156-81c9-4dec-ab45-df98ded53324 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:08.294279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3e156-81c9-4dec-ab45-df98ded53324 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:08.294554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3e156-81c9-4dec-ab45-df98ded53324 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:08.302754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3e156-81c9-4dec-ab45-df98ded53324 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:08.308349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3e156-81c9-4dec-ab45-df98ded53324 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:08.314439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 693/1394] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:09.050053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6e92d-d67d-4db7-a26a-e2c5f9750067 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:09.050441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6e92d-d67d-4db7-a26a-e2c5f9750067 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:09.050758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6e92d-d67d-4db7-a26a-e2c5f9750067 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:09.052183 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 702/1395] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:09.057642 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710d480-c651-4d72-b9c1-3a717d95c53a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:09.057930 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710d480-c651-4d72-b9c1-3a717d95c53a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:09.058203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710d480-c651-4d72-b9c1-3a717d95c53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:09.076399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0710d480-c651-4d72-b9c1-3a717d95c53a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:09.078194 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0710d480-c651-4d72-b9c1-3a717d95c53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:09.085438 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 694/1396] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:09.142021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5224ed-d51d-4a2c-9e71-c9a8c78319e7 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:09.142309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5224ed-d51d-4a2c-9e71-c9a8c78319e7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:09.142623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5224ed-d51d-4a2c-9e71-c9a8c78319e7 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:09.143980 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 703/1397] 10.222.0.81 () {54 vars in 962 bytes} [Wed May 4 17:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:09.149038 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1bfb2-eb62-4f02-84e0-f0381b909d63 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:09.149387 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1bfb2-eb62-4f02-84e0-f0381b909d63 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:09.150637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1bfb2-eb62-4f02-84e0-f0381b909d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:09.198361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bfb1bfb2-eb62-4f02-84e0-f0381b909d63 None None] MFA Rules not processed for user `ec8e2eb70a5d4dd1b3a9bec2bd0a78a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:09.199580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bfb1bfb2-eb62-4f02-84e0-f0381b909d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:09.259528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 695/1398] 10.222.0.81 () {58 vars in 1059 bytes} [Wed May 4 17:42:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:09.267008 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5224ed-d51d-4a2c-9e71-c9a8c78319e7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:09.277840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5224ed-d51d-4a2c-9e71-c9a8c78319e7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:09.281312 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2871e-3956-45f3-a55f-8854eb230466 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8e2eb70a5d4dd1b3a9bec2bd0a78a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:09.282040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2871e-3956-45f3-a55f-8854eb230466 service glance] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:09.282209 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2871e-3956-45f3-a55f-8854eb230466 service glance] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:09.282476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2871e-3956-45f3-a55f-8854eb230466 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:09.291680 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2871e-3956-45f3-a55f-8854eb230466 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:09.293135 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2871e-3956-45f3-a55f-8854eb230466 service glance] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:09.302545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 704/1399] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:09.909527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae775c3-57b8-4d2b-bfab-11186dd946ba None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:09.909818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae775c3-57b8-4d2b-bfab-11186dd946ba None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:09.910113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae775c3-57b8-4d2b-bfab-11186dd946ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:09.961168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1ae775c3-57b8-4d2b-bfab-11186dd946ba None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:09.962448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1ae775c3-57b8-4d2b-bfab-11186dd946ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:10.026885 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 696/1400] 10.222.0.81 () {58 vars in 1009 bytes} [Wed May 4 17:42:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:10.073276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fcec1-0d0c-4780-b300-ce7fb8358407 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:10.077131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fcec1-0d0c-4780-b300-ce7fb8358407 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:10.077131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fcec1-0d0c-4780-b300-ce7fb8358407 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:10.077131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 705/1401] 10.222.0.81 () {54 vars in 942 bytes} [Wed May 4 17:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:10.081641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038be65-cc9a-4a59-8f99-941e7b1e8000 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:10.081936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038be65-cc9a-4a59-8f99-941e7b1e8000 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:10.082247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038be65-cc9a-4a59-8f99-941e7b1e8000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:10.132319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3038be65-cc9a-4a59-8f99-941e7b1e8000 None None] MFA Rules not processed for user `382e84e110754effa5ffec950f7c1598`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:10.133583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3038be65-cc9a-4a59-8f99-941e7b1e8000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:10.210830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 697/1402] 10.222.0.81 () {58 vars in 1039 bytes} [Wed May 4 17:42:10 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:10.220313 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fcec1-0d0c-4780-b300-ce7fb8358407 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:10.233458 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fcec1-0d0c-4780-b300-ce7fb8358407 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:10.238624 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd5d9e-b5b4-4cf6-b983-74e679009b9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:10.239266 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd5d9e-b5b4-4cf6-b983-74e679009b9d service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:10.239544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd5d9e-b5b4-4cf6-b983-74e679009b9d service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:10.239817 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd5d9e-b5b4-4cf6-b983-74e679009b9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:10.248838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd5d9e-b5b4-4cf6-b983-74e679009b9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:10.250520 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd5d9e-b5b4-4cf6-b983-74e679009b9d service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:10.258483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 706/1403] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 17:42:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 17:42:10.759621 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8158d-2770-406d-a874-f121c11d0b6e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:10.759819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8158d-2770-406d-a874-f121c11d0b6e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:10.760098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8158d-2770-406d-a874-f121c11d0b6e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:10.761618 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 698/1404] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:10.769818 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1fb34-8221-4966-bd13-7217fbbd82fd None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:10.770391 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1fb34-8221-4966-bd13-7217fbbd82fd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:10.770647 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1fb34-8221-4966-bd13-7217fbbd82fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:10.796345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-eea1fb34-8221-4966-bd13-7217fbbd82fd None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:10.797571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-eea1fb34-8221-4966-bd13-7217fbbd82fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:10.807041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 707/1405] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:10.850838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8158d-2770-406d-a874-f121c11d0b6e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:10.867606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8158d-2770-406d-a874-f121c11d0b6e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:10.874962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4cdcc-4d94-405b-afb4-e4ad0f04c9eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:10.875605 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4cdcc-4d94-405b-afb4-e4ad0f04c9eb service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:10.875883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4cdcc-4d94-405b-afb4-e4ad0f04c9eb service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:10.876153 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4cdcc-4d94-405b-afb4-e4ad0f04c9eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:10.885836 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4cdcc-4d94-405b-afb4-e4ad0f04c9eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:10.887410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4cdcc-4d94-405b-afb4-e4ad0f04c9eb service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:10.898107 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 699/1406] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:13.304976 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028a196-0c55-4929-9d9a-db346be58619 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:13.306058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028a196-0c55-4929-9d9a-db346be58619 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:13.306058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028a196-0c55-4929-9d9a-db346be58619 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:13.307443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 708/1407] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:13.312654 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe8d26-5db7-4a1a-8d37-d1ea426127d6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:13.313101 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe8d26-5db7-4a1a-8d37-d1ea426127d6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:13.313202 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe8d26-5db7-4a1a-8d37-d1ea426127d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:13.336510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9bbe8d26-5db7-4a1a-8d37-d1ea426127d6 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:13.338390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9bbe8d26-5db7-4a1a-8d37-d1ea426127d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:13.348666 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 700/1408] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:13.394348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028a196-0c55-4929-9d9a-db346be58619 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:13.411497 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028a196-0c55-4929-9d9a-db346be58619 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:13.418114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097ba82-8cc6-4f5f-806b-2964a4646b1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:13.418763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ba82-8cc6-4f5f-806b-2964a4646b1c service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:13.419040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ba82-8cc6-4f5f-806b-2964a4646b1c service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:13.419313 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ba82-8cc6-4f5f-806b-2964a4646b1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:13.433660 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097ba82-8cc6-4f5f-806b-2964a4646b1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:13.435366 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097ba82-8cc6-4f5f-806b-2964a4646b1c service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:13.446434 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 709/1409] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:35.350402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c9718-0781-4087-bc7b-8fa2b435c797 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:35.350950 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c9718-0781-4087-bc7b-8fa2b435c797 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:35.350950 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c9718-0781-4087-bc7b-8fa2b435c797 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:35.352379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 701/1410] 10.222.0.81 () {54 vars in 918 bytes} [Wed May 4 17:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:35.358011 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f0b2-6a62-40d0-b61f-e7b7efa532d5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:35.358486 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f0b2-6a62-40d0-b61f-e7b7efa532d5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:35.358596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f0b2-6a62-40d0-b61f-e7b7efa532d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:35.375907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7a75f0b2-6a62-40d0-b61f-e7b7efa532d5 None None] MFA Rules not processed for user `4ff8c001247c43ccbc4ccb26daa17201`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:35.377110 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7a75f0b2-6a62-40d0-b61f-e7b7efa532d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:35.385376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 710/1411] 10.222.0.81 () {58 vars in 1015 bytes} [Wed May 4 17:42:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:42:35.399636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd626d1a-d5a8-41f1-9566-eb3666f4352e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:35.400781 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd626d1a-d5a8-41f1-9566-eb3666f4352e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:35.400971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd626d1a-d5a8-41f1-9566-eb3666f4352e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:35.402328 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 702/1412] 10.222.0.81 () {54 vars in 918 bytes} [Wed May 4 17:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:35.406758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5ee8f-1a1b-494b-a6d3-dd955cb9d201 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:35.407040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5ee8f-1a1b-494b-a6d3-dd955cb9d201 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:35.407314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5ee8f-1a1b-494b-a6d3-dd955cb9d201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:35.425576 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e1a5ee8f-1a1b-494b-a6d3-dd955cb9d201 None None] MFA Rules not processed for user `d4a073d8f47a485cbb22db01530f3b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:35.428519 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e1a5ee8f-1a1b-494b-a6d3-dd955cb9d201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:35.436722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 711/1413] 10.222.0.81 () {58 vars in 1015 bytes} [Wed May 4 17:42:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:38.245188 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366449c-23c6-4725-a4ec-27de0f4654f7 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:38.245768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366449c-23c6-4725-a4ec-27de0f4654f7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:38.245768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366449c-23c6-4725-a4ec-27de0f4654f7 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:38.247073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 17:42:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:38.252202 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dec3cd-3337-4469-9443-6c4bfacf1faa None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:38.252640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dec3cd-3337-4469-9443-6c4bfacf1faa None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:38.252783 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dec3cd-3337-4469-9443-6c4bfacf1faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:38.271183 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-86dec3cd-3337-4469-9443-6c4bfacf1faa None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:38.272365 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-86dec3cd-3337-4469-9443-6c4bfacf1faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:38.280069 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 17:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:38.322066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366449c-23c6-4725-a4ec-27de0f4654f7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:38.338539 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366449c-23c6-4725-a4ec-27de0f4654f7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:38.343855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c93cc-0fe6-4daa-8167-cb0e23f19371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:38.344525 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c93cc-0fe6-4daa-8167-cb0e23f19371 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:38.344809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c93cc-0fe6-4daa-8167-cb0e23f19371 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:38.345081 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c93cc-0fe6-4daa-8167-cb0e23f19371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:38.353612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c93cc-0fe6-4daa-8167-cb0e23f19371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:38.355181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c93cc-0fe6-4daa-8167-cb0e23f19371 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:38.364460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 704/1416] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:39.668792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1f8c5-7744-4572-96a7-71ce0d2d051d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:39.669309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1f8c5-7744-4572-96a7-71ce0d2d051d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:39.669309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1f8c5-7744-4572-96a7-71ce0d2d051d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:39.670701 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 17:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:39.675638 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6537bf7-3a3e-4643-83bc-6fadaf91d300 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:39.676072 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6537bf7-3a3e-4643-83bc-6fadaf91d300 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:39.676304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6537bf7-3a3e-4643-83bc-6fadaf91d300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:39.694090 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e6537bf7-3a3e-4643-83bc-6fadaf91d300 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:39.695274 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e6537bf7-3a3e-4643-83bc-6fadaf91d300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:39.702922 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 17:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:39.873001 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1f8c5-7744-4572-96a7-71ce0d2d051d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:39.888779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1f8c5-7744-4572-96a7-71ce0d2d051d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:39.894661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d88616-ef8a-4365-b5c4-e234f1c3017a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:39.899133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d88616-ef8a-4365-b5c4-e234f1c3017a service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:39.899133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d88616-ef8a-4365-b5c4-e234f1c3017a service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:39.899133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d88616-ef8a-4365-b5c4-e234f1c3017a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:39.905336 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d88616-ef8a-4365-b5c4-e234f1c3017a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:39.907015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d88616-ef8a-4365-b5c4-e234f1c3017a service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:39.916546 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 714/1419] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:41.249834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecac81-0b9a-433e-8a78-e3ef5dd851fc None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:41.288411 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecac81-0b9a-433e-8a78-e3ef5dd851fc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:41.288411 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecac81-0b9a-433e-8a78-e3ef5dd851fc None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:41.288411 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 17:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:41.288774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b56fa7-f54f-4ffa-9b2e-61b53572b195 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:41.288774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b56fa7-f54f-4ffa-9b2e-61b53572b195 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:41.288774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b56fa7-f54f-4ffa-9b2e-61b53572b195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:41.288774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-28b56fa7-f54f-4ffa-9b2e-61b53572b195 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:41.288774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-28b56fa7-f54f-4ffa-9b2e-61b53572b195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:41.296002 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 17:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:41.447593 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecac81-0b9a-433e-8a78-e3ef5dd851fc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:41.461480 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecac81-0b9a-433e-8a78-e3ef5dd851fc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:41.466992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eca1e0-1224-4f78-8d81-2d6d3fc4ed7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:41.467620 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eca1e0-1224-4f78-8d81-2d6d3fc4ed7e service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:41.467893 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eca1e0-1224-4f78-8d81-2d6d3fc4ed7e service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:41.468161 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eca1e0-1224-4f78-8d81-2d6d3fc4ed7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:41.476165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eca1e0-1224-4f78-8d81-2d6d3fc4ed7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:41.477768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eca1e0-1224-4f78-8d81-2d6d3fc4ed7e service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:41.487170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 707/1422] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:42.750094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4eff7-adb0-4e26-b3b0-2a413ce995f3 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:42.750678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4eff7-adb0-4e26-b3b0-2a413ce995f3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:42.750678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4eff7-adb0-4e26-b3b0-2a413ce995f3 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:42.751987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 17:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:42.756858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc50263-b258-4ded-8042-2150d2242128 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:42.757247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc50263-b258-4ded-8042-2150d2242128 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:42.757412 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc50263-b258-4ded-8042-2150d2242128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:42.775126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bfc50263-b258-4ded-8042-2150d2242128 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:42.776916 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bfc50263-b258-4ded-8042-2150d2242128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:42.784655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 17:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:42.934130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4eff7-adb0-4e26-b3b0-2a413ce995f3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:42.949056 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4eff7-adb0-4e26-b3b0-2a413ce995f3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:42.957639 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f6cbb-1ca4-4d8c-aa8b-dd934f81e58f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:42.958280 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f6cbb-1ca4-4d8c-aa8b-dd934f81e58f service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:42.958555 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f6cbb-1ca4-4d8c-aa8b-dd934f81e58f service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:42.960319 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f6cbb-1ca4-4d8c-aa8b-dd934f81e58f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:42.971746 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f6cbb-1ca4-4d8c-aa8b-dd934f81e58f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:42.975551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f6cbb-1ca4-4d8c-aa8b-dd934f81e58f service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:42.983770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 717/1425] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:44.250025 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ce39b-5fc5-43f1-b65c-ab65d397bdc9 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:44.250579 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ce39b-5fc5-43f1-b65c-ab65d397bdc9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:44.250579 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ce39b-5fc5-43f1-b65c-ab65d397bdc9 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:44.251927 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 17:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:44.256804 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99145c-da29-4e84-aa5b-827c2864f20b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:44.257253 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99145c-da29-4e84-aa5b-827c2864f20b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:44.257364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99145c-da29-4e84-aa5b-827c2864f20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:44.277223 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ee99145c-da29-4e84-aa5b-827c2864f20b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:44.278406 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ee99145c-da29-4e84-aa5b-827c2864f20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:44.286578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 17:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:44.436663 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ce39b-5fc5-43f1-b65c-ab65d397bdc9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:44.450783 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ce39b-5fc5-43f1-b65c-ab65d397bdc9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:44.456147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327652ca-5a80-4e6e-b2c9-329314bf77fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:44.456809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327652ca-5a80-4e6e-b2c9-329314bf77fd service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:44.457097 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327652ca-5a80-4e6e-b2c9-329314bf77fd service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:44.457374 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327652ca-5a80-4e6e-b2c9-329314bf77fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:44.465342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327652ca-5a80-4e6e-b2c9-329314bf77fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:44.466907 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327652ca-5a80-4e6e-b2c9-329314bf77fd service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:44.476008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 710/1428] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:45.729604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1bdc6-518a-46ac-818c-3b729fe73d02 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:45.730223 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1bdc6-518a-46ac-818c-3b729fe73d02 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:45.730223 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1bdc6-518a-46ac-818c-3b729fe73d02 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:45.731503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 17:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:45.736335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb52d27-a321-4fb7-9daa-d24e4e494c4b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:45.736815 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb52d27-a321-4fb7-9daa-d24e4e494c4b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:45.736924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb52d27-a321-4fb7-9daa-d24e4e494c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:45.755010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-cdb52d27-a321-4fb7-9daa-d24e4e494c4b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:45.756189 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cdb52d27-a321-4fb7-9daa-d24e4e494c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:45.764348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 17:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:45.910971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1bdc6-518a-46ac-818c-3b729fe73d02 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:45.925435 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1bdc6-518a-46ac-818c-3b729fe73d02 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:45.930680 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7d081-69c6-4f33-b4db-82f275822fc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:45.931309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7d081-69c6-4f33-b4db-82f275822fc7 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:45.931582 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7d081-69c6-4f33-b4db-82f275822fc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:45.931888 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7d081-69c6-4f33-b4db-82f275822fc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:45.941930 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7d081-69c6-4f33-b4db-82f275822fc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:45.943523 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7d081-69c6-4f33-b4db-82f275822fc7 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:45.953111 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 720/1431] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:47.185336 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902578bf-ce84-49ca-952f-99c345900e0c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:47.185886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902578bf-ce84-49ca-952f-99c345900e0c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:47.185886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902578bf-ce84-49ca-952f-99c345900e0c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:47.187281 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 17:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:47.192186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0114e9d-9792-4166-b506-371e4eb70546 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:47.192607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0114e9d-9792-4166-b506-371e4eb70546 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:47.192782 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0114e9d-9792-4166-b506-371e4eb70546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:47.210918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d0114e9d-9792-4166-b506-371e4eb70546 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:47.212111 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d0114e9d-9792-4166-b506-371e4eb70546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:47.220424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 17:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:47.370079 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902578bf-ce84-49ca-952f-99c345900e0c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:47.383825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902578bf-ce84-49ca-952f-99c345900e0c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:47.390015 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78ea24-e4c3-4e1b-8cb8-bafedfdb93fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:47.390638 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78ea24-e4c3-4e1b-8cb8-bafedfdb93fb service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:47.390916 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78ea24-e4c3-4e1b-8cb8-bafedfdb93fb service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:47.391189 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78ea24-e4c3-4e1b-8cb8-bafedfdb93fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:47.399008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78ea24-e4c3-4e1b-8cb8-bafedfdb93fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:47.400667 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78ea24-e4c3-4e1b-8cb8-bafedfdb93fb service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:47.409839 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 713/1434] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:48.687829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7966ad-0e84-42b5-b4c8-34a526178813 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:48.688377 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7966ad-0e84-42b5-b4c8-34a526178813 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:48.688377 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7966ad-0e84-42b5-b4c8-34a526178813 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:48.689770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 17:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:48.694690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835d121-1a64-400f-b0f6-662761ef8228 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:48.695139 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835d121-1a64-400f-b0f6-662761ef8228 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:48.695248 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835d121-1a64-400f-b0f6-662761ef8228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:48.713660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3835d121-1a64-400f-b0f6-662761ef8228 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:48.714880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3835d121-1a64-400f-b0f6-662761ef8228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:48.722644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 17:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:48.872188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7966ad-0e84-42b5-b4c8-34a526178813 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:48.887050 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7966ad-0e84-42b5-b4c8-34a526178813 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:48.892692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8dd9b-6f37-4be5-9344-01a5ca1220f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:48.893312 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8dd9b-6f37-4be5-9344-01a5ca1220f8 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:48.893590 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8dd9b-6f37-4be5-9344-01a5ca1220f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:48.893865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8dd9b-6f37-4be5-9344-01a5ca1220f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:48.901882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8dd9b-6f37-4be5-9344-01a5ca1220f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:48.903453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8dd9b-6f37-4be5-9344-01a5ca1220f8 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:48.912640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 723/1437] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:50.212003 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe7903-8ce5-47e1-b5bd-cf25a0096de1 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:50.212615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe7903-8ce5-47e1-b5bd-cf25a0096de1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:50.212615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe7903-8ce5-47e1-b5bd-cf25a0096de1 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:50.214590 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 17:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:50.219413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a28b6-9ec0-47de-a1f8-e0e44c668ac5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:50.219845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a28b6-9ec0-47de-a1f8-e0e44c668ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:50.219979 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a28b6-9ec0-47de-a1f8-e0e44c668ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:50.238258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-455a28b6-9ec0-47de-a1f8-e0e44c668ac5 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:50.239448 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-455a28b6-9ec0-47de-a1f8-e0e44c668ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:50.247406 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 17:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:50.398961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe7903-8ce5-47e1-b5bd-cf25a0096de1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:50.413865 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe7903-8ce5-47e1-b5bd-cf25a0096de1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:50.419203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489da81c-ae4b-440b-88f0-75c615c5dbad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:50.419831 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489da81c-ae4b-440b-88f0-75c615c5dbad service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:50.420116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489da81c-ae4b-440b-88f0-75c615c5dbad service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:50.420403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489da81c-ae4b-440b-88f0-75c615c5dbad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:50.428304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489da81c-ae4b-440b-88f0-75c615c5dbad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:50.429909 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489da81c-ae4b-440b-88f0-75c615c5dbad service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:50.439074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 716/1440] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:52.556747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486b16-02f4-4c82-99a4-53007424ef2d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:52.557431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486b16-02f4-4c82-99a4-53007424ef2d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:52.557431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486b16-02f4-4c82-99a4-53007424ef2d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:52.558649 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 17:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:52.564000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4892b2-a12c-4f16-b630-56537451f06f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:52.564408 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4892b2-a12c-4f16-b630-56537451f06f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:52.564602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4892b2-a12c-4f16-b630-56537451f06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:52.582946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bb4892b2-a12c-4f16-b630-56537451f06f None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:52.584139 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bb4892b2-a12c-4f16-b630-56537451f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:52.592716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 17:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:42:52.631270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89486b16-02f4-4c82-99a4-53007424ef2d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:52.642810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89486b16-02f4-4c82-99a4-53007424ef2d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:52.646297 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1d070-b9e9-46ed-b751-656f2489d12d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:52.646923 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1d070-b9e9-46ed-b751-656f2489d12d service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:52.647200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1d070-b9e9-46ed-b751-656f2489d12d service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:52.647471 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1d070-b9e9-46ed-b751-656f2489d12d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:52.657249 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1d070-b9e9-46ed-b751-656f2489d12d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:52.658675 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1d070-b9e9-46ed-b751-656f2489d12d service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:52.667975 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 726/1443] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:42:55.130572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d4541-73f0-40a4-a99c-121adb535f2f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:55.131191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d4541-73f0-40a4-a99c-121adb535f2f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:55.131191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d4541-73f0-40a4-a99c-121adb535f2f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:55.132498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 17:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:42:55.138031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bba0e-52ed-4dc0-86fd-e93fbd744598 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:55.138475 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bba0e-52ed-4dc0-86fd-e93fbd744598 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:55.138591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bba0e-52ed-4dc0-86fd-e93fbd744598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:55.156213 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3a7bba0e-52ed-4dc0-86fd-e93fbd744598 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:55.157443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3a7bba0e-52ed-4dc0-86fd-e93fbd744598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:55.165204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 17:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:55.204172 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d4541-73f0-40a4-a99c-121adb535f2f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:55.214692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d4541-73f0-40a4-a99c-121adb535f2f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:55.218201 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9244644-c144-4bd4-823d-b1b2612f1653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:55.218823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9244644-c144-4bd4-823d-b1b2612f1653 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:55.219099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9244644-c144-4bd4-823d-b1b2612f1653 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:55.219369 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9244644-c144-4bd4-823d-b1b2612f1653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:55.227787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9244644-c144-4bd4-823d-b1b2612f1653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:55.229756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9244644-c144-4bd4-823d-b1b2612f1653 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:55.239370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 719/1446] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:42:58.052676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417baa57-48db-420c-9613-2c9202a536be None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:58.053253 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417baa57-48db-420c-9613-2c9202a536be None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:58.053253 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417baa57-48db-420c-9613-2c9202a536be None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:58.054593 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 17:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:42:58.060146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99071135-11ba-47ea-ace1-4d8cf375a7e3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:58.060595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99071135-11ba-47ea-ace1-4d8cf375a7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:58.060690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99071135-11ba-47ea-ace1-4d8cf375a7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:58.078826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-99071135-11ba-47ea-ace1-4d8cf375a7e3 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:42:58.080021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-99071135-11ba-47ea-ace1-4d8cf375a7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:42:58.087867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 17:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:42:58.126497 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417baa57-48db-420c-9613-2c9202a536be None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:42:58.137553 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417baa57-48db-420c-9613-2c9202a536be None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:42:58.141276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1223f-3b4a-4e65-a7b9-6b38bdadf9fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:42:58.141897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1223f-3b4a-4e65-a7b9-6b38bdadf9fc service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:42:58.142172 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1223f-3b4a-4e65-a7b9-6b38bdadf9fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:42:58.142443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1223f-3b4a-4e65-a7b9-6b38bdadf9fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:42:58.151830 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1223f-3b4a-4e65-a7b9-6b38bdadf9fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:42:58.153285 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1223f-3b4a-4e65-a7b9-6b38bdadf9fc service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:42:58.162465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 729/1449] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:43:00.611032 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29583e03-4650-44b8-987e-dacd2bca108d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:00.611570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29583e03-4650-44b8-987e-dacd2bca108d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:00.611570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29583e03-4650-44b8-987e-dacd2bca108d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:00.612924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 17:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:43:00.618112 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfafe42-5dce-4854-98dd-60293fe016c4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:00.618568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfafe42-5dce-4854-98dd-60293fe016c4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:00.618678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfafe42-5dce-4854-98dd-60293fe016c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:00.637510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-dbfafe42-5dce-4854-98dd-60293fe016c4 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:43:00.638704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dbfafe42-5dce-4854-98dd-60293fe016c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:43:00.646745 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 17:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:43:00.685433 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29583e03-4650-44b8-987e-dacd2bca108d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:43:00.695988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29583e03-4650-44b8-987e-dacd2bca108d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:43:00.700228 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c5da7-56bc-420e-9ec7-a60a67f9e120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:43:00.700896 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c5da7-56bc-420e-9ec7-a60a67f9e120 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:00.701181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c5da7-56bc-420e-9ec7-a60a67f9e120 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:00.701458 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c5da7-56bc-420e-9ec7-a60a67f9e120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:00.710070 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c5da7-56bc-420e-9ec7-a60a67f9e120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:43:00.711487 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c5da7-56bc-420e-9ec7-a60a67f9e120 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:43:00.721134 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 722/1452] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:43:03.139257 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdde1cd-b11b-4098-a0b7-970ba83ef0b9 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:03.139833 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdde1cd-b11b-4098-a0b7-970ba83ef0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:03.139833 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdde1cd-b11b-4098-a0b7-970ba83ef0b9 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:03.141457 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 17:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:43:03.146611 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd1ac0-231f-4e3c-9dfe-e384d15b3d1c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:03.147054 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd1ac0-231f-4e3c-9dfe-e384d15b3d1c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:03.147162 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd1ac0-231f-4e3c-9dfe-e384d15b3d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:03.164397 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-69cd1ac0-231f-4e3c-9dfe-e384d15b3d1c None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:43:03.165714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-69cd1ac0-231f-4e3c-9dfe-e384d15b3d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:43:03.174048 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 17:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:43:03.212205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdde1cd-b11b-4098-a0b7-970ba83ef0b9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:43:03.222791 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdde1cd-b11b-4098-a0b7-970ba83ef0b9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:43:03.226263 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393618f-9268-43f7-be12-ace12391cb2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:43:03.226877 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393618f-9268-43f7-be12-ace12391cb2c service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:03.227151 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393618f-9268-43f7-be12-ace12391cb2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:03.227429 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393618f-9268-43f7-be12-ace12391cb2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:03.236653 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393618f-9268-43f7-be12-ace12391cb2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:43:03.238072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393618f-9268-43f7-be12-ace12391cb2c service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:43:03.247740 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 732/1455] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:43:05.577789 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f244fdc-f25f-4abb-baa3-7a245916b162 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:05.578325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f244fdc-f25f-4abb-baa3-7a245916b162 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:05.578325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f244fdc-f25f-4abb-baa3-7a245916b162 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:05.579725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 17:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:43:05.585179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b957f-d0cd-4ebb-b0d7-cc232b1a1d76 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:05.585606 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b957f-d0cd-4ebb-b0d7-cc232b1a1d76 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:05.585723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b957f-d0cd-4ebb-b0d7-cc232b1a1d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:05.603791 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d00b957f-d0cd-4ebb-b0d7-cc232b1a1d76 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:43:05.604954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d00b957f-d0cd-4ebb-b0d7-cc232b1a1d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:43:05.612737 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 17:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:43:05.652349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f244fdc-f25f-4abb-baa3-7a245916b162 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:43:05.662952 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f244fdc-f25f-4abb-baa3-7a245916b162 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:43:05.666671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b17e6-0e59-48a7-a10f-d5841e85cc99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:43:05.667301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b17e6-0e59-48a7-a10f-d5841e85cc99 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:05.667581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b17e6-0e59-48a7-a10f-d5841e85cc99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:05.667853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b17e6-0e59-48a7-a10f-d5841e85cc99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:05.676664 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b17e6-0e59-48a7-a10f-d5841e85cc99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:43:05.678128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b17e6-0e59-48a7-a10f-d5841e85cc99 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:43:05.687688 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 725/1458] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:43:08.011339 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcef846-d8c9-4e7a-b27b-5402c0f7d213 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:08.011901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcef846-d8c9-4e7a-b27b-5402c0f7d213 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:08.011901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcef846-d8c9-4e7a-b27b-5402c0f7d213 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:08.013351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 17:43:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:43:08.020784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ab695-0034-413c-9261-d42bfaba8cb3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:08.029371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ab695-0034-413c-9261-d42bfaba8cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:08.029371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ab695-0034-413c-9261-d42bfaba8cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:08.048377 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-950ab695-0034-413c-9261-d42bfaba8cb3 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:43:08.049689 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-950ab695-0034-413c-9261-d42bfaba8cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:43:08.063170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 17:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:43:08.101163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcef846-d8c9-4e7a-b27b-5402c0f7d213 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:43:08.112184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcef846-d8c9-4e7a-b27b-5402c0f7d213 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:43:08.115733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6004de1-be7a-481b-aa4f-25a167105c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:43:08.116356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6004de1-be7a-481b-aa4f-25a167105c12 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:08.116666 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6004de1-be7a-481b-aa4f-25a167105c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:08.116944 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6004de1-be7a-481b-aa4f-25a167105c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:08.126738 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6004de1-be7a-481b-aa4f-25a167105c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:43:08.128170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6004de1-be7a-481b-aa4f-25a167105c12 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:43:08.138224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 735/1461] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:43:10.458013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c8607-a29e-4dcd-b1b2-ea14e21cbb6f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:10.458577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c8607-a29e-4dcd-b1b2-ea14e21cbb6f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:10.458577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c8607-a29e-4dcd-b1b2-ea14e21cbb6f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:10.459899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 17:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:43:10.465742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675fd80-4412-44fa-8b8f-7cd433508ddd None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:10.466193 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675fd80-4412-44fa-8b8f-7cd433508ddd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:10.466333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675fd80-4412-44fa-8b8f-7cd433508ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:10.485054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0675fd80-4412-44fa-8b8f-7cd433508ddd None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:43:10.486238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0675fd80-4412-44fa-8b8f-7cd433508ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:43:10.493875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 17:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:43:10.533678 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c8607-a29e-4dcd-b1b2-ea14e21cbb6f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:43:10.545226 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c8607-a29e-4dcd-b1b2-ea14e21cbb6f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:43:10.548750 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b94542-7b28-4de8-ad06-1ac6d87a4c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:43:10.549371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b94542-7b28-4de8-ad06-1ac6d87a4c8f service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:10.549646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b94542-7b28-4de8-ad06-1ac6d87a4c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:10.549914 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b94542-7b28-4de8-ad06-1ac6d87a4c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:10.558752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b94542-7b28-4de8-ad06-1ac6d87a4c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:43:10.560149 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b94542-7b28-4de8-ad06-1ac6d87a4c8f service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:43:10.569285 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 728/1464] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:43:12.937599 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393dbb1-6be1-42e5-a0fa-6e86dd3ce6af None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:12.938148 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393dbb1-6be1-42e5-a0fa-6e86dd3ce6af None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:12.938148 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393dbb1-6be1-42e5-a0fa-6e86dd3ce6af None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:12.939501 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 17:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:43:12.944776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195beeb-1acb-48bf-9f31-c67747b5cb66 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:12.945169 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195beeb-1acb-48bf-9f31-c67747b5cb66 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:12.945335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195beeb-1acb-48bf-9f31-c67747b5cb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:12.963731 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1195beeb-1acb-48bf-9f31-c67747b5cb66 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:43:12.969247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1195beeb-1acb-48bf-9f31-c67747b5cb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:43:12.972706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 17:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:43:13.008400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393dbb1-6be1-42e5-a0fa-6e86dd3ce6af None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:43:13.019560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393dbb1-6be1-42e5-a0fa-6e86dd3ce6af None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:43:13.023009 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a2875-42e9-47f0-839a-0c16ee0bcdd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:43:13.023625 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a2875-42e9-47f0-839a-0c16ee0bcdd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:13.023901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a2875-42e9-47f0-839a-0c16ee0bcdd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:13.024169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a2875-42e9-47f0-839a-0c16ee0bcdd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:13.033446 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a2875-42e9-47f0-839a-0c16ee0bcdd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:43:13.034856 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a2875-42e9-47f0-839a-0c16ee0bcdd1 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:43:13.044050 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 738/1467] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:43:15.325732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f0751-da38-4a14-8f45-630f57be668b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:15.326722 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f0751-da38-4a14-8f45-630f57be668b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:15.326722 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f0751-da38-4a14-8f45-630f57be668b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:15.327609 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 17:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:43:15.333020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebf08e-66ea-4a0b-bb56-d5c58bb66ab9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:15.333435 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebf08e-66ea-4a0b-bb56-d5c58bb66ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:15.333577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebf08e-66ea-4a0b-bb56-d5c58bb66ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:15.351889 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7aebf08e-66ea-4a0b-bb56-d5c58bb66ab9 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:43:15.353174 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7aebf08e-66ea-4a0b-bb56-d5c58bb66ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:43:15.361031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 17:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:43:15.397718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f0751-da38-4a14-8f45-630f57be668b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:43:15.408744 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f0751-da38-4a14-8f45-630f57be668b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:43:15.412145 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fded0f-a533-4699-8b6a-5ea8b22a5f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:43:15.412806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fded0f-a533-4699-8b6a-5ea8b22a5f92 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:15.413089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fded0f-a533-4699-8b6a-5ea8b22a5f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:15.413367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fded0f-a533-4699-8b6a-5ea8b22a5f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:15.422249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fded0f-a533-4699-8b6a-5ea8b22a5f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:43:15.423699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fded0f-a533-4699-8b6a-5ea8b22a5f92 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:43:15.433265 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 731/1470] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:43:49.290795 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290764e-0915-4429-8b5c-b072389b38db None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:49.291411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290764e-0915-4429-8b5c-b072389b38db None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:49.291411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290764e-0915-4429-8b5c-b072389b38db None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:49.292784 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 740/1471] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:43:49.297844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ed738-3f6c-489c-9987-f010d2a2153c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:49.298250 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ed738-3f6c-489c-9987-f010d2a2153c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:49.298402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ed738-3f6c-489c-9987-f010d2a2153c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:49.315943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-350ed738-3f6c-489c-9987-f010d2a2153c None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:43:49.317164 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-350ed738-3f6c-489c-9987-f010d2a2153c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:43:49.326479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 732/1472] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:43:49.372927 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0122bb9-3409-4c2f-83d3-6d0a170590f2 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:49.373217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0122bb9-3409-4c2f-83d3-6d0a170590f2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:49.373494 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0122bb9-3409-4c2f-83d3-6d0a170590f2 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:49.375147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 741/1473] 10.222.0.81 () {54 vars in 962 bytes} [Wed May 4 17:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:43:49.379681 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd6655-7619-482f-98e8-7965384fe3ee None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:49.379970 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd6655-7619-482f-98e8-7965384fe3ee None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:49.380247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd6655-7619-482f-98e8-7965384fe3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:49.398447 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-58dd6655-7619-482f-98e8-7965384fe3ee None None] MFA Rules not processed for user `ec8e2eb70a5d4dd1b3a9bec2bd0a78a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:43:49.399754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-58dd6655-7619-482f-98e8-7965384fe3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:43:49.406233 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 733/1474] 10.222.0.81 () {58 vars in 1059 bytes} [Wed May 4 17:43:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:43:49.413411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0122bb9-3409-4c2f-83d3-6d0a170590f2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:43:49.423704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0122bb9-3409-4c2f-83d3-6d0a170590f2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:43:49.427173 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed0b30-f652-441b-bbfb-7ddcabf378d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8e2eb70a5d4dd1b3a9bec2bd0a78a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:43:49.427770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed0b30-f652-441b-bbfb-7ddcabf378d0 service glance] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:49.428052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed0b30-f652-441b-bbfb-7ddcabf378d0 service glance] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:49.428326 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed0b30-f652-441b-bbfb-7ddcabf378d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:49.437664 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed0b30-f652-441b-bbfb-7ddcabf378d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:43:49.439129 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed0b30-f652-441b-bbfb-7ddcabf378d0 service glance] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:43:49.449232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 742/1475] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:43:51.803131 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afa66-ab08-43b1-b494-2b062f21fa9a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:51.803703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afa66-ab08-43b1-b494-2b062f21fa9a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:51.803703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afa66-ab08-43b1-b494-2b062f21fa9a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:51.805114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 734/1476] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:43:51.810367 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb81aab-c6a3-4974-8a53-4b9743d26498 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:51.810802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb81aab-c6a3-4974-8a53-4b9743d26498 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:51.810910 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb81aab-c6a3-4974-8a53-4b9743d26498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:51.827881 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8bb81aab-c6a3-4974-8a53-4b9743d26498 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:43:51.829076 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8bb81aab-c6a3-4974-8a53-4b9743d26498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:43:51.836678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 743/1477] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:43:51.860982 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997afa66-ab08-43b1-b494-2b062f21fa9a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:43:51.873142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997afa66-ab08-43b1-b494-2b062f21fa9a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:43:51.877519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301e6c4-db6d-4314-80dd-b9db0645c809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:43:51.878151 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301e6c4-db6d-4314-80dd-b9db0645c809 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:51.878434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301e6c4-db6d-4314-80dd-b9db0645c809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:51.878709 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301e6c4-db6d-4314-80dd-b9db0645c809 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:51.879439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301e6c4-db6d-4314-80dd-b9db0645c809 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:43:51.881189 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-b301e6c4-db6d-4314-80dd-b9db0645c809 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 17:43:51.881189 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: warnings.warn(msg) May 04 17:43:51.881189 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: May 04 17:43:51.882314 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301e6c4-db6d-4314-80dd-b9db0645c809 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:43:51.901882 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 735/1478] 10.222.0.81 () {56 vars in 1108 bytes} [Wed May 4 17:43:51 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:43:54.160016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac6225-1961-4766-8e78-cb408f288aca None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:54.160627 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac6225-1961-4766-8e78-cb408f288aca None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:54.160627 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac6225-1961-4766-8e78-cb408f288aca None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:54.162040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 744/1479] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:43:54.167656 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24a37a-861b-42d9-bb46-a5ad42fbc694 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:54.168061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24a37a-861b-42d9-bb46-a5ad42fbc694 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:54.168217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24a37a-861b-42d9-bb46-a5ad42fbc694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:54.186886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7b24a37a-861b-42d9-bb46-a5ad42fbc694 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:43:54.188091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7b24a37a-861b-42d9-bb46-a5ad42fbc694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:43:54.195902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 736/1480] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:43:54.239252 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac6225-1961-4766-8e78-cb408f288aca None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:43:54.254293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac6225-1961-4766-8e78-cb408f288aca None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:43:54.259719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85421311-7531-4443-b105-80e8b41a5368 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:43:54.260348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85421311-7531-4443-b105-80e8b41a5368 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:54.260660 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85421311-7531-4443-b105-80e8b41a5368 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:54.261034 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85421311-7531-4443-b105-80e8b41a5368 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:54.269398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85421311-7531-4443-b105-80e8b41a5368 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:43:54.271110 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85421311-7531-4443-b105-80e8b41a5368 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:43:54.280786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 745/1481] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:43:56.741778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769691ae-80be-49e1-9d93-e64603aa74ae None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:56.742400 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769691ae-80be-49e1-9d93-e64603aa74ae None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:56.742400 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769691ae-80be-49e1-9d93-e64603aa74ae None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:56.744375 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 737/1482] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:43:56.749489 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2dd26-2a4a-4751-a8ff-161004b43887 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:56.749950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2dd26-2a4a-4751-a8ff-161004b43887 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:56.750066 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2dd26-2a4a-4751-a8ff-161004b43887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:56.767767 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-28d2dd26-2a4a-4751-a8ff-161004b43887 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:43:56.768980 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-28d2dd26-2a4a-4751-a8ff-161004b43887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:43:56.777481 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 746/1483] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:43:56.813273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769691ae-80be-49e1-9d93-e64603aa74ae None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:43:56.823954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769691ae-80be-49e1-9d93-e64603aa74ae None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:43:56.827471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455c692-09f8-4eb3-8734-1cdb813409d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:43:56.828107 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455c692-09f8-4eb3-8734-1cdb813409d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:56.828391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455c692-09f8-4eb3-8734-1cdb813409d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:56.828698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455c692-09f8-4eb3-8734-1cdb813409d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:56.838329 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455c692-09f8-4eb3-8734-1cdb813409d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:43:56.839777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455c692-09f8-4eb3-8734-1cdb813409d2 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:43:56.848929 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 738/1484] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:43:59.157502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a6e1f-efe6-4ad7-937c-14beb15c9f13 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:59.158076 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a6e1f-efe6-4ad7-937c-14beb15c9f13 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:59.158076 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a6e1f-efe6-4ad7-937c-14beb15c9f13 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:59.159460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 747/1485] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:43:59.164657 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2c1a3-c088-4c17-936a-818ec01590e1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:59.165649 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2c1a3-c088-4c17-936a-818ec01590e1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:59.165861 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2c1a3-c088-4c17-936a-818ec01590e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:59.183155 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e0a2c1a3-c088-4c17-936a-818ec01590e1 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:43:59.184343 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e0a2c1a3-c088-4c17-936a-818ec01590e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:43:59.191988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 739/1486] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:43:59.230341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a6e1f-efe6-4ad7-937c-14beb15c9f13 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:43:59.240677 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a6e1f-efe6-4ad7-937c-14beb15c9f13 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:43:59.244250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef851829-ceee-4040-8d20-c4d8da9d6954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:43:59.244901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef851829-ceee-4040-8d20-c4d8da9d6954 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:43:59.245176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef851829-ceee-4040-8d20-c4d8da9d6954 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:43:59.245445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef851829-ceee-4040-8d20-c4d8da9d6954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:43:59.254027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef851829-ceee-4040-8d20-c4d8da9d6954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:43:59.255439 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef851829-ceee-4040-8d20-c4d8da9d6954 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:43:59.264566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 748/1487] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:44:01.668597 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c8bfd-247a-4f8b-bdbb-d24f9946338e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:44:01.669122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c8bfd-247a-4f8b-bdbb-d24f9946338e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:44:01.669122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c8bfd-247a-4f8b-bdbb-d24f9946338e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:44:01.670432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 740/1488] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:44:01.676191 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eea511-efbc-4622-a685-6e70a32b7b2c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:44:01.676643 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eea511-efbc-4622-a685-6e70a32b7b2c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:44:01.676874 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eea511-efbc-4622-a685-6e70a32b7b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:44:01.695030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-95eea511-efbc-4622-a685-6e70a32b7b2c None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:44:01.696819 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-95eea511-efbc-4622-a685-6e70a32b7b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:44:01.704645 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 749/1489] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:44:01.746872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c8bfd-247a-4f8b-bdbb-d24f9946338e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:44:01.757328 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c8bfd-247a-4f8b-bdbb-d24f9946338e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:44:01.760911 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ad752-e2db-448e-afea-b64d9051af5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:44:01.761543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ad752-e2db-448e-afea-b64d9051af5f service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:44:01.761826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ad752-e2db-448e-afea-b64d9051af5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:44:01.762102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ad752-e2db-448e-afea-b64d9051af5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:44:01.771111 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ad752-e2db-448e-afea-b64d9051af5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:44:01.772587 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ad752-e2db-448e-afea-b64d9051af5f service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:44:01.782030 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 741/1490] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:44:04.558348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093f371-ae3b-49a6-9955-ecb8109d8bc5 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:44:04.558911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093f371-ae3b-49a6-9955-ecb8109d8bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:44:04.558911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093f371-ae3b-49a6-9955-ecb8109d8bc5 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:44:04.560276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 750/1491] 10.222.0.81 () {54 vars in 926 bytes} [Wed May 4 17:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:44:04.565425 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a063a-f1fe-44df-bbf6-70db328db84c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:44:04.565876 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a063a-f1fe-44df-bbf6-70db328db84c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:44:04.566021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a063a-f1fe-44df-bbf6-70db328db84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:44:04.583176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-799a063a-f1fe-44df-bbf6-70db328db84c None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:44:04.584363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-799a063a-f1fe-44df-bbf6-70db328db84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:44:04.592949 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 742/1492] 10.222.0.81 () {58 vars in 1023 bytes} [Wed May 4 17:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:44:04.631450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093f371-ae3b-49a6-9955-ecb8109d8bc5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:44:04.642975 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093f371-ae3b-49a6-9955-ecb8109d8bc5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:44:04.646436 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897395ad-f556-42e7-b661-130ca7eaf9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:44:04.647057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897395ad-f556-42e7-b661-130ca7eaf9db service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:44:04.647334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897395ad-f556-42e7-b661-130ca7eaf9db service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:44:04.647603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897395ad-f556-42e7-b661-130ca7eaf9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:44:04.656992 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897395ad-f556-42e7-b661-130ca7eaf9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:44:04.658415 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897395ad-f556-42e7-b661-130ca7eaf9db service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:44:04.667683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 751/1493] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:45:59.456537 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9f99f-58c7-4d61-a3d6-d407acb0bc18 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:45:59.457137 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9f99f-58c7-4d61-a3d6-d407acb0bc18 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:45:59.457137 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9f99f-58c7-4d61-a3d6-d407acb0bc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:45:59.475592 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7bf9f99f-58c7-4d61-a3d6-d407acb0bc18 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:45:59.478361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7bf9f99f-58c7-4d61-a3d6-d407acb0bc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:45:59.485719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 743/1494] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:45:59.493467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494250f-f12f-45d6-88fb-67dae881b693 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:45:59.494006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494250f-f12f-45d6-88fb-67dae881b693 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:45:59.494006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494250f-f12f-45d6-88fb-67dae881b693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:45:59.511543 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8494250f-f12f-45d6-88fb-67dae881b693 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:45:59.512750 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8494250f-f12f-45d6-88fb-67dae881b693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:45:59.520428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 752/1495] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:45:59.525341 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9f99f-58c7-4d61-a3d6-d407acb0bc18 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:45:59.535351 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9f99f-58c7-4d61-a3d6-d407acb0bc18 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:45:59.539881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa422ead-ce43-4499-92e6-d9edf392241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:45:59.544825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa422ead-ce43-4499-92e6-d9edf392241d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:45:59.544825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa422ead-ce43-4499-92e6-d9edf392241d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:45:59.544825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa422ead-ce43-4499-92e6-d9edf392241d admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:45:59.544825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa422ead-ce43-4499-92e6-d9edf392241d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:45:59.544825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa422ead-ce43-4499-92e6-d9edf392241d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:45:59.545886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-aa422ead-ce43-4499-92e6-d9edf392241d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 17:45:59.545886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: warnings.warn(msg) May 04 17:45:59.545886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: May 04 17:45:59.545886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa422ead-ce43-4499-92e6-d9edf392241d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:45:59.555693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 744/1496] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:45:59.564092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494250f-f12f-45d6-88fb-67dae881b693 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:45:59.573587 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494250f-f12f-45d6-88fb-67dae881b693 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:45:59.578151 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b9757-999e-4a30-9853-d23ab945102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:45:59.578788 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b9757-999e-4a30-9853-d23ab945102f admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:45:59.579065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b9757-999e-4a30-9853-d23ab945102f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:45:59.579337 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b9757-999e-4a30-9853-d23ab945102f admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:45:59.580016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b9757-999e-4a30-9853-d23ab945102f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:45:59.581792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: WARNING py.warnings [None req-720b9757-999e-4a30-9853-d23ab945102f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 17:45:59.581792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: warnings.warn(msg) May 04 17:45:59.581792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: May 04 17:45:59.582975 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b9757-999e-4a30-9853-d23ab945102f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:45:59.808741 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 753/1497] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:45:59 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:45:59.812893 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa422ead-ce43-4499-92e6-d9edf392241d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:45:59.823491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa422ead-ce43-4499-92e6-d9edf392241d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:45:59.878624 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836005a1-5316-4cb1-b316-f00f36487916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:45:59.879398 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836005a1-5316-4cb1-b316-f00f36487916 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:45:59.879686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836005a1-5316-4cb1-b316-f00f36487916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:45:59.879961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836005a1-5316-4cb1-b316-f00f36487916 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:45:59.880684 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836005a1-5316-4cb1-b316-f00f36487916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:45:59.881715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-836005a1-5316-4cb1-b316-f00f36487916 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 17:45:59.881715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: warnings.warn(msg) May 04 17:45:59.881715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: May 04 17:45:59.882903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836005a1-5316-4cb1-b316-f00f36487916 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:45:59.955133 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 745/1498] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:45:59 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:45:59.959323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b9757-999e-4a30-9853-d23ab945102f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:45:59.970287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b9757-999e-4a30-9853-d23ab945102f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:45:59.974814 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbbd23-530d-410e-b37d-4e606c6d36f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:45:59.975464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbbd23-530d-410e-b37d-4e606c6d36f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:45:59.975744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbbd23-530d-410e-b37d-4e606c6d36f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:45:59.976053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbbd23-530d-410e-b37d-4e606c6d36f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:45:59.976817 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbbd23-530d-410e-b37d-4e606c6d36f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:45:59.978193 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: WARNING py.warnings [None req-3cbbbd23-530d-410e-b37d-4e606c6d36f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 17:45:59.978193 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: warnings.warn(msg) May 04 17:45:59.978193 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: May 04 17:45:59.979155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbbd23-530d-410e-b37d-4e606c6d36f1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:45:59.991681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 754/1499] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:45:59.996027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836005a1-5316-4cb1-b316-f00f36487916 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:46:00.011361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836005a1-5316-4cb1-b316-f00f36487916 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:46:00.016838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6ef71-35a5-401e-be2c-3aa7a7b01654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:46:00.017509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ef71-35a5-401e-be2c-3aa7a7b01654 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:46:00.017796 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ef71-35a5-401e-be2c-3aa7a7b01654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:46:00.018071 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ef71-35a5-401e-be2c-3aa7a7b01654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:46:00.019418 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6ef71-35a5-401e-be2c-3aa7a7b01654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:46:00.020457 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-40d6ef71-35a5-401e-be2c-3aa7a7b01654 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 17:46:00.020457 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: warnings.warn(msg) May 04 17:46:00.020457 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: May 04 17:46:00.024871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6ef71-35a5-401e-be2c-3aa7a7b01654 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:46:00.038452 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 746/1500] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:46:00.042717 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbbd23-530d-410e-b37d-4e606c6d36f1 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:46:00.053636 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbbd23-530d-410e-b37d-4e606c6d36f1 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:46:00.058613 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4966b3-70e4-4bcf-b9f3-0a4d290b028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:46:00.059530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4966b3-70e4-4bcf-b9f3-0a4d290b028a admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:46:00.059754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4966b3-70e4-4bcf-b9f3-0a4d290b028a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:46:00.060026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4966b3-70e4-4bcf-b9f3-0a4d290b028a admin admin] PATH_INFO: `/v3/projects/87ebb6a918264fa389964a94f66b153f/users/d1815ac175514fe09049eba961286b64/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:46:00.074816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4966b3-70e4-4bcf-b9f3-0a4d290b028a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ebb6a918264fa389964a94f66b153f, user_id=d1815ac175514fe09049eba961286b64, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:46:00.075873 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: WARNING py.warnings [None req-5a4966b3-70e4-4bcf-b9f3-0a4d290b028a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 17:46:00.075873 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: warnings.warn(msg) May 04 17:46:00.075873 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: May 04 17:46:00.077885 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4966b3-70e4-4bcf-b9f3-0a4d290b028a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:46:00.154589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 755/1501] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:46:00 2022] PUT /identity/v3/projects/87ebb6a918264fa389964a94f66b153f/users/d1815ac175514fe09049eba961286b64/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:46:00.166052 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede93d-bc0c-4a0b-bb53-8882c60285cb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:46:00.168646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede93d-bc0c-4a0b-bb53-8882c60285cb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:46:00.168646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede93d-bc0c-4a0b-bb53-8882c60285cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:46:00.192497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-46ede93d-bc0c-4a0b-bb53-8882c60285cb None None] MFA Rules not processed for user `d1815ac175514fe09049eba961286b64`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:46:00.193707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-46ede93d-bc0c-4a0b-bb53-8882c60285cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:46:00.256362 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 747/1502] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:46:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:46:00.267986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4966b3-70e4-4bcf-b9f3-0a4d290b028a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:46:00.336211 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4966b3-70e4-4bcf-b9f3-0a4d290b028a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:46:00.341823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f8c8b-3e06-4846-9bf8-f242619cd6a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:46:00.342471 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f8c8b-3e06-4846-9bf8-f242619cd6a8 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:46:00.342746 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f8c8b-3e06-4846-9bf8-f242619cd6a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:46:00.343014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f8c8b-3e06-4846-9bf8-f242619cd6a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:46:00.350668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f8c8b-3e06-4846-9bf8-f242619cd6a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:46:00.352233 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f8c8b-3e06-4846-9bf8-f242619cd6a8 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:46:00.360692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 756/1503] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:46:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:46:00.430477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011ed0d-1d42-4262-bcd2-7add0822dc14 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:46:00.430772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011ed0d-1d42-4262-bcd2-7add0822dc14 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:46:00.431050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011ed0d-1d42-4262-bcd2-7add0822dc14 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:46:00.432424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 748/1504] 10.222.0.81 () {52 vars in 829 bytes} [Wed May 4 17:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:46:00.436030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f8c8b-3e06-4846-9bf8-f242619cd6a8 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:46:00.496097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f8c8b-3e06-4846-9bf8-f242619cd6a8 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:46:00.500755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcb98f-c82c-44fb-8327-dcef573e1984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:46:00.501612 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcb98f-c82c-44fb-8327-dcef573e1984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:46:00.501891 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcb98f-c82c-44fb-8327-dcef573e1984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:46:00.502165 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcb98f-c82c-44fb-8327-dcef573e1984 admin admin] PATH_INFO: `/v3/users/d1815ac175514fe09049eba961286b64` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:46:00.503342 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcb98f-c82c-44fb-8327-dcef573e1984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1815ac175514fe09049eba961286b64)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:46:00.504351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: WARNING py.warnings [None req-e5dcb98f-c82c-44fb-8327-dcef573e1984 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 17:46:00.504351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: warnings.warn(msg) May 04 17:46:00.504351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: May 04 17:46:00.505578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcb98f-c82c-44fb-8327-dcef573e1984 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:46:00.755293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e5dcb98f-c82c-44fb-8327-dcef573e1984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1815ac175514fe09049eba961286b64'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:46:00.846064 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e5dcb98f-c82c-44fb-8327-dcef573e1984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1815ac175514fe09049eba961286b64'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:46:00.846686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e5dcb98f-c82c-44fb-8327-dcef573e1984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1815ac175514fe09049eba961286b64'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:46:00.858828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e5dcb98f-c82c-44fb-8327-dcef573e1984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1815ac175514fe09049eba961286b64'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:46:00.876960 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e5dcb98f-c82c-44fb-8327-dcef573e1984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1815ac175514fe09049eba961286b64'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:46:00.882963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 757/1505] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:46:00 2022] DELETE /identity/v3/users/d1815ac175514fe09049eba961286b64 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:46:00.888110 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539935d0-f32e-4c8e-8f2f-37225d09c517 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:46:00.888627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539935d0-f32e-4c8e-8f2f-37225d09c517 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:46:00.888761 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539935d0-f32e-4c8e-8f2f-37225d09c517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:46:00.905665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-539935d0-f32e-4c8e-8f2f-37225d09c517 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:46:00.906852 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-539935d0-f32e-4c8e-8f2f-37225d09c517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:46:00.961700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 749/1506] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:46:00.971780 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcb98f-c82c-44fb-8327-dcef573e1984 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:46:00.974397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e5dcb98f-c82c-44fb-8327-dcef573e1984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:46:01.029166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcb98f-c82c-44fb-8327-dcef573e1984 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:46:01.032701 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c627240-db65-4dac-bee3-915e13a51a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:46:01.033342 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c627240-db65-4dac-bee3-915e13a51a02 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:46:01.033624 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c627240-db65-4dac-bee3-915e13a51a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:46:01.033899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c627240-db65-4dac-bee3-915e13a51a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:46:01.042733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c627240-db65-4dac-bee3-915e13a51a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:46:01.044167 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c627240-db65-4dac-bee3-915e13a51a02 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:46:01.053596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 758/1507] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:46:01.608229 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539935d0-f32e-4c8e-8f2f-37225d09c517 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:46:01.609772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-539935d0-f32e-4c8e-8f2f-37225d09c517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:46:01.623428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539935d0-f32e-4c8e-8f2f-37225d09c517 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:46:01.628424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84275c-a206-4f94-b380-1ce1f188cd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:46:01.629436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84275c-a206-4f94-b380-1ce1f188cd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:46:01.629821 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84275c-a206-4f94-b380-1ce1f188cd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:46:01.630102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84275c-a206-4f94-b380-1ce1f188cd94 admin admin] PATH_INFO: `/v3/projects/87ebb6a918264fa389964a94f66b153f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:46:01.631303 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84275c-a206-4f94-b380-1ce1f188cd94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ebb6a918264fa389964a94f66b153f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:46:01.632468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-2e84275c-a206-4f94-b380-1ce1f188cd94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 17:46:01.632468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: warnings.warn(msg) May 04 17:46:01.632468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: May 04 17:46:01.633758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84275c-a206-4f94-b380-1ce1f188cd94 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:46:01.759150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2e84275c-a206-4f94-b380-1ce1f188cd94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ebb6a918264fa389964a94f66b153f', 'request_id': 'req-2e84275c-a206-4f94-b380-1ce1f188cd94'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:46:01.765717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2e84275c-a206-4f94-b380-1ce1f188cd94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ebb6a918264fa389964a94f66b153f', 'request_id': 'req-2e84275c-a206-4f94-b380-1ce1f188cd94'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:46:01.857558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2e84275c-a206-4f94-b380-1ce1f188cd94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ebb6a918264fa389964a94f66b153f', 'request_id': 'req-2e84275c-a206-4f94-b380-1ce1f188cd94'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:46:01.875518 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2e84275c-a206-4f94-b380-1ce1f188cd94 admin admin] The token cache is being invalidate because project 87ebb6a918264fa389964a94f66b153f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:46:01.875813 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2e84275c-a206-4f94-b380-1ce1f188cd94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:46:01.876465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2e84275c-a206-4f94-b380-1ce1f188cd94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:46:01.878122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 750/1508] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:46:01 2022] DELETE /identity/v3/projects/87ebb6a918264fa389964a94f66b153f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:47:47.610769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd285ec-7d38-4e6f-b63f-fbd0bec2db0e None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:47:47.611253 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd285ec-7d38-4e6f-b63f-fbd0bec2db0e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:47:47.611361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd285ec-7d38-4e6f-b63f-fbd0bec2db0e None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:47:47.612730 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 759/1509] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 17:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:47:47.617611 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f30ff-1f8c-4736-992a-04550ec24ffe None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:47:47.618077 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f30ff-1f8c-4736-992a-04550ec24ffe None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:47:47.618195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f30ff-1f8c-4736-992a-04550ec24ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:47:47.635661 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c50f30ff-1f8c-4736-992a-04550ec24ffe None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:47:47.636892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c50f30ff-1f8c-4736-992a-04550ec24ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:47:47.694859 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 751/1510] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 17:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:47:47.850485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd285ec-7d38-4e6f-b63f-fbd0bec2db0e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:47:47.852100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2fd285ec-7d38-4e6f-b63f-fbd0bec2db0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:47:47.924432 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd285ec-7d38-4e6f-b63f-fbd0bec2db0e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:47:47.929976 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c777b6f-4504-4d10-93c8-8b617c2e52f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:47:47.930612 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c777b6f-4504-4d10-93c8-8b617c2e52f0 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:47:47.930890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c777b6f-4504-4d10-93c8-8b617c2e52f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:47:47.931163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c777b6f-4504-4d10-93c8-8b617c2e52f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:47:47.939211 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c777b6f-4504-4d10-93c8-8b617c2e52f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:47:47.940834 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c777b6f-4504-4d10-93c8-8b617c2e52f0 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:47:47.950563 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 760/1511] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:47:48.612607 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554fe94-06ce-4311-97a5-3d575dc6e32e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:47:48.612936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554fe94-06ce-4311-97a5-3d575dc6e32e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:47:48.613218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554fe94-06ce-4311-97a5-3d575dc6e32e None None] PATH_INFO: `/v3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:47:48.615248 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 752/1512] 10.222.0.86 () {54 vars in 925 bytes} [Wed May 4 17:47:48 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:47:48.621485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f80faa-6566-49a9-91b5-1716d2f54407 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:47:48.621485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f80faa-6566-49a9-91b5-1716d2f54407 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:47:48.622037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f80faa-6566-49a9-91b5-1716d2f54407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:47:48.640404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a2f80faa-6566-49a9-91b5-1716d2f54407 None None] MFA Rules not processed for user `4ff8c001247c43ccbc4ccb26daa17201`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:47:48.641615 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a2f80faa-6566-49a9-91b5-1716d2f54407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:47:48.706656 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 761/1513] 10.222.0.86 () {58 vars in 1015 bytes} [Wed May 4 17:47:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:47:49.178720 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aaf05-cf70-4978-bc5f-fb48ae1a05de None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:47:49.179309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aaf05-cf70-4978-bc5f-fb48ae1a05de None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:47:49.179309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aaf05-cf70-4978-bc5f-fb48ae1a05de None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:47:49.180671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 17:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:47:49.185444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471418b7-a7c1-43b6-9ffd-fe4f839677fd None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:47:49.185726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471418b7-a7c1-43b6-9ffd-fe4f839677fd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:47:49.185997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471418b7-a7c1-43b6-9ffd-fe4f839677fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:47:49.203295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-471418b7-a7c1-43b6-9ffd-fe4f839677fd None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:47:49.204506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-471418b7-a7c1-43b6-9ffd-fe4f839677fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:47:49.212691 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 17:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:47:49.368256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aaf05-cf70-4978-bc5f-fb48ae1a05de None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:47:49.382492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aaf05-cf70-4978-bc5f-fb48ae1a05de None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:47:49.387843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58dced-1d34-4201-a95d-e0eae9257524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:47:49.388507 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58dced-1d34-4201-a95d-e0eae9257524 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:47:49.388791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58dced-1d34-4201-a95d-e0eae9257524 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:47:49.389065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58dced-1d34-4201-a95d-e0eae9257524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:47:49.397021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58dced-1d34-4201-a95d-e0eae9257524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:47:49.398584 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58dced-1d34-4201-a95d-e0eae9257524 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:47:49.408098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 754/1516] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:47:52.920241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffc670-d30a-4947-8d4b-954420999518 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:47:52.920865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffc670-d30a-4947-8d4b-954420999518 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:47:52.920865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffc670-d30a-4947-8d4b-954420999518 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:47:52.922192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 763/1517] 10.222.0.81 () {54 vars in 960 bytes} [Wed May 4 17:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:47:52.928107 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ef74e-7707-4f90-9b74-edb753d6bae4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:47:52.928632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ef74e-7707-4f90-9b74-edb753d6bae4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:47:52.928764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ef74e-7707-4f90-9b74-edb753d6bae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:47:52.948943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bb2ef74e-7707-4f90-9b74-edb753d6bae4 None None] MFA Rules not processed for user `4ff8c001247c43ccbc4ccb26daa17201`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:47:52.950129 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bb2ef74e-7707-4f90-9b74-edb753d6bae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:47:52.958603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 755/1518] 10.222.0.81 () {58 vars in 1057 bytes} [Wed May 4 17:47:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:47:52.966113 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffc670-d30a-4947-8d4b-954420999518 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:47:52.979583 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffc670-d30a-4947-8d4b-954420999518 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:47:52.984595 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0f4e3-feee-4d63-ae7f-78ee5439400b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ff8c001247c43ccbc4ccb26daa17201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:47:52.985221 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0f4e3-feee-4d63-ae7f-78ee5439400b service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:47:52.985501 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0f4e3-feee-4d63-ae7f-78ee5439400b service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:47:52.985778 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0f4e3-feee-4d63-ae7f-78ee5439400b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:47:52.994593 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0f4e3-feee-4d63-ae7f-78ee5439400b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:47:52.996185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0f4e3-feee-4d63-ae7f-78ee5439400b service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:47:53.006406 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 764/1519] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:47:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:48:01.031021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e0b51-a359-467d-a478-77f8964befd8 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:01.031599 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e0b51-a359-467d-a478-77f8964befd8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:01.031599 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e0b51-a359-467d-a478-77f8964befd8 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:01.032973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 756/1520] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 17:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:48:01.038457 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a8f5f-142d-4386-94e8-23156c40c42d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:01.038894 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a8f5f-142d-4386-94e8-23156c40c42d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:01.039036 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a8f5f-142d-4386-94e8-23156c40c42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:01.056712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-461a8f5f-142d-4386-94e8-23156c40c42d None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:48:01.057887 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-461a8f5f-142d-4386-94e8-23156c40c42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:48:01.065719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 765/1521] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 17:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:48:01.218586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e0b51-a359-467d-a478-77f8964befd8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:48:01.233153 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e0b51-a359-467d-a478-77f8964befd8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:48:01.238471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd0efd-7d6e-4864-b51d-ee5ce7c5e227 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:48:01.239135 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd0efd-7d6e-4864-b51d-ee5ce7c5e227 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:01.239419 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd0efd-7d6e-4864-b51d-ee5ce7c5e227 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:01.239693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd0efd-7d6e-4864-b51d-ee5ce7c5e227 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:01.247744 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd0efd-7d6e-4864-b51d-ee5ce7c5e227 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:48:01.249347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd0efd-7d6e-4864-b51d-ee5ce7c5e227 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:48:01.258979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 757/1522] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:48:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:48:02.493906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26094a-3943-4381-852a-2481c8374849 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:02.494509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26094a-3943-4381-852a-2481c8374849 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:02.494509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26094a-3943-4381-852a-2481c8374849 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:02.495858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 766/1523] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 17:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:48:02.500570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510a379-f78b-491b-b005-296ab052813e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:02.501058 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510a379-f78b-491b-b005-296ab052813e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:02.501164 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510a379-f78b-491b-b005-296ab052813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:02.519551 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f510a379-f78b-491b-b005-296ab052813e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:48:02.520769 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f510a379-f78b-491b-b005-296ab052813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:48:02.529033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 758/1524] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 17:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:48:02.680715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26094a-3943-4381-852a-2481c8374849 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:48:02.695295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26094a-3943-4381-852a-2481c8374849 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:48:02.700707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e0e37-57a2-428c-93dc-823808f9e85e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:48:02.701329 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e0e37-57a2-428c-93dc-823808f9e85e service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:02.701608 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e0e37-57a2-428c-93dc-823808f9e85e service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:02.701882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e0e37-57a2-428c-93dc-823808f9e85e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:02.709914 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e0e37-57a2-428c-93dc-823808f9e85e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:48:02.711538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e0e37-57a2-428c-93dc-823808f9e85e service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:48:02.720831 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 767/1525] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:48:07.414875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acee80-c32b-4538-a51a-7b69a6be7883 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:07.415451 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acee80-c32b-4538-a51a-7b69a6be7883 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:07.415451 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acee80-c32b-4538-a51a-7b69a6be7883 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:07.416806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 759/1526] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 17:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:48:07.421831 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982b99d-16ad-40d9-bcd8-6586cca2ec85 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:07.422224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982b99d-16ad-40d9-bcd8-6586cca2ec85 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:07.422420 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982b99d-16ad-40d9-bcd8-6586cca2ec85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:07.439962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4982b99d-16ad-40d9-bcd8-6586cca2ec85 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:48:07.441258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4982b99d-16ad-40d9-bcd8-6586cca2ec85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:48:07.449680 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 768/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 17:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:48:07.486022 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acee80-c32b-4538-a51a-7b69a6be7883 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:48:07.487672 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e7acee80-c32b-4538-a51a-7b69a6be7883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:48:07.544528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acee80-c32b-4538-a51a-7b69a6be7883 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:48:07.548288 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521aa48c-1c8e-4d88-86c9-ab46b14d8115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:48:07.548962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521aa48c-1c8e-4d88-86c9-ab46b14d8115 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:07.549244 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521aa48c-1c8e-4d88-86c9-ab46b14d8115 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:07.549516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521aa48c-1c8e-4d88-86c9-ab46b14d8115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:07.559678 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521aa48c-1c8e-4d88-86c9-ab46b14d8115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:48:07.561151 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521aa48c-1c8e-4d88-86c9-ab46b14d8115 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:48:07.575820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 760/1528] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:48:09.881793 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b628e2e-5ef7-4d11-bab5-ac837514c3af None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:09.882318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b628e2e-5ef7-4d11-bab5-ac837514c3af None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:09.882318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b628e2e-5ef7-4d11-bab5-ac837514c3af None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:09.883705 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 769/1529] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 17:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:48:09.889003 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc563c0-cb75-4ee0-86e9-ee310ef0e784 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:09.889462 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc563c0-cb75-4ee0-86e9-ee310ef0e784 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:09.889562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc563c0-cb75-4ee0-86e9-ee310ef0e784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:09.908479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ddc563c0-cb75-4ee0-86e9-ee310ef0e784 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:48:09.909677 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ddc563c0-cb75-4ee0-86e9-ee310ef0e784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:48:09.918086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 761/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 17:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:48:09.954692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b628e2e-5ef7-4d11-bab5-ac837514c3af None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:48:09.966191 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b628e2e-5ef7-4d11-bab5-ac837514c3af None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:48:09.969832 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04700f88-44b9-42b2-8c3a-de0f3dd29dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:48:09.970529 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04700f88-44b9-42b2-8c3a-de0f3dd29dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:09.970745 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04700f88-44b9-42b2-8c3a-de0f3dd29dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:09.971016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04700f88-44b9-42b2-8c3a-de0f3dd29dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:09.981106 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04700f88-44b9-42b2-8c3a-de0f3dd29dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:48:09.982568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04700f88-44b9-42b2-8c3a-de0f3dd29dd0 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:48:09.992482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 770/1531] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:48:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:48:13.840715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fec25-c1de-4f36-9c00-81a138cbdfa9 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:13.841203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fec25-c1de-4f36-9c00-81a138cbdfa9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:13.841307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fec25-c1de-4f36-9c00-81a138cbdfa9 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:13.842673 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 762/1532] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 17:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:48:13.847711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ae411-b35d-469c-a8bb-b66e06aa9b1a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:13.848168 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ae411-b35d-469c-a8bb-b66e06aa9b1a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:13.848275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ae411-b35d-469c-a8bb-b66e06aa9b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:13.868181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ec5ae411-b35d-469c-a8bb-b66e06aa9b1a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:48:13.868391 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ec5ae411-b35d-469c-a8bb-b66e06aa9b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:48:13.876028 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 771/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 17:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:48:14.151344 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fec25-c1de-4f36-9c00-81a138cbdfa9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:48:14.153034 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b81fec25-c1de-4f36-9c00-81a138cbdfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:48:14.209877 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fec25-c1de-4f36-9c00-81a138cbdfa9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:48:14.213443 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f75f3e-fc2b-45ad-8660-d45b280d9458 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:48:14.214089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f75f3e-fc2b-45ad-8660-d45b280d9458 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:14.214377 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f75f3e-fc2b-45ad-8660-d45b280d9458 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:14.214658 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f75f3e-fc2b-45ad-8660-d45b280d9458 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:14.223350 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f75f3e-fc2b-45ad-8660-d45b280d9458 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:48:14.225346 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f75f3e-fc2b-45ad-8660-d45b280d9458 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:48:14.234785 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 763/1534] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:48:16.570147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a2d1d-4600-48b0-87bb-4d4ea8442fbb None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:16.570714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a2d1d-4600-48b0-87bb-4d4ea8442fbb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:16.570840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a2d1d-4600-48b0-87bb-4d4ea8442fbb None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:16.572236 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 772/1535] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 17:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:48:16.577457 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc06eb6-8173-4ac8-86d7-37f03d5f33e2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:16.577879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc06eb6-8173-4ac8-86d7-37f03d5f33e2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:16.578022 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc06eb6-8173-4ac8-86d7-37f03d5f33e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:16.595887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0dc06eb6-8173-4ac8-86d7-37f03d5f33e2 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:48:16.597047 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0dc06eb6-8173-4ac8-86d7-37f03d5f33e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:48:16.605379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 764/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 17:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:48:16.879677 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac75ae-92e6-436e-a451-0c966507b0e7 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:16.879964 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac75ae-92e6-436e-a451-0c966507b0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:16.880264 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac75ae-92e6-436e-a451-0c966507b0e7 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:16.881720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 773/1537] 10.222.0.81 () {54 vars in 963 bytes} [Wed May 4 17:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:48:16.886698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdaa14-7235-41fe-81d2-06875d692af9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:16.886986 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdaa14-7235-41fe-81d2-06875d692af9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:16.887293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdaa14-7235-41fe-81d2-06875d692af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:16.905404 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c2cdaa14-7235-41fe-81d2-06875d692af9 None None] MFA Rules not processed for user `4f22b09c1ffc4006a4b47ba882c55f80`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:48:16.906573 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c2cdaa14-7235-41fe-81d2-06875d692af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:48:16.913500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 765/1538] 10.222.0.81 () {58 vars in 1060 bytes} [Wed May 4 17:48:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:48:16.921047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac75ae-92e6-436e-a451-0c966507b0e7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:48:16.931830 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac75ae-92e6-436e-a451-0c966507b0e7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:48:16.935374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23133b1b-32cd-4c93-9cd2-60344a309153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:48:16.936016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23133b1b-32cd-4c93-9cd2-60344a309153 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:48:16.936301 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23133b1b-32cd-4c93-9cd2-60344a309153 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:48:16.936635 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23133b1b-32cd-4c93-9cd2-60344a309153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:48:16.945627 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23133b1b-32cd-4c93-9cd2-60344a309153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:48:16.947046 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23133b1b-32cd-4c93-9cd2-60344a309153 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:48:16.956207 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 774/1539] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:48:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:49:49.779557 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ac2be-cf84-47d1-bd7d-7862d79a5585 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:49.780200 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ac2be-cf84-47d1-bd7d-7862d79a5585 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:49.780200 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ac2be-cf84-47d1-bd7d-7862d79a5585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:49.783347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7a356-4db6-44a7-966f-72ccd19d5128 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:49.783822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7a356-4db6-44a7-966f-72ccd19d5128 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:49.783918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7a356-4db6-44a7-966f-72ccd19d5128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:49.817630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-14a7a356-4db6-44a7-966f-72ccd19d5128 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:49.819221 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-14a7a356-4db6-44a7-966f-72ccd19d5128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:49.820318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-068ac2be-cf84-47d1-bd7d-7862d79a5585 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:49.822275 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-068ac2be-cf84-47d1-bd7d-7862d79a5585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:49.833260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 775/1540] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:49:49.859442 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 766/1541] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:49:49.863828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9ef0f-19f2-45b7-b576-6a3611dbce8b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:49.870809 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9ef0f-19f2-45b7-b576-6a3611dbce8b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:49.871380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9ef0f-19f2-45b7-b576-6a3611dbce8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:49.901689 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2ed9ef0f-19f2-45b7-b576-6a3611dbce8b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:49.903654 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2ed9ef0f-19f2-45b7-b576-6a3611dbce8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:49.909018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3ed6a-04e5-41c0-a8ca-9602cd640b5d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:49.909265 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3ed6a-04e5-41c0-a8ca-9602cd640b5d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:49.909538 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3ed6a-04e5-41c0-a8ca-9602cd640b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:49.922315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 776/1542] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:49.929049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9ef0f-19f2-45b7-b576-6a3611dbce8b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:49.944235 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9ef0f-19f2-45b7-b576-6a3611dbce8b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:49.961531 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a8740-bcb5-454d-aba1-90145d236cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:49.962723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a8740-bcb5-454d-aba1-90145d236cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:49.963237 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a8740-bcb5-454d-aba1-90145d236cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:49.963786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a8740-bcb5-454d-aba1-90145d236cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:49.964791 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a8740-bcb5-454d-aba1-90145d236cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:49:49.965667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a8740-bcb5-454d-aba1-90145d236cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:49.967081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: WARNING py.warnings [None req-8b4a8740-bcb5-454d-aba1-90145d236cbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 17:49:49.967081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: warnings.warn(msg) May 04 17:49:49.967081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: May 04 17:49:49.968681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a8740-bcb5-454d-aba1-90145d236cbb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:49.973462 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ffd3ed6a-04e5-41c0-a8ca-9602cd640b5d None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:49.974668 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ffd3ed6a-04e5-41c0-a8ca-9602cd640b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:49.988344 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 777/1543] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:49:50.001806 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a8740-bcb5-454d-aba1-90145d236cbb admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:50.002989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 767/1544] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:50.017552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3ed6a-04e5-41c0-a8ca-9602cd640b5d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:50.019740 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a8740-bcb5-454d-aba1-90145d236cbb admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:50.030465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20ca31-bf60-4a7f-8303-bac17d2efdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:50.031479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20ca31-bf60-4a7f-8303-bac17d2efdb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.031989 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20ca31-bf60-4a7f-8303-bac17d2efdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.032250 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3ed6a-04e5-41c0-a8ca-9602cd640b5d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:50.032741 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20ca31-bf60-4a7f-8303-bac17d2efdb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.033705 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20ca31-bf60-4a7f-8303-bac17d2efdb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:50.036120 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20ca31-bf60-4a7f-8303-bac17d2efdb4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:50.052464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5587603-e2df-40a9-a348-c3e7ae99c858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:50.052464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5587603-e2df-40a9-a348-c3e7ae99c858 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.052464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5587603-e2df-40a9-a348-c3e7ae99c858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.052464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5587603-e2df-40a9-a348-c3e7ae99c858 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.052947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5587603-e2df-40a9-a348-c3e7ae99c858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:49:50.052947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5587603-e2df-40a9-a348-c3e7ae99c858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:50.053097 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5587603-e2df-40a9-a348-c3e7ae99c858 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:50.079165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 768/1545] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:49:50.088556 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5587603-e2df-40a9-a348-c3e7ae99c858 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:50.109353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5587603-e2df-40a9-a348-c3e7ae99c858 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:50.120415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff78ef8-f8b6-4218-9df6-52bea46670b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:50.121191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff78ef8-f8b6-4218-9df6-52bea46670b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.121477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff78ef8-f8b6-4218-9df6-52bea46670b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.121757 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff78ef8-f8b6-4218-9df6-52bea46670b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.122570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff78ef8-f8b6-4218-9df6-52bea46670b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:50.123654 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-cff78ef8-f8b6-4218-9df6-52bea46670b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 17:49:50.123654 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: warnings.warn(msg) May 04 17:49:50.123654 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: May 04 17:49:50.125396 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff78ef8-f8b6-4218-9df6-52bea46670b2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:50.137017 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 778/1546] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/projects => generated 403 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:49:50.141241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20ca31-bf60-4a7f-8303-bac17d2efdb4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:50.229475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 769/1547] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/projects => generated 389 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:49:50.242344 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff78ef8-f8b6-4218-9df6-52bea46670b2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:50.245074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20ca31-bf60-4a7f-8303-bac17d2efdb4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:50.346632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff78ef8-f8b6-4218-9df6-52bea46670b2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:50.364219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b1583-9f14-4616-a944-ea5fba93ab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:50.364958 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b1583-9f14-4616-a944-ea5fba93ab01 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.365250 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b1583-9f14-4616-a944-ea5fba93ab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.365530 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b1583-9f14-4616-a944-ea5fba93ab01 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.366656 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b1583-9f14-4616-a944-ea5fba93ab01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:50.368541 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288ab9c-5104-4ca7-990b-9f84a90e5184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:50.368864 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b1583-9f14-4616-a944-ea5fba93ab01 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:50.369597 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288ab9c-5104-4ca7-990b-9f84a90e5184 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.369884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288ab9c-5104-4ca7-990b-9f84a90e5184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.370296 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288ab9c-5104-4ca7-990b-9f84a90e5184 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.371044 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288ab9c-5104-4ca7-990b-9f84a90e5184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:50.372133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: WARNING py.warnings [None req-a288ab9c-5104-4ca7-990b-9f84a90e5184 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 17:49:50.372133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: warnings.warn(msg) May 04 17:49:50.372133 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: May 04 17:49:50.373439 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288ab9c-5104-4ca7-990b-9f84a90e5184 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:50.461813 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 770/1548] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/users => generated 295 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:49:50.464521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1c0b7-68e8-410d-ba36-186c4a172e87 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.465049 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1c0b7-68e8-410d-ba36-186c4a172e87 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.465451 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1c0b7-68e8-410d-ba36-186c4a172e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.496866 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a2c1c0b7-68e8-410d-ba36-186c4a172e87 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:50.496866 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a2c1c0b7-68e8-410d-ba36-186c4a172e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:50.508505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 771/1549] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:50.510318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1c0b7-68e8-410d-ba36-186c4a172e87 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:50.522856 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 779/1550] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/users => generated 302 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:49:50.524332 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce82064-33c8-4c9b-9d91-60aa5cbc4613 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.525296 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce82064-33c8-4c9b-9d91-60aa5cbc4613 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.536525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce82064-33c8-4c9b-9d91-60aa5cbc4613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.555182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1c0b7-68e8-410d-ba36-186c4a172e87 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:50.568540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e49cd-cdff-47fe-8e12-3ea11e6d9dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:50.569336 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e49cd-cdff-47fe-8e12-3ea11e6d9dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.569626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e49cd-cdff-47fe-8e12-3ea11e6d9dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.569954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e49cd-cdff-47fe-8e12-3ea11e6d9dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.570702 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e49cd-cdff-47fe-8e12-3ea11e6d9dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:50.573450 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e49cd-cdff-47fe-8e12-3ea11e6d9dc0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:50.573660 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2ce82064-33c8-4c9b-9d91-60aa5cbc4613 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:50.574882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2ce82064-33c8-4c9b-9d91-60aa5cbc4613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:50.586765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 772/1551] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:50.589217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc7bdd-be64-493c-a1be-cfb216312ef6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.589510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc7bdd-be64-493c-a1be-cfb216312ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.589788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc7bdd-be64-493c-a1be-cfb216312ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.592306 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 780/1552] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:50.593334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce82064-33c8-4c9b-9d91-60aa5cbc4613 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:50.611037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce82064-33c8-4c9b-9d91-60aa5cbc4613 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:50.611398 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f3bc7bdd-be64-493c-a1be-cfb216312ef6 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:50.612828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f3bc7bdd-be64-493c-a1be-cfb216312ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:50.622803 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c62b3-7fab-48fc-a98a-6a1c890c2cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:50.624665 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c62b3-7fab-48fc-a98a-6a1c890c2cbf admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.624952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c62b3-7fab-48fc-a98a-6a1c890c2cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.625229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c62b3-7fab-48fc-a98a-6a1c890c2cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.626901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 773/1553] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:50.627220 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c62b3-7fab-48fc-a98a-6a1c890c2cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:50.628192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8004fef-f06a-411a-8017-d7c45beac37f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.630611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c62b3-7fab-48fc-a98a-6a1c890c2cbf admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:50.630733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8004fef-f06a-411a-8017-d7c45beac37f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.633715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8004fef-f06a-411a-8017-d7c45beac37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.643868 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 781/1554] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:50.645145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc43f4-76ee-400e-80c5-3789a008b8af None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.645432 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc43f4-76ee-400e-80c5-3789a008b8af None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.645706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc43f4-76ee-400e-80c5-3789a008b8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.648842 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e8004fef-f06a-411a-8017-d7c45beac37f None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:50.650661 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e8004fef-f06a-411a-8017-d7c45beac37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:50.658592 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 774/1555] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:50.659150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8004fef-f06a-411a-8017-d7c45beac37f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:50.665812 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2edc43f4-76ee-400e-80c5-3789a008b8af None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:50.667146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2edc43f4-76ee-400e-80c5-3789a008b8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:50.669461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8004fef-f06a-411a-8017-d7c45beac37f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:50.674143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a85932-a824-408e-bf2d-e898cf64331d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:50.679689 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a85932-a824-408e-bf2d-e898cf64331d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.679802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 782/1556] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:50.679802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011304a3-d8fe-4cff-9e7d-d541d5732bdc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.679802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011304a3-d8fe-4cff-9e7d-d541d5732bdc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.680078 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a85932-a824-408e-bf2d-e898cf64331d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.680173 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011304a3-d8fe-4cff-9e7d-d541d5732bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.680250 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a85932-a824-408e-bf2d-e898cf64331d admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.680250 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a85932-a824-408e-bf2d-e898cf64331d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:50.680250 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a85932-a824-408e-bf2d-e898cf64331d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:50.691141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 775/1557] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:50.691764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc49a6-0ffb-49b8-b206-a656c6c27408 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.692153 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc49a6-0ffb-49b8-b206-a656c6c27408 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.692622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc49a6-0ffb-49b8-b206-a656c6c27408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.698214 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-011304a3-d8fe-4cff-9e7d-d541d5732bdc None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:50.699592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-011304a3-d8fe-4cff-9e7d-d541d5732bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:50.707359 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 783/1558] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:50.708143 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011304a3-d8fe-4cff-9e7d-d541d5732bdc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:50.712956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-27bc49a6-0ffb-49b8-b206-a656c6c27408 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:50.714434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-27bc49a6-0ffb-49b8-b206-a656c6c27408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:50.717944 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011304a3-d8fe-4cff-9e7d-d541d5732bdc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:50.722284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd95245-8cf2-41d7-80e6-7d38bd3f215b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:50.722634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 776/1559] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:50.723850 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f834f5c-a65e-412a-8d27-9e460cad3bac None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.724140 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f834f5c-a65e-412a-8d27-9e460cad3bac None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.724418 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f834f5c-a65e-412a-8d27-9e460cad3bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.728763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95245-8cf2-41d7-80e6-7d38bd3f215b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.729265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95245-8cf2-41d7-80e6-7d38bd3f215b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.729644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95245-8cf2-41d7-80e6-7d38bd3f215b admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.730585 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd95245-8cf2-41d7-80e6-7d38bd3f215b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:49:50.731003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd95245-8cf2-41d7-80e6-7d38bd3f215b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:50.733038 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd95245-8cf2-41d7-80e6-7d38bd3f215b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:50.742290 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4f834f5c-a65e-412a-8d27-9e460cad3bac None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:50.744086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4f834f5c-a65e-412a-8d27-9e460cad3bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:50.745564 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 784/1560] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:49:50.746570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd95245-8cf2-41d7-80e6-7d38bd3f215b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:50.753152 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 777/1561] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:50.753522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0672b-afcc-4dea-9607-21bc4756ee27 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.753796 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0672b-afcc-4dea-9607-21bc4756ee27 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.754082 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0672b-afcc-4dea-9607-21bc4756ee27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.756874 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd95245-8cf2-41d7-80e6-7d38bd3f215b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:50.762404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6868530-d40f-4421-b802-9c80bca344c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:50.763273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6868530-d40f-4421-b802-9c80bca344c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.763552 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6868530-d40f-4421-b802-9c80bca344c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.763826 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6868530-d40f-4421-b802-9c80bca344c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.764588 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6868530-d40f-4421-b802-9c80bca344c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:50.766312 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6868530-d40f-4421-b802-9c80bca344c1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:50.775277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-dff0672b-afcc-4dea-9607-21bc4756ee27 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:50.776503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dff0672b-afcc-4dea-9607-21bc4756ee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:50.776869 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 785/1562] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:50.781354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be626087-2605-4467-a9ac-f103f09de1c2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.781644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be626087-2605-4467-a9ac-f103f09de1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.781917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be626087-2605-4467-a9ac-f103f09de1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.784661 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 778/1563] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:50.785836 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0672b-afcc-4dea-9607-21bc4756ee27 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:50.801434 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-be626087-2605-4467-a9ac-f103f09de1c2 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:50.802020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0672b-afcc-4dea-9607-21bc4756ee27 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:50.802624 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-be626087-2605-4467-a9ac-f103f09de1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:50.808307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1f3bb-4111-4753-8393-f87d61049b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:50.809284 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1f3bb-4111-4753-8393-f87d61049b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.809565 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1f3bb-4111-4753-8393-f87d61049b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.809836 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1f3bb-4111-4753-8393-f87d61049b9e admin admin] PATH_INFO: `/v3/projects/6061fedb7a6f46398811de3ae8aa091b/users/0bf039be83b54817ac2f340cf9dfad63/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.811055 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 786/1564] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:50.811777 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be626087-2605-4467-a9ac-f103f09de1c2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:50.820802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be626087-2605-4467-a9ac-f103f09de1c2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:50.826525 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1f3bb-4111-4753-8393-f87d61049b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6061fedb7a6f46398811de3ae8aa091b, user_id=0bf039be83b54817ac2f340cf9dfad63, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:50.827283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6006999-9261-4c3e-b15d-64b3b0ca2d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:50.827585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-aba1f3bb-4111-4753-8393-f87d61049b9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 17:49:50.827585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: warnings.warn(msg) May 04 17:49:50.827585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: May 04 17:49:50.827928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6006999-9261-4c3e-b15d-64b3b0ca2d14 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.828207 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6006999-9261-4c3e-b15d-64b3b0ca2d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.828506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6006999-9261-4c3e-b15d-64b3b0ca2d14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.829232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6006999-9261-4c3e-b15d-64b3b0ca2d14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:49:50.829533 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1f3bb-4111-4753-8393-f87d61049b9e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:50.829627 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6006999-9261-4c3e-b15d-64b3b0ca2d14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:50.831107 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6006999-9261-4c3e-b15d-64b3b0ca2d14 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:50.843108 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 787/1565] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:49:50.845618 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73ea9d-44a8-461a-b469-464fd7439850 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.845618 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73ea9d-44a8-461a-b469-464fd7439850 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.845618 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73ea9d-44a8-461a-b469-464fd7439850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.861571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-be73ea9d-44a8-461a-b469-464fd7439850 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:50.862750 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-be73ea9d-44a8-461a-b469-464fd7439850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:50.871032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 788/1566] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:50.871759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73ea9d-44a8-461a-b469-464fd7439850 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:50.880523 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73ea9d-44a8-461a-b469-464fd7439850 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:50.886197 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00df444-130c-4110-a750-2fbd53fe779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:50.886824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00df444-130c-4110-a750-2fbd53fe779d admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.887112 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00df444-130c-4110-a750-2fbd53fe779d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.887389 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00df444-130c-4110-a750-2fbd53fe779d admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.888072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00df444-130c-4110-a750-2fbd53fe779d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:50.890009 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00df444-130c-4110-a750-2fbd53fe779d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:50.940116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 779/1567] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:49:50 2022] PUT /identity/v3/projects/6061fedb7a6f46398811de3ae8aa091b/users/0bf039be83b54817ac2f340cf9dfad63/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:49:50.941479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eb3a1-5bc5-4b68-8834-e90765d1fe83 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:50.941771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eb3a1-5bc5-4b68-8834-e90765d1fe83 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:50.942052 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eb3a1-5bc5-4b68-8834-e90765d1fe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:50.959704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-009eb3a1-5bc5-4b68-8834-e90765d1fe83 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:50.960939 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-009eb3a1-5bc5-4b68-8834-e90765d1fe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:50.967116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 789/1568] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:50.967116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00df444-130c-4110-a750-2fbd53fe779d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:51.018348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 780/1569] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:51.019121 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009eb3a1-5bc5-4b68-8834-e90765d1fe83 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:51.024753 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00df444-130c-4110-a750-2fbd53fe779d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:51.028207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009eb3a1-5bc5-4b68-8834-e90765d1fe83 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:51.029571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2ac77-3590-443d-8a87-cb509d912593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:51.030535 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2ac77-3590-443d-8a87-cb509d912593 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.030885 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2ac77-3590-443d-8a87-cb509d912593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.031229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2ac77-3590-443d-8a87-cb509d912593 admin admin] PATH_INFO: `/v3/projects/ad30ae0b8e9f47be9bdb04d3b478b358/users/ac35cb05faf746978c0c71b344b51e94/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.032736 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7572b1-8bcb-4c3f-ad9e-b71e206e26a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:51.033379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7572b1-8bcb-4c3f-ad9e-b71e206e26a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.033664 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7572b1-8bcb-4c3f-ad9e-b71e206e26a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.033942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7572b1-8bcb-4c3f-ad9e-b71e206e26a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.034671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7572b1-8bcb-4c3f-ad9e-b71e206e26a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:49:51.035269 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7572b1-8bcb-4c3f-ad9e-b71e206e26a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:51.036903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7572b1-8bcb-4c3f-ad9e-b71e206e26a5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:51.046294 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f2ac77-3590-443d-8a87-cb509d912593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad30ae0b8e9f47be9bdb04d3b478b358, user_id=ac35cb05faf746978c0c71b344b51e94, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:51.048231 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 781/1570] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:49:51.048971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f2ac77-3590-443d-8a87-cb509d912593 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:51.049176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7572b1-8bcb-4c3f-ad9e-b71e206e26a5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:51.059211 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7572b1-8bcb-4c3f-ad9e-b71e206e26a5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:51.073763 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ab2ac-d888-4707-a4a5-4f3de8f43d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:51.073763 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ab2ac-d888-4707-a4a5-4f3de8f43d95 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.073763 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ab2ac-d888-4707-a4a5-4f3de8f43d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.073763 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ab2ac-d888-4707-a4a5-4f3de8f43d95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.074356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ab2ac-d888-4707-a4a5-4f3de8f43d95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:49:51.074356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ab2ac-d888-4707-a4a5-4f3de8f43d95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:51.074356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ab2ac-d888-4707-a4a5-4f3de8f43d95 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:51.081020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 782/1571] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:49:51.081845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ab2ac-d888-4707-a4a5-4f3de8f43d95 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:51.091594 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ab2ac-d888-4707-a4a5-4f3de8f43d95 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:51.096396 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04e60a-66cc-4c00-804b-1e7b0cf17ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:51.097094 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e60a-66cc-4c00-804b-1e7b0cf17ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.097433 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e60a-66cc-4c00-804b-1e7b0cf17ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.097708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e60a-66cc-4c00-804b-1e7b0cf17ad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.098492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04e60a-66cc-4c00-804b-1e7b0cf17ad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:51.100385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04e60a-66cc-4c00-804b-1e7b0cf17ad9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:51.128556 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 790/1572] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:49:50 2022] PUT /identity/v3/projects/ad30ae0b8e9f47be9bdb04d3b478b358/users/ac35cb05faf746978c0c71b344b51e94/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:49:51.129527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2ac77-3590-443d-8a87-cb509d912593 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:51.188751 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 783/1573] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:49:51 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:51.190262 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c209da6-a3fe-4b82-a405-11d009602356 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.190549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c209da6-a3fe-4b82-a405-11d009602356 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.190820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c209da6-a3fe-4b82-a405-11d009602356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.196471 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2ac77-3590-443d-8a87-cb509d912593 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:51.208222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2c209da6-a3fe-4b82-a405-11d009602356 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:51.209450 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2c209da6-a3fe-4b82-a405-11d009602356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:51.252308 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ee503-4c7d-4df6-b51c-82b5d00a4633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:51.253055 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ee503-4c7d-4df6-b51c-82b5d00a4633 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.253335 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ee503-4c7d-4df6-b51c-82b5d00a4633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.253611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ee503-4c7d-4df6-b51c-82b5d00a4633 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.254336 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ee503-4c7d-4df6-b51c-82b5d00a4633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:49:51.254646 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ee503-4c7d-4df6-b51c-82b5d00a4633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:51.256249 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ee503-4c7d-4df6-b51c-82b5d00a4633 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:51.267135 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 784/1574] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:51.274753 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 791/1575] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:49:51.275445 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c209da6-a3fe-4b82-a405-11d009602356 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:51.275566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ee503-4c7d-4df6-b51c-82b5d00a4633 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:51.280877 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c209da6-a3fe-4b82-a405-11d009602356 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:51.281040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ee503-4c7d-4df6-b51c-82b5d00a4633 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:51.285810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfe106-e7ac-4c36-86a8-3082cc51889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:51.286142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc98612-4269-42a5-848d-7d02f3c7f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:51.286613 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfe106-e7ac-4c36-86a8-3082cc51889a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.286808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc98612-4269-42a5-848d-7d02f3c7f19f admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.286947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfe106-e7ac-4c36-86a8-3082cc51889a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.287096 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc98612-4269-42a5-848d-7d02f3c7f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.287213 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfe106-e7ac-4c36-86a8-3082cc51889a admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.287353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc98612-4269-42a5-848d-7d02f3c7f19f admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.287879 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfe106-e7ac-4c36-86a8-3082cc51889a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:49:51.288032 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc98612-4269-42a5-848d-7d02f3c7f19f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:51.288198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfe106-e7ac-4c36-86a8-3082cc51889a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:51.289813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfe106-e7ac-4c36-86a8-3082cc51889a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:51.290038 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc98612-4269-42a5-848d-7d02f3c7f19f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:51.304124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 792/1576] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:49:51.304986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfe106-e7ac-4c36-86a8-3082cc51889a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:51.315634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfe106-e7ac-4c36-86a8-3082cc51889a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:51.320232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ecdbc-a3c8-478a-b8ba-66534136792d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:51.320925 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ecdbc-a3c8-478a-b8ba-66534136792d admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.321208 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ecdbc-a3c8-478a-b8ba-66534136792d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.321532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ecdbc-a3c8-478a-b8ba-66534136792d admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.322235 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ecdbc-a3c8-478a-b8ba-66534136792d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:51.324156 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ecdbc-a3c8-478a-b8ba-66534136792d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:51.375199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 785/1577] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:49:51 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:51.376009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc98612-4269-42a5-848d-7d02f3c7f19f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:51.385696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc98612-4269-42a5-848d-7d02f3c7f19f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:51.390694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b770f3-707a-4edf-9290-e0301ab80796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:51.391643 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b770f3-707a-4edf-9290-e0301ab80796 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.391935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b770f3-707a-4edf-9290-e0301ab80796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.392215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b770f3-707a-4edf-9290-e0301ab80796 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.396814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b770f3-707a-4edf-9290-e0301ab80796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:51.399581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b770f3-707a-4edf-9290-e0301ab80796 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:51.433518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 793/1578] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:49:51 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:51.434818 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49305235-a9a9-4423-b321-42833c86ee33 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.435103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49305235-a9a9-4423-b321-42833c86ee33 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.435380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49305235-a9a9-4423-b321-42833c86ee33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.460487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-49305235-a9a9-4423-b321-42833c86ee33 None None] MFA Rules not processed for user `ac35cb05faf746978c0c71b344b51e94`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:51.461682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-49305235-a9a9-4423-b321-42833c86ee33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:51.501806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 786/1579] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:49:51 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:51.503252 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b770f3-707a-4edf-9290-e0301ab80796 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:51.527413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 794/1580] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:51.528701 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49305235-a9a9-4423-b321-42833c86ee33 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:51.567317 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b770f3-707a-4edf-9290-e0301ab80796 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:51.572294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e51156-d177-47e0-84a8-0bbea0a973d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:51.572992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e51156-d177-47e0-84a8-0bbea0a973d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.573280 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e51156-d177-47e0-84a8-0bbea0a973d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.573622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e51156-d177-47e0-84a8-0bbea0a973d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.574319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e51156-d177-47e0-84a8-0bbea0a973d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:51.576241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e51156-d177-47e0-84a8-0bbea0a973d0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:51.591087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49305235-a9a9-4423-b321-42833c86ee33 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:51.596008 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b9b3e-045d-4996-9954-38e5e4fff534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:51.596727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b9b3e-045d-4996-9954-38e5e4fff534 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.597010 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b9b3e-045d-4996-9954-38e5e4fff534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.597284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b9b3e-045d-4996-9954-38e5e4fff534 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.597975 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b9b3e-045d-4996-9954-38e5e4fff534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:51.599878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b9b3e-045d-4996-9954-38e5e4fff534 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:51.698262 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 787/1581] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:49:51 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:51.698262 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e51156-d177-47e0-84a8-0bbea0a973d0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:51.737203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 795/1582] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:49:51 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:51.738197 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b9b3e-045d-4996-9954-38e5e4fff534 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:51.750213 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e51156-d177-47e0-84a8-0bbea0a973d0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:51.799304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bab21-87f5-4c30-89d8-e2315c0f8888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:51.799940 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bab21-87f5-4c30-89d8-e2315c0f8888 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.800143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bab21-87f5-4c30-89d8-e2315c0f8888 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.800323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b9b3e-045d-4996-9954-38e5e4fff534 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:51.800455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bab21-87f5-4c30-89d8-e2315c0f8888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.805058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135db52-8181-4fb9-ba92-4a94e32de3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:51.805714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135db52-8181-4fb9-ba92-4a94e32de3bf admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.806143 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135db52-8181-4fb9-ba92-4a94e32de3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.806522 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135db52-8181-4fb9-ba92-4a94e32de3bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.807118 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135db52-8181-4fb9-ba92-4a94e32de3bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:51.809052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135db52-8181-4fb9-ba92-4a94e32de3bf admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:51.809460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bab21-87f5-4c30-89d8-e2315c0f8888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:51.810872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bab21-87f5-4c30-89d8-e2315c0f8888 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:51.820183 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 788/1583] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:49:51.821010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bab21-87f5-4c30-89d8-e2315c0f8888 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:51.830142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bab21-87f5-4c30-89d8-e2315c0f8888 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:51.834923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751fe9f-4fae-47cb-a237-23d4fd46f575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:51.835585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751fe9f-4fae-47cb-a237-23d4fd46f575 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.835868 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751fe9f-4fae-47cb-a237-23d4fd46f575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.836145 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751fe9f-4fae-47cb-a237-23d4fd46f575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.836911 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751fe9f-4fae-47cb-a237-23d4fd46f575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:51.839083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751fe9f-4fae-47cb-a237-23d4fd46f575 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:51.849107 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 789/1584] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:51.849107 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751fe9f-4fae-47cb-a237-23d4fd46f575 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:51.859878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751fe9f-4fae-47cb-a237-23d4fd46f575 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:51.864531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7052c-b39d-430b-a0d9-85959cdf8c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:51.865165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7052c-b39d-430b-a0d9-85959cdf8c60 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.865452 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7052c-b39d-430b-a0d9-85959cdf8c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.865728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7052c-b39d-430b-a0d9-85959cdf8c60 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.866403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7052c-b39d-430b-a0d9-85959cdf8c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:51.868313 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7052c-b39d-430b-a0d9-85959cdf8c60 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:51.902165 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 796/1585] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:49:51 2022] POST /identity/v3/projects => generated 405 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:51.902977 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135db52-8181-4fb9-ba92-4a94e32de3bf admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:51.961575 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135db52-8181-4fb9-ba92-4a94e32de3bf admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:51.967135 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae861bf9-c728-47b7-8016-38495c9898fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:51.967897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae861bf9-c728-47b7-8016-38495c9898fa admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:51.968174 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae861bf9-c728-47b7-8016-38495c9898fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:51.968455 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae861bf9-c728-47b7-8016-38495c9898fa admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:51.971999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae861bf9-c728-47b7-8016-38495c9898fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:51.971999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae861bf9-c728-47b7-8016-38495c9898fa admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:51.997772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 790/1586] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:49:51 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:51.998428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7052c-b39d-430b-a0d9-85959cdf8c60 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.007610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7052c-b39d-430b-a0d9-85959cdf8c60 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.013467 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37667814-8fb8-4efa-8e47-352f14be9d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.014192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37667814-8fb8-4efa-8e47-352f14be9d37 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.014543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37667814-8fb8-4efa-8e47-352f14be9d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.014887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37667814-8fb8-4efa-8e47-352f14be9d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.015701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37667814-8fb8-4efa-8e47-352f14be9d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.017748 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37667814-8fb8-4efa-8e47-352f14be9d37 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.078362 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 797/1587] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:49:51 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:52.081254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae861bf9-c728-47b7-8016-38495c9898fa admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.089623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae861bf9-c728-47b7-8016-38495c9898fa admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.094235 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b7f13-dbd6-41de-a798-b426d1cf6a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.094875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b7f13-dbd6-41de-a798-b426d1cf6a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.095156 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b7f13-dbd6-41de-a798-b426d1cf6a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.095431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b7f13-dbd6-41de-a798-b426d1cf6a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.096152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b7f13-dbd6-41de-a798-b426d1cf6a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.097771 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b7f13-dbd6-41de-a798-b426d1cf6a56 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.107621 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 798/1588] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:52.108512 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b7f13-dbd6-41de-a798-b426d1cf6a56 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.112209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 791/1589] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:49:51 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:52.112209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37667814-8fb8-4efa-8e47-352f14be9d37 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.118824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b7f13-dbd6-41de-a798-b426d1cf6a56 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.174125 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37667814-8fb8-4efa-8e47-352f14be9d37 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.177392 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790403ea-4908-4f36-ae96-8d3dc8817b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.178068 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790403ea-4908-4f36-ae96-8d3dc8817b85 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.178362 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790403ea-4908-4f36-ae96-8d3dc8817b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.178625 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790403ea-4908-4f36-ae96-8d3dc8817b85 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.179326 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790403ea-4908-4f36-ae96-8d3dc8817b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.180365 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cbc8a-57b3-4793-bf30-31f54c7e31ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.181432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cbc8a-57b3-4793-bf30-31f54c7e31ac admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.181558 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790403ea-4908-4f36-ae96-8d3dc8817b85 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.181967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cbc8a-57b3-4793-bf30-31f54c7e31ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.182390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cbc8a-57b3-4793-bf30-31f54c7e31ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.183329 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cbc8a-57b3-4793-bf30-31f54c7e31ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.185434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cbc8a-57b3-4793-bf30-31f54c7e31ac admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.196901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 792/1590] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:52.198076 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cbc8a-57b3-4793-bf30-31f54c7e31ac admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.207635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cbc8a-57b3-4793-bf30-31f54c7e31ac admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.213046 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab923395-44e9-4ad6-9319-844a87b954a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.213696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab923395-44e9-4ad6-9319-844a87b954a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.213975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab923395-44e9-4ad6-9319-844a87b954a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.214247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab923395-44e9-4ad6-9319-844a87b954a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.214929 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab923395-44e9-4ad6-9319-844a87b954a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.216973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab923395-44e9-4ad6-9319-844a87b954a5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.252587 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 799/1591] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:49:52 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:52.253426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790403ea-4908-4f36-ae96-8d3dc8817b85 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.263920 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790403ea-4908-4f36-ae96-8d3dc8817b85 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.268597 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22f51f-741e-4963-9fae-7bd3cf0b9482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.269244 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22f51f-741e-4963-9fae-7bd3cf0b9482 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.269526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22f51f-741e-4963-9fae-7bd3cf0b9482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.269797 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22f51f-741e-4963-9fae-7bd3cf0b9482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.270510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22f51f-741e-4963-9fae-7bd3cf0b9482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.272096 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22f51f-741e-4963-9fae-7bd3cf0b9482 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.282259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 800/1592] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:52.283070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22f51f-741e-4963-9fae-7bd3cf0b9482 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.293247 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22f51f-741e-4963-9fae-7bd3cf0b9482 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.297673 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457d938-7ebf-4e35-be4e-f8d09244beb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.303003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457d938-7ebf-4e35-be4e-f8d09244beb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.303003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457d938-7ebf-4e35-be4e-f8d09244beb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.303003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457d938-7ebf-4e35-be4e-f8d09244beb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.303003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457d938-7ebf-4e35-be4e-f8d09244beb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.303003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457d938-7ebf-4e35-be4e-f8d09244beb9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.305393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 793/1593] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:49:52 2022] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:52.307920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab923395-44e9-4ad6-9319-844a87b954a5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.312739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 801/1594] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:52.313557 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457d938-7ebf-4e35-be4e-f8d09244beb9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.320849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab923395-44e9-4ad6-9319-844a87b954a5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.323755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457d938-7ebf-4e35-be4e-f8d09244beb9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.329385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccf5ea-fac3-44b9-a006-1485e41e4939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.331478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17326c-b632-4144-b72a-1e191970777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.331628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccf5ea-fac3-44b9-a006-1485e41e4939 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.331750 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17326c-b632-4144-b72a-1e191970777e admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.331855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccf5ea-fac3-44b9-a006-1485e41e4939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.331955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17326c-b632-4144-b72a-1e191970777e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.332050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccf5ea-fac3-44b9-a006-1485e41e4939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.332136 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17326c-b632-4144-b72a-1e191970777e admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.332301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccf5ea-fac3-44b9-a006-1485e41e4939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.332381 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17326c-b632-4144-b72a-1e191970777e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.333320 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccf5ea-fac3-44b9-a006-1485e41e4939 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.333823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17326c-b632-4144-b72a-1e191970777e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.344610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 794/1595] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:52.345492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccf5ea-fac3-44b9-a006-1485e41e4939 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.355450 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccf5ea-fac3-44b9-a006-1485e41e4939 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.359941 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799d65c-2f86-4633-a940-a7d35e802aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.360869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799d65c-2f86-4633-a940-a7d35e802aab admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.361146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799d65c-2f86-4633-a940-a7d35e802aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.361416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799d65c-2f86-4633-a940-a7d35e802aab admin admin] PATH_INFO: `/v3/projects/315bc11153674d80b7583a9e12aa7403/users/f0f8cb60eb22499db31259081123d47b/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.375815 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799d65c-2f86-4633-a940-a7d35e802aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=315bc11153674d80b7583a9e12aa7403, user_id=f0f8cb60eb22499db31259081123d47b, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.378465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799d65c-2f86-4633-a940-a7d35e802aab admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.425903 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 802/1596] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:49:52 2022] POST /identity/v3/users => generated 309 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:52.426719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17326c-b632-4144-b72a-1e191970777e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.437472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17326c-b632-4144-b72a-1e191970777e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.442135 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49114dc8-2052-4c1f-ae2a-af1a9a9c3157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.442787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49114dc8-2052-4c1f-ae2a-af1a9a9c3157 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.443070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49114dc8-2052-4c1f-ae2a-af1a9a9c3157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.443349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49114dc8-2052-4c1f-ae2a-af1a9a9c3157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.444070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49114dc8-2052-4c1f-ae2a-af1a9a9c3157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.445703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49114dc8-2052-4c1f-ae2a-af1a9a9c3157 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.455741 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 803/1597] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:52.461790 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49114dc8-2052-4c1f-ae2a-af1a9a9c3157 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.466736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49114dc8-2052-4c1f-ae2a-af1a9a9c3157 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.471334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7d245-ab5c-41c9-b378-c8b624151add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.471979 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7d245-ab5c-41c9-b378-c8b624151add admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.472258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7d245-ab5c-41c9-b378-c8b624151add admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.472565 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7d245-ab5c-41c9-b378-c8b624151add admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.473284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7d245-ab5c-41c9-b378-c8b624151add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.474866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7d245-ab5c-41c9-b378-c8b624151add admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.489828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 804/1598] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:52.494284 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 795/1599] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:49:52 2022] PUT /identity/v3/projects/315bc11153674d80b7583a9e12aa7403/users/f0f8cb60eb22499db31259081123d47b/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:49:52.494784 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7d245-ab5c-41c9-b378-c8b624151add admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.494976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799d65c-2f86-4633-a940-a7d35e802aab admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.509988 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7d245-ab5c-41c9-b378-c8b624151add admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.574274 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799d65c-2f86-4633-a940-a7d35e802aab admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.574274 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe386bc5-ee1f-4796-85e1-24343dc7f72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.574274 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe386bc5-ee1f-4796-85e1-24343dc7f72f admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.574274 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe386bc5-ee1f-4796-85e1-24343dc7f72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.574817 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe386bc5-ee1f-4796-85e1-24343dc7f72f admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.574817 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe386bc5-ee1f-4796-85e1-24343dc7f72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.575852 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe386bc5-ee1f-4796-85e1-24343dc7f72f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.579820 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb244c2c-c780-453f-8b3a-9c60945855e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.581678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb244c2c-c780-453f-8b3a-9c60945855e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.581678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb244c2c-c780-453f-8b3a-9c60945855e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.582020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb244c2c-c780-453f-8b3a-9c60945855e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.582822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb244c2c-c780-453f-8b3a-9c60945855e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.584584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb244c2c-c780-453f-8b3a-9c60945855e3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.590769 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 796/1600] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:52.590769 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe386bc5-ee1f-4796-85e1-24343dc7f72f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.599206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 805/1601] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:52.599206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb244c2c-c780-453f-8b3a-9c60945855e3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.604198 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe386bc5-ee1f-4796-85e1-24343dc7f72f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.609564 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a532ef-b987-4b7e-b8f2-7af74ad6d5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.616175 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb244c2c-c780-453f-8b3a-9c60945855e3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.616299 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a532ef-b987-4b7e-b8f2-7af74ad6d5cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.616299 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a532ef-b987-4b7e-b8f2-7af74ad6d5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.616299 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a532ef-b987-4b7e-b8f2-7af74ad6d5cf admin admin] PATH_INFO: `/v3/projects/65ea04a5ce2f4f75968d7d0204336cf6/users/3b220b08ef304644b329bcd31f0247f7/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.616629 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b7de6-d0b0-439b-9ae2-0ed1c4e90d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.616629 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b7de6-d0b0-439b-9ae2-0ed1c4e90d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.616629 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b7de6-d0b0-439b-9ae2-0ed1c4e90d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.616629 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b7de6-d0b0-439b-9ae2-0ed1c4e90d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.616996 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b7de6-d0b0-439b-9ae2-0ed1c4e90d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.617845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b7de6-d0b0-439b-9ae2-0ed1c4e90d9a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.626881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a532ef-b987-4b7e-b8f2-7af74ad6d5cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ea04a5ce2f4f75968d7d0204336cf6, user_id=3b220b08ef304644b329bcd31f0247f7, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.628075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 806/1602] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:52.628075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b7de6-d0b0-439b-9ae2-0ed1c4e90d9a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.631661 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a532ef-b987-4b7e-b8f2-7af74ad6d5cf admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.639483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b7de6-d0b0-439b-9ae2-0ed1c4e90d9a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.644387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a651975-84c8-4750-a2df-3d426d05f55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.645080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a651975-84c8-4750-a2df-3d426d05f55f admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.645397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a651975-84c8-4750-a2df-3d426d05f55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.645665 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a651975-84c8-4750-a2df-3d426d05f55f admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.646381 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a651975-84c8-4750-a2df-3d426d05f55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.647949 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a651975-84c8-4750-a2df-3d426d05f55f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.659541 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 807/1603] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:52.660573 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a651975-84c8-4750-a2df-3d426d05f55f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.670768 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a651975-84c8-4750-a2df-3d426d05f55f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.675853 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21e900-c4a7-47f2-8e79-8def523a6423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.676773 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e900-c4a7-47f2-8e79-8def523a6423 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.677059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e900-c4a7-47f2-8e79-8def523a6423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.677336 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e900-c4a7-47f2-8e79-8def523a6423 admin admin] PATH_INFO: `/v3/projects/56e43f1ac6b545459d949f659c6d7ef3/users/c6f2f2a51c7543c3af725aad92c8c678/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.693338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 797/1604] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:49:52 2022] PUT /identity/v3/projects/65ea04a5ce2f4f75968d7d0204336cf6/users/3b220b08ef304644b329bcd31f0247f7/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:49:52.694910 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9f247-4de2-4aef-9d9d-18000b71d384 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.695192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9f247-4de2-4aef-9d9d-18000b71d384 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.695623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9f247-4de2-4aef-9d9d-18000b71d384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.698365 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21e900-c4a7-47f2-8e79-8def523a6423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e43f1ac6b545459d949f659c6d7ef3, user_id=c6f2f2a51c7543c3af725aad92c8c678, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.701630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21e900-c4a7-47f2-8e79-8def523a6423 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.719522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-acd9f247-4de2-4aef-9d9d-18000b71d384 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:52.720965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-acd9f247-4de2-4aef-9d9d-18000b71d384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:52.768588 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 808/1605] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:49:52 2022] PUT /identity/v3/projects/56e43f1ac6b545459d949f659c6d7ef3/users/c6f2f2a51c7543c3af725aad92c8c678/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:49:52.779750 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21e900-c4a7-47f2-8e79-8def523a6423 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.783791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 798/1606] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:52.784726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9f247-4de2-4aef-9d9d-18000b71d384 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.795084 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9f247-4de2-4aef-9d9d-18000b71d384 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.843819 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21e900-c4a7-47f2-8e79-8def523a6423 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.848376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfc35f-ac45-4a35-8a37-fbdf613e55e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.849285 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfc35f-ac45-4a35-8a37-fbdf613e55e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.849560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfc35f-ac45-4a35-8a37-fbdf613e55e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.849832 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfc35f-ac45-4a35-8a37-fbdf613e55e2 admin admin] PATH_INFO: `/v3/projects/0a80a63e96c840f1a780b0b263f68aa9/users/4f49f50b0a7841c4a117cc5e2e1dccb1/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.853397 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf353a-6ea7-497f-849d-238552f61a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.854069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf353a-6ea7-497f-849d-238552f61a3d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.854353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf353a-6ea7-497f-849d-238552f61a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.854627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf353a-6ea7-497f-849d-238552f61a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.855355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf353a-6ea7-497f-849d-238552f61a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.857118 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf353a-6ea7-497f-849d-238552f61a3d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.863891 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfc35f-ac45-4a35-8a37-fbdf613e55e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a80a63e96c840f1a780b0b263f68aa9, user_id=4f49f50b0a7841c4a117cc5e2e1dccb1, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.866544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfc35f-ac45-4a35-8a37-fbdf613e55e2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.866773 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 799/1607] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:52.867564 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf353a-6ea7-497f-849d-238552f61a3d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.880005 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf353a-6ea7-497f-849d-238552f61a3d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:52.883606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913a6ef-6320-49a9-add3-fa9a52a8ac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:52.885088 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913a6ef-6320-49a9-add3-fa9a52a8ac77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.885593 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913a6ef-6320-49a9-add3-fa9a52a8ac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.885875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913a6ef-6320-49a9-add3-fa9a52a8ac77 admin admin] PATH_INFO: `/v3/projects/841c32d11e35444e81cf00767e54eb4a/users/2bec0737d8424a24aee8c8429de7df56/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:52.902619 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913a6ef-6320-49a9-add3-fa9a52a8ac77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=841c32d11e35444e81cf00767e54eb4a, user_id=2bec0737d8424a24aee8c8429de7df56, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:52.905544 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913a6ef-6320-49a9-add3-fa9a52a8ac77 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:52.963145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 809/1608] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:49:52 2022] PUT /identity/v3/projects/0a80a63e96c840f1a780b0b263f68aa9/users/4f49f50b0a7841c4a117cc5e2e1dccb1/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:49:52.963145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfc35f-ac45-4a35-8a37-fbdf613e55e2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:52.978678 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 800/1609] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:49:52 2022] PUT /identity/v3/projects/841c32d11e35444e81cf00767e54eb4a/users/2bec0737d8424a24aee8c8429de7df56/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:49:52.984630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabcdb5-6bd3-4bfa-a961-2a3d0a8b0b83 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:52.984630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabcdb5-6bd3-4bfa-a961-2a3d0a8b0b83 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:52.984630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabcdb5-6bd3-4bfa-a961-2a3d0a8b0b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:53.000010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-feabcdb5-6bd3-4bfa-a961-2a3d0a8b0b83 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:53.001301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-feabcdb5-6bd3-4bfa-a961-2a3d0a8b0b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:53.025007 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfc35f-ac45-4a35-8a37-fbdf613e55e2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:53.066754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 801/1610] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:53.068156 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d74499-e2eb-4279-a7ac-051d9de0f28d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:53.068461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d74499-e2eb-4279-a7ac-051d9de0f28d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:53.068747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d74499-e2eb-4279-a7ac-051d9de0f28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:53.086040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb9e3c-6a37-4c90-9c5d-d439ed207123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:53.086960 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb9e3c-6a37-4c90-9c5d-d439ed207123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:53.087301 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb9e3c-6a37-4c90-9c5d-d439ed207123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:53.087576 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb9e3c-6a37-4c90-9c5d-d439ed207123 admin admin] PATH_INFO: `/v3/projects/1e86d64e07b5439c8ff99dbebc95ca72/users/f0b15660aa77430e80c252ed417cd1f2/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:53.096475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d2d74499-e2eb-4279-a7ac-051d9de0f28d None None] MFA Rules not processed for user `c6f2f2a51c7543c3af725aad92c8c678`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:53.097681 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d2d74499-e2eb-4279-a7ac-051d9de0f28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:53.103273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb9e3c-6a37-4c90-9c5d-d439ed207123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e86d64e07b5439c8ff99dbebc95ca72, user_id=f0b15660aa77430e80c252ed417cd1f2, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:53.106081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb9e3c-6a37-4c90-9c5d-d439ed207123 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:53.167311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 802/1611] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:53.168470 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d74499-e2eb-4279-a7ac-051d9de0f28d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:53.173725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 810/1612] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:49:52 2022] PUT /identity/v3/projects/1e86d64e07b5439c8ff99dbebc95ca72/users/f0b15660aa77430e80c252ed417cd1f2/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:49:53.174614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb9e3c-6a37-4c90-9c5d-d439ed207123 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:53.233492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d74499-e2eb-4279-a7ac-051d9de0f28d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:53.257072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb9e3c-6a37-4c90-9c5d-d439ed207123 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:53.262935 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8354725-59fe-4827-9402-bf2d4f844fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:53.263853 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8354725-59fe-4827-9402-bf2d4f844fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:53.264130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8354725-59fe-4827-9402-bf2d4f844fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:53.264401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8354725-59fe-4827-9402-bf2d4f844fc6 admin admin] PATH_INFO: `/v3/projects/e7af3b817ec64181be4ccda0d50d3660/users/d301f56693364b39b17a12eb015eb1ab/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:53.279955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8354725-59fe-4827-9402-bf2d4f844fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7af3b817ec64181be4ccda0d50d3660, user_id=d301f56693364b39b17a12eb015eb1ab, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:53.282998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8354725-59fe-4827-9402-bf2d4f844fc6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:53.295938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51a51e-5d55-49b3-9b98-967d4681d1b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:53.296651 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51a51e-5d55-49b3-9b98-967d4681d1b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:53.296935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51a51e-5d55-49b3-9b98-967d4681d1b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:53.297212 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51a51e-5d55-49b3-9b98-967d4681d1b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:53.307750 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51a51e-5d55-49b3-9b98-967d4681d1b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:53.309475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51a51e-5d55-49b3-9b98-967d4681d1b8 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:53.319465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 803/1613] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:49:53.325031 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0113b39-ad4a-4c28-8caf-722a606894c3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:53.325031 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0113b39-ad4a-4c28-8caf-722a606894c3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:53.325031 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0113b39-ad4a-4c28-8caf-722a606894c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:53.343637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a0113b39-ad4a-4c28-8caf-722a606894c3 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:53.345186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a0113b39-ad4a-4c28-8caf-722a606894c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:53.355026 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 804/1614] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:53.355716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0113b39-ad4a-4c28-8caf-722a606894c3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:53.370153 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0113b39-ad4a-4c28-8caf-722a606894c3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:53.375626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491af208-613b-4b15-a73f-fa4b8c974add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:53.376424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491af208-613b-4b15-a73f-fa4b8c974add admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:53.376857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491af208-613b-4b15-a73f-fa4b8c974add admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:53.377211 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491af208-613b-4b15-a73f-fa4b8c974add admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:53.378196 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491af208-613b-4b15-a73f-fa4b8c974add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:53.380424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491af208-613b-4b15-a73f-fa4b8c974add admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:53.382152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 811/1615] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:49:53 2022] PUT /identity/v3/projects/e7af3b817ec64181be4ccda0d50d3660/users/d301f56693364b39b17a12eb015eb1ab/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:49:53.383265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8354725-59fe-4827-9402-bf2d4f844fc6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:53.387400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c8354725-59fe-4827-9402-bf2d4f844fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:53.401280 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 805/1616] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:53.402940 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491af208-613b-4b15-a73f-fa4b8c974add admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:53.414685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491af208-613b-4b15-a73f-fa4b8c974add admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:53.464684 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8354725-59fe-4827-9402-bf2d4f844fc6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:53.470405 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7da9a0-087e-45ab-af92-666a1104aa6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:53.471436 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7da9a0-087e-45ab-af92-666a1104aa6d service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:53.472269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7da9a0-087e-45ab-af92-666a1104aa6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:53.472610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7da9a0-087e-45ab-af92-666a1104aa6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:53.483690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaf867-c605-4930-845b-325b013df0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:53.484475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaf867-c605-4930-845b-325b013df0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:53.484915 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaf867-c605-4930-845b-325b013df0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:53.485279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaf867-c605-4930-845b-325b013df0b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:53.486163 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbaf867-c605-4930-845b-325b013df0b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:53.488801 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbaf867-c605-4930-845b-325b013df0b6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:53.552095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7da9a0-087e-45ab-af92-666a1104aa6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:53.553620 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7da9a0-087e-45ab-af92-666a1104aa6d service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:53.564172 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 812/1617] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:49:53.566223 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cb663-949f-44ce-b8ad-271755fc2fc0 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:53.566835 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cb663-949f-44ce-b8ad-271755fc2fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:53.567313 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cb663-949f-44ce-b8ad-271755fc2fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:53.586358 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 806/1618] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:49:53 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:53.588297 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaf867-c605-4930-845b-325b013df0b6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:53.602127 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-998cb663-949f-44ce-b8ad-271755fc2fc0 None None] MFA Rules not processed for user `f0b15660aa77430e80c252ed417cd1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:53.604577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-998cb663-949f-44ce-b8ad-271755fc2fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:53.684612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaf867-c605-4930-845b-325b013df0b6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:53.692302 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 813/1619] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:53.693841 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd7c85-1d63-4262-b219-f51d9cd9ae50 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:53.694262 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd7c85-1d63-4262-b219-f51d9cd9ae50 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:53.694649 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd7c85-1d63-4262-b219-f51d9cd9ae50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:53.697307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b879ecc-ac8a-4bac-b296-e037b1c217e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:53.698260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b879ecc-ac8a-4bac-b296-e037b1c217e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:53.698495 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b879ecc-ac8a-4bac-b296-e037b1c217e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:53.698758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b879ecc-ac8a-4bac-b296-e037b1c217e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:53.761070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d1cd7c85-1d63-4262-b219-f51d9cd9ae50 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:53.763163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d1cd7c85-1d63-4262-b219-f51d9cd9ae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:53.810912 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b879ecc-ac8a-4bac-b296-e037b1c217e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:53.812464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b879ecc-ac8a-4bac-b296-e037b1c217e9 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:53.825953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 807/1620] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:49:53.826855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b879ecc-ac8a-4bac-b296-e037b1c217e9 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:53.837164 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b879ecc-ac8a-4bac-b296-e037b1c217e9 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:53.843028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268ee37-7410-4c07-88d3-2e414e8cb1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:53.844779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268ee37-7410-4c07-88d3-2e414e8cb1c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:53.845134 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268ee37-7410-4c07-88d3-2e414e8cb1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:53.845548 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268ee37-7410-4c07-88d3-2e414e8cb1c9 admin admin] PATH_INFO: `/v3/projects/841c32d11e35444e81cf00767e54eb4a/users/2bec0737d8424a24aee8c8429de7df56/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:53.848089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268ee37-7410-4c07-88d3-2e414e8cb1c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=841c32d11e35444e81cf00767e54eb4a, user_id=2bec0737d8424a24aee8c8429de7df56, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:53.852387 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268ee37-7410-4c07-88d3-2e414e8cb1c9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:53.862568 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 808/1621] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:49:53 2022] PUT /identity/v3/projects/841c32d11e35444e81cf00767e54eb4a/users/2bec0737d8424a24aee8c8429de7df56/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:49:53.877448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268ee37-7410-4c07-88d3-2e414e8cb1c9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:53.886676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 814/1622] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:53.886676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2ef2d-40e9-460c-bfae-5e4e4129b713 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:53.886676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2ef2d-40e9-460c-bfae-5e4e4129b713 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:53.886676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2ef2d-40e9-460c-bfae-5e4e4129b713 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:53.886676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 815/1623] 10.222.0.81 () {54 vars in 960 bytes} [Wed May 4 17:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:49:53.886676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b071-21af-4497-87dc-1247c46268df None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:53.886676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b071-21af-4497-87dc-1247c46268df None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:53.887602 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b071-21af-4497-87dc-1247c46268df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:53.909448 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-80f0b071-21af-4497-87dc-1247c46268df None None] MFA Rules not processed for user `d4a073d8f47a485cbb22db01530f3b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:53.910959 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-80f0b071-21af-4497-87dc-1247c46268df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:53.949400 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268ee37-7410-4c07-88d3-2e414e8cb1c9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:53.954168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c0162-5965-4ca9-a823-a2793c4e73f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:53.955437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c0162-5965-4ca9-a823-a2793c4e73f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:53.955437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c0162-5965-4ca9-a823-a2793c4e73f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:53.955693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c0162-5965-4ca9-a823-a2793c4e73f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:53.956249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c0162-5965-4ca9-a823-a2793c4e73f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:53.958213 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c0162-5965-4ca9-a823-a2793c4e73f6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:53.985290 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 816/1624] 10.222.0.81 () {58 vars in 1057 bytes} [Wed May 4 17:49:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:49:53.994683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e1ed5-abae-431a-a4c2-69000944bd0e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:53.994975 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e1ed5-abae-431a-a4c2-69000944bd0e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:53.995258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e1ed5-abae-431a-a4c2-69000944bd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:54.036018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-625e1ed5-abae-431a-a4c2-69000944bd0e None None] MFA Rules not processed for user `2bec0737d8424a24aee8c8429de7df56`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:54.038085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-625e1ed5-abae-431a-a4c2-69000944bd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:54.085348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 809/1625] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:49:53 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:54.085348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c0162-5965-4ca9-a823-a2793c4e73f6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:54.177189 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 817/1626] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:53 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:54.179130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e1ed5-abae-431a-a4c2-69000944bd0e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:54.204794 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c0162-5965-4ca9-a823-a2793c4e73f6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:54.206580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e1ed5-abae-431a-a4c2-69000944bd0e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:54.210008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e3e61-e9ba-4a2b-a66a-745af0fc455b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:54.211244 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e3e61-e9ba-4a2b-a66a-745af0fc455b service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:54.211811 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e3e61-e9ba-4a2b-a66a-745af0fc455b service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:54.213171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e3e61-e9ba-4a2b-a66a-745af0fc455b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:54.222460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee5037-abab-4e2d-b7b5-87486f13344c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:54.224227 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee5037-abab-4e2d-b7b5-87486f13344c service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:54.224591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e3e61-e9ba-4a2b-a66a-745af0fc455b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:54.224735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee5037-abab-4e2d-b7b5-87486f13344c service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:54.225141 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee5037-abab-4e2d-b7b5-87486f13344c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:54.226380 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e3e61-e9ba-4a2b-a66a-745af0fc455b service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:54.238395 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 810/1627] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:49:54.239439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e3e61-e9ba-4a2b-a66a-745af0fc455b service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:54.250013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e3e61-e9ba-4a2b-a66a-745af0fc455b service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:54.255918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a5ad2-8b43-4170-977f-83aa002cddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:54.256722 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a5ad2-8b43-4170-977f-83aa002cddb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:54.257176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a5ad2-8b43-4170-977f-83aa002cddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:54.257513 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a5ad2-8b43-4170-977f-83aa002cddb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:54.258332 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a5ad2-8b43-4170-977f-83aa002cddb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:54.260241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a5ad2-8b43-4170-977f-83aa002cddb2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:54.271950 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 811/1628] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:54.272991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a5ad2-8b43-4170-977f-83aa002cddb2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:54.309611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee5037-abab-4e2d-b7b5-87486f13344c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:54.311890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee5037-abab-4e2d-b7b5-87486f13344c service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:54.325948 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 818/1629] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:49:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:49:54.326988 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee5037-abab-4e2d-b7b5-87486f13344c service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:54.338986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee5037-abab-4e2d-b7b5-87486f13344c service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:54.344050 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4923dd7-c354-47cd-bc6a-6204a7da927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:54.345159 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4923dd7-c354-47cd-bc6a-6204a7da927f admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:54.345548 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4923dd7-c354-47cd-bc6a-6204a7da927f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:54.345924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4923dd7-c354-47cd-bc6a-6204a7da927f admin admin] PATH_INFO: `/v3/projects/2691db18eb1845bcad4dc57272324005/users/590d2e5995764733bf56522c2a9c2e9e/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:54.389663 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4923dd7-c354-47cd-bc6a-6204a7da927f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2691db18eb1845bcad4dc57272324005, user_id=590d2e5995764733bf56522c2a9c2e9e, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:54.397044 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a5ad2-8b43-4170-977f-83aa002cddb2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:54.398981 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4923dd7-c354-47cd-bc6a-6204a7da927f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:54.409322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81972b33-5275-4fd7-aff8-ef42c097e93f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:54.410620 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81972b33-5275-4fd7-aff8-ef42c097e93f service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:54.410909 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81972b33-5275-4fd7-aff8-ef42c097e93f service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:54.417025 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81972b33-5275-4fd7-aff8-ef42c097e93f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:54.439407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81972b33-5275-4fd7-aff8-ef42c097e93f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:54.441687 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81972b33-5275-4fd7-aff8-ef42c097e93f service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:54.477090 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 812/1630] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:49:54 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:49:54.561834 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 819/1631] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:49:54 2022] PUT /identity/v3/projects/2691db18eb1845bcad4dc57272324005/users/590d2e5995764733bf56522c2a9c2e9e/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:49:54.565123 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81972b33-5275-4fd7-aff8-ef42c097e93f service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:54.592583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81972b33-5275-4fd7-aff8-ef42c097e93f service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:54.798646 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ec456-289c-4117-95ac-72a7aa409964 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:54.799099 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ec456-289c-4117-95ac-72a7aa409964 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:54.799455 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ec456-289c-4117-95ac-72a7aa409964 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:54.801343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 820/1632] 10.222.0.81 () {54 vars in 912 bytes} [Wed May 4 17:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:49:54.807482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae204285-a394-4f7a-b50c-d014bebbf1c8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:54.809193 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae204285-a394-4f7a-b50c-d014bebbf1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:54.810304 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae204285-a394-4f7a-b50c-d014bebbf1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:54.813098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b6209-6167-4dc7-9840-3623d086cf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:54.813848 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6209-6167-4dc7-9840-3623d086cf08 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:54.815398 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6209-6167-4dc7-9840-3623d086cf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:54.815696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6209-6167-4dc7-9840-3623d086cf08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:54.817156 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b6209-6167-4dc7-9840-3623d086cf08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:54.818720 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b6209-6167-4dc7-9840-3623d086cf08 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:54.840219 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ae204285-a394-4f7a-b50c-d014bebbf1c8 None None] MFA Rules not processed for user `d4a073d8f47a485cbb22db01530f3b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:54.842364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ae204285-a394-4f7a-b50c-d014bebbf1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:54.852505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 813/1633] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:54.854831 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b6209-6167-4dc7-9840-3623d086cf08 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:54.876146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b6209-6167-4dc7-9840-3623d086cf08 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:54.878020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bef6d9-2589-4a68-a4f6-851d38331fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:54.878981 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bef6d9-2589-4a68-a4f6-851d38331fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:54.879334 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bef6d9-2589-4a68-a4f6-851d38331fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:54.879676 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bef6d9-2589-4a68-a4f6-851d38331fa9 admin admin] PATH_INFO: `/v3/users/ac35cb05faf746978c0c71b344b51e94` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:54.881679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bef6d9-2589-4a68-a4f6-851d38331fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac35cb05faf746978c0c71b344b51e94)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:54.882984 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-a0bef6d9-2589-4a68-a4f6-851d38331fa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 17:49:54.882984 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: warnings.warn(msg) May 04 17:49:54.882984 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: May 04 17:49:54.885157 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bef6d9-2589-4a68-a4f6-851d38331fa9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:54.958034 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 821/1634] 10.222.0.81 () {58 vars in 1009 bytes} [Wed May 4 17:49:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:49:54.959935 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae204285-a394-4f7a-b50c-d014bebbf1c8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:54.973804 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae204285-a394-4f7a-b50c-d014bebbf1c8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:54.980233 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36c8fb-88b1-4ff2-bb51-2c04279f4320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:54.981281 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36c8fb-88b1-4ff2-bb51-2c04279f4320 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:54.981665 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36c8fb-88b1-4ff2-bb51-2c04279f4320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:54.981945 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36c8fb-88b1-4ff2-bb51-2c04279f4320 admin admin] PATH_INFO: `/v3/projects/2691db18eb1845bcad4dc57272324005/users/590d2e5995764733bf56522c2a9c2e9e/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:54.984084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36c8fb-88b1-4ff2-bb51-2c04279f4320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2691db18eb1845bcad4dc57272324005, user_id=590d2e5995764733bf56522c2a9c2e9e, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:54.986769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36c8fb-88b1-4ff2-bb51-2c04279f4320 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:54.998721 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 822/1635] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:49:54 2022] PUT /identity/v3/projects/2691db18eb1845bcad4dc57272324005/users/590d2e5995764733bf56522c2a9c2e9e/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:49:54.999551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36c8fb-88b1-4ff2-bb51-2c04279f4320 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:55.069651 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36c8fb-88b1-4ff2-bb51-2c04279f4320 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:55.074267 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720532a1-6173-493b-b485-697738b72b98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:55.076266 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720532a1-6173-493b-b485-697738b72b98 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:55.076760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720532a1-6173-493b-b485-697738b72b98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:55.077174 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720532a1-6173-493b-b485-697738b72b98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:55.177021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a0bef6d9-2589-4a68-a4f6-851d38331fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac35cb05faf746978c0c71b344b51e94'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:49:55.197882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720532a1-6173-493b-b485-697738b72b98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:55.199787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720532a1-6173-493b-b485-697738b72b98 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:55.206355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a0bef6d9-2589-4a68-a4f6-851d38331fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac35cb05faf746978c0c71b344b51e94'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:49:55.237963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 823/1636] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:49:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:49:55.239669 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991209d-b640-4491-9c65-39e868191d4e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:55.239976 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991209d-b640-4491-9c65-39e868191d4e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:55.240233 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991209d-b640-4491-9c65-39e868191d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:55.277762 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6991209d-b640-4491-9c65-39e868191d4e None None] MFA Rules not processed for user `590d2e5995764733bf56522c2a9c2e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:55.281601 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6991209d-b640-4491-9c65-39e868191d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:55.290195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a0bef6d9-2589-4a68-a4f6-851d38331fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac35cb05faf746978c0c71b344b51e94'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:49:55.311728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a0bef6d9-2589-4a68-a4f6-851d38331fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac35cb05faf746978c0c71b344b51e94'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:49:55.318089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a0bef6d9-2589-4a68-a4f6-851d38331fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac35cb05faf746978c0c71b344b51e94'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:49:55.338237 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 814/1637] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:49:54 2022] DELETE /identity/v3/users/ac35cb05faf746978c0c71b344b51e94 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:49:55.339721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7870a-ea07-46f2-a51a-accb816d4b10 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:55.340171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7870a-ea07-46f2-a51a-accb816d4b10 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:55.340495 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7870a-ea07-46f2-a51a-accb816d4b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:55.380582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-07f7870a-ea07-46f2-a51a-accb816d4b10 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:55.384199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-07f7870a-ea07-46f2-a51a-accb816d4b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:55.471441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 824/1638] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:55.487508 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 815/1639] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:49:55.489845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991209d-b640-4491-9c65-39e868191d4e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:55.492624 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6991209d-b640-4491-9c65-39e868191d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:55.507329 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991209d-b640-4491-9c65-39e868191d4e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:55.553921 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7870a-ea07-46f2-a51a-accb816d4b10 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:55.555556 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-07f7870a-ea07-46f2-a51a-accb816d4b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:55.640636 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae9f6e-7c55-4585-8399-82fe8a2bd750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:55.641310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae9f6e-7c55-4585-8399-82fe8a2bd750 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:55.641596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae9f6e-7c55-4585-8399-82fe8a2bd750 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:55.641871 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae9f6e-7c55-4585-8399-82fe8a2bd750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:55.754514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7870a-ea07-46f2-a51a-accb816d4b10 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:55.768049 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5402131-cd3d-488b-ac6c-a56e6af011f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:55.768880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402131-cd3d-488b-ac6c-a56e6af011f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:55.769232 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402131-cd3d-488b-ac6c-a56e6af011f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:55.769720 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402131-cd3d-488b-ac6c-a56e6af011f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:55.791086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5402131-cd3d-488b-ac6c-a56e6af011f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:55.794649 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5402131-cd3d-488b-ac6c-a56e6af011f0 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:55.818153 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 816/1640] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:49:55.831722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae9f6e-7c55-4585-8399-82fe8a2bd750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:55.833219 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae9f6e-7c55-4585-8399-82fe8a2bd750 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:55.846753 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 825/1641] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:49:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:49:56.245964 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71657e40-7572-498a-9a33-70107b2c50ab None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:56.246833 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71657e40-7572-498a-9a33-70107b2c50ab None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:56.246833 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71657e40-7572-498a-9a33-70107b2c50ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:56.292646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-71657e40-7572-498a-9a33-70107b2c50ab None None] MFA Rules not processed for user `f0f8cb60eb22499db31259081123d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:56.298304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-71657e40-7572-498a-9a33-70107b2c50ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:56.356041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae9f6e-7c55-4585-8399-82fe8a2bd750 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:56.365260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae9f6e-7c55-4585-8399-82fe8a2bd750 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:56.381895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77958864-13ba-4199-b967-2d968a083a5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:56.382655 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77958864-13ba-4199-b967-2d968a083a5b service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:56.383094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77958864-13ba-4199-b967-2d968a083a5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:56.384683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77958864-13ba-4199-b967-2d968a083a5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:56.392816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-77958864-13ba-4199-b967-2d968a083a5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:56.463676 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 817/1642] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:56.475866 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcb64a-8247-4df3-a60b-526ff3bd9eac None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:56.476214 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcb64a-8247-4df3-a60b-526ff3bd9eac None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:56.476515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcb64a-8247-4df3-a60b-526ff3bd9eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:56.497049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77958864-13ba-4199-b967-2d968a083a5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:56.497858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fabcb64a-8247-4df3-a60b-526ff3bd9eac None None] MFA Rules not processed for user `f0f8cb60eb22499db31259081123d47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:56.499269 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fabcb64a-8247-4df3-a60b-526ff3bd9eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:56.499391 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77958864-13ba-4199-b967-2d968a083a5b service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:56.508473 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 818/1643] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:49:56.511536 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 826/1644] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:49:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:49:56.527473 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c644b2-6742-4ea8-8dc9-681613706f63 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:56.533220 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c644b2-6742-4ea8-8dc9-681613706f63 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:56.533220 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c644b2-6742-4ea8-8dc9-681613706f63 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:56.533220 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 819/1645] 10.222.0.81 () {54 vars in 960 bytes} [Wed May 4 17:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:49:56.538913 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712809a1-f60c-422c-86e1-9d4ff11bee63 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:56.539171 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712809a1-f60c-422c-86e1-9d4ff11bee63 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:56.539405 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712809a1-f60c-422c-86e1-9d4ff11bee63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:56.566591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-712809a1-f60c-422c-86e1-9d4ff11bee63 None None] MFA Rules not processed for user `d4a073d8f47a485cbb22db01530f3b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:56.573155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-712809a1-f60c-422c-86e1-9d4ff11bee63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:56.708165 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 827/1646] 10.222.0.81 () {58 vars in 1057 bytes} [Wed May 4 17:49:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:56.716933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c644b2-6742-4ea8-8dc9-681613706f63 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:56.739430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c644b2-6742-4ea8-8dc9-681613706f63 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:56.762623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028d396-82fa-4c5d-8af5-d3cdf76df87f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:56.763048 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028d396-82fa-4c5d-8af5-d3cdf76df87f service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:56.763337 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028d396-82fa-4c5d-8af5-d3cdf76df87f service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:56.765448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028d396-82fa-4c5d-8af5-d3cdf76df87f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:56.783537 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028d396-82fa-4c5d-8af5-d3cdf76df87f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:56.785859 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028d396-82fa-4c5d-8af5-d3cdf76df87f service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:56.802056 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 820/1647] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:49:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:49:57.201394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a84d2-5a4e-4563-abde-ea528adccca9 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:57.201795 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a84d2-5a4e-4563-abde-ea528adccca9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:57.202146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a84d2-5a4e-4563-abde-ea528adccca9 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:57.205661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 828/1648] 10.222.0.81 () {54 vars in 912 bytes} [Wed May 4 17:49:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:49:57.217417 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c4487-9596-4e06-84e5-5ea57db15bc6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:57.218177 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c4487-9596-4e06-84e5-5ea57db15bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:57.219109 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c4487-9596-4e06-84e5-5ea57db15bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:57.256291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7e0c4487-9596-4e06-84e5-5ea57db15bc6 None None] MFA Rules not processed for user `d4a073d8f47a485cbb22db01530f3b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:57.257876 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7e0c4487-9596-4e06-84e5-5ea57db15bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:57.274448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 821/1649] 10.222.0.81 () {58 vars in 1009 bytes} [Wed May 4 17:49:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:57.287826 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a84d2-5a4e-4563-abde-ea528adccca9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:57.289627 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-527a84d2-5a4e-4563-abde-ea528adccca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:57.400088 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a84d2-5a4e-4563-abde-ea528adccca9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:57.405113 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6199b4-6bfa-4454-84c4-123f8a64c0f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8e2eb70a5d4dd1b3a9bec2bd0a78a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:57.405944 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6199b4-6bfa-4454-84c4-123f8a64c0f0 service glance] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:57.406318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6199b4-6bfa-4454-84c4-123f8a64c0f0 service glance] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:57.406668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6199b4-6bfa-4454-84c4-123f8a64c0f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:57.423208 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6199b4-6bfa-4454-84c4-123f8a64c0f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:57.426171 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6199b4-6bfa-4454-84c4-123f8a64c0f0 service glance] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:57.444322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c4487-9596-4e06-84e5-5ea57db15bc6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:57.446868 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7e0c4487-9596-4e06-84e5-5ea57db15bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:57.461046 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 829/1650] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:49:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:49:57.467472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c4487-9596-4e06-84e5-5ea57db15bc6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:57.473080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ac89b-cd5d-41a9-aa5c-a1451f292634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:57.476855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac89b-cd5d-41a9-aa5c-a1451f292634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:57.476855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac89b-cd5d-41a9-aa5c-a1451f292634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:57.476855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac89b-cd5d-41a9-aa5c-a1451f292634 admin admin] PATH_INFO: `/v3/projects/ad30ae0b8e9f47be9bdb04d3b478b358` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:57.476855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ac89b-cd5d-41a9-aa5c-a1451f292634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad30ae0b8e9f47be9bdb04d3b478b358)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:57.479695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ac89b-cd5d-41a9-aa5c-a1451f292634 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:57.631643 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-689ac89b-cd5d-41a9-aa5c-a1451f292634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad30ae0b8e9f47be9bdb04d3b478b358', 'request_id': 'req-689ac89b-cd5d-41a9-aa5c-a1451f292634'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:49:57.642210 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-689ac89b-cd5d-41a9-aa5c-a1451f292634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad30ae0b8e9f47be9bdb04d3b478b358', 'request_id': 'req-689ac89b-cd5d-41a9-aa5c-a1451f292634'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:49:57.747549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-689ac89b-cd5d-41a9-aa5c-a1451f292634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad30ae0b8e9f47be9bdb04d3b478b358', 'request_id': 'req-689ac89b-cd5d-41a9-aa5c-a1451f292634'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:49:57.767306 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-689ac89b-cd5d-41a9-aa5c-a1451f292634 admin admin] The token cache is being invalidate because project ad30ae0b8e9f47be9bdb04d3b478b358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:49:57.767602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-689ac89b-cd5d-41a9-aa5c-a1451f292634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:49:57.768394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-689ac89b-cd5d-41a9-aa5c-a1451f292634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:49:57.776452 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 822/1651] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:49:57 2022] DELETE /identity/v3/projects/ad30ae0b8e9f47be9bdb04d3b478b358 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:49:57.781182 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6199b4-6bfa-4454-84c4-123f8a64c0f0 service glance] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:57.787150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2619d-0167-492b-8898-982644969a7c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:57.787447 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2619d-0167-492b-8898-982644969a7c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:57.787724 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2619d-0167-492b-8898-982644969a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:57.813952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6199b4-6bfa-4454-84c4-123f8a64c0f0 service glance] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:57.852762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f9c2619d-0167-492b-8898-982644969a7c None None] MFA Rules not processed for user `d301f56693364b39b17a12eb015eb1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:57.854045 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f9c2619d-0167-492b-8898-982644969a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:58.251797 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942266ab-d771-4645-92e3-32d682d7bf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:58.251797 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942266ab-d771-4645-92e3-32d682d7bf79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:58.261670 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 823/1652] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:49:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:58.263816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942266ab-d771-4645-92e3-32d682d7bf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:58.263816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942266ab-d771-4645-92e3-32d682d7bf79 admin admin] PATH_INFO: `/v3/users/2bec0737d8424a24aee8c8429de7df56` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:58.264505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2619d-0167-492b-8898-982644969a7c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:58.264700 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942266ab-d771-4645-92e3-32d682d7bf79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bec0737d8424a24aee8c8429de7df56)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:58.264837 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f9c2619d-0167-492b-8898-982644969a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:58.265064 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942266ab-d771-4645-92e3-32d682d7bf79 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:58.265210 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2619d-0167-492b-8898-982644969a7c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:58.265210 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fa2bc-a87c-4bbc-b164-ea152de44c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:58.265210 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fa2bc-a87c-4bbc-b164-ea152de44c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:58.265210 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fa2bc-a87c-4bbc-b164-ea152de44c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:58.265774 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fa2bc-a87c-4bbc-b164-ea152de44c58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:58.265774 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fa2bc-a87c-4bbc-b164-ea152de44c58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:58.265774 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fa2bc-a87c-4bbc-b164-ea152de44c58 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:58.265774 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 824/1653] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:49:58 2022] POST /identity/v3/projects => generated 399 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:58.267991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a25a16-883e-4188-8f46-4fbe9edd4068 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:58.268366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a25a16-883e-4188-8f46-4fbe9edd4068 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:58.268875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a25a16-883e-4188-8f46-4fbe9edd4068 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:58.271951 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 825/1654] 10.222.0.81 () {54 vars in 912 bytes} [Wed May 4 17:49:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:49:58.273028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a25a16-883e-4188-8f46-4fbe9edd4068 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:58.360167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a25a16-883e-4188-8f46-4fbe9edd4068 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:58.365617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60330380-bbf4-4b12-8473-e2b63af7164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:58.366818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330380-bbf4-4b12-8473-e2b63af7164b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:58.367486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330380-bbf4-4b12-8473-e2b63af7164b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:58.367999 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330380-bbf4-4b12-8473-e2b63af7164b admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:58.369401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60330380-bbf4-4b12-8473-e2b63af7164b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:58.371504 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60330380-bbf4-4b12-8473-e2b63af7164b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:58.463808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 826/1655] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:49:58 2022] POST /identity/v3/users => generated 306 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:49:58.465678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-942266ab-d771-4645-92e3-32d682d7bf79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bec0737d8424a24aee8c8429de7df56'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:49:58.468671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81787084-8f84-4c4d-b8fb-22103c9afbe5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:58.469199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81787084-8f84-4c4d-b8fb-22103c9afbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:58.470411 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81787084-8f84-4c4d-b8fb-22103c9afbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:58.532759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-81787084-8f84-4c4d-b8fb-22103c9afbe5 None None] MFA Rules not processed for user `96f0feac2b384b509bc9f75b92b4df95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:49:58.534602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-81787084-8f84-4c4d-b8fb-22103c9afbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:58.597822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-942266ab-d771-4645-92e3-32d682d7bf79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bec0737d8424a24aee8c8429de7df56'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:49:58.598428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-942266ab-d771-4645-92e3-32d682d7bf79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bec0737d8424a24aee8c8429de7df56'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:49:58.610212 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-942266ab-d771-4645-92e3-32d682d7bf79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bec0737d8424a24aee8c8429de7df56'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:49:58.619841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 827/1656] 10.222.0.81 () {58 vars in 1009 bytes} [Wed May 4 17:49:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:49:58.621365 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81787084-8f84-4c4d-b8fb-22103c9afbe5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:58.623268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-81787084-8f84-4c4d-b8fb-22103c9afbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:58.641631 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81787084-8f84-4c4d-b8fb-22103c9afbe5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:58.644116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-942266ab-d771-4645-92e3-32d682d7bf79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bec0737d8424a24aee8c8429de7df56'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:49:58.649795 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f8f7a-bc66-4b1e-befe-f656f003a8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:58.650946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f8f7a-bc66-4b1e-befe-f656f003a8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:58.651609 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f8f7a-bc66-4b1e-befe-f656f003a8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:58.652196 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f8f7a-bc66-4b1e-befe-f656f003a8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:58.654076 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f8f7a-bc66-4b1e-befe-f656f003a8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:58.659205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 830/1657] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:49:57 2022] DELETE /identity/v3/users/2bec0737d8424a24aee8c8429de7df56 => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:49:58.660025 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f8f7a-bc66-4b1e-befe-f656f003a8f1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:58.679474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942266ab-d771-4645-92e3-32d682d7bf79 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:58.681250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-942266ab-d771-4645-92e3-32d682d7bf79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:49:58.693788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 828/1658] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:58.701988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f8f7a-bc66-4b1e-befe-f656f003a8f1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:58.733858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f8f7a-bc66-4b1e-befe-f656f003a8f1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:58.805562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942266ab-d771-4645-92e3-32d682d7bf79 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:58.816982 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5d2a8-427b-493e-bcf8-72cfa1b7d7c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:58.817654 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5d2a8-427b-493e-bcf8-72cfa1b7d7c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:58.817932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5d2a8-427b-493e-bcf8-72cfa1b7d7c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:58.818208 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5d2a8-427b-493e-bcf8-72cfa1b7d7c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:58.839468 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5d2a8-427b-493e-bcf8-72cfa1b7d7c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:58.841418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5d2a8-427b-493e-bcf8-72cfa1b7d7c4 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:58.860266 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 831/1659] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:49:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:49:58.905867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2697b2e-5633-44d3-9f39-ec4ba730e7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:58.907293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2697b2e-5633-44d3-9f39-ec4ba730e7f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:58.907293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2697b2e-5633-44d3-9f39-ec4ba730e7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:58.907601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2697b2e-5633-44d3-9f39-ec4ba730e7f1 admin admin] PATH_INFO: `/v3/projects/69d7625000da4bf1a680fc7978381d15/users/f3ee01a3fac34a29bb90b1f06335dd0d/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:58.941062 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2697b2e-5633-44d3-9f39-ec4ba730e7f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d7625000da4bf1a680fc7978381d15, user_id=f3ee01a3fac34a29bb90b1f06335dd0d, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:58.947431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2697b2e-5633-44d3-9f39-ec4ba730e7f1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:59.101121 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 829/1660] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:49:58 2022] PUT /identity/v3/projects/69d7625000da4bf1a680fc7978381d15/users/f3ee01a3fac34a29bb90b1f06335dd0d/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:49:59.105406 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5d2a8-427b-493e-bcf8-72cfa1b7d7c4 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:59.122479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5d2a8-427b-493e-bcf8-72cfa1b7d7c4 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:59.292386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43d2bd-e674-4797-b2d9-76f8720471ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:59.298191 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43d2bd-e674-4797-b2d9-76f8720471ab admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:59.298191 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43d2bd-e674-4797-b2d9-76f8720471ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:59.298191 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43d2bd-e674-4797-b2d9-76f8720471ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:59.301034 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43d2bd-e674-4797-b2d9-76f8720471ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:59.302854 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43d2bd-e674-4797-b2d9-76f8720471ab admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:59.319623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 832/1661] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:49:59.325372 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2697b2e-5633-44d3-9f39-ec4ba730e7f1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:49:59.340920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2697b2e-5633-44d3-9f39-ec4ba730e7f1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:49:59.356569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad37bf-aa68-4169-ad58-031c3aebd4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:49:59.361209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad37bf-aa68-4169-ad58-031c3aebd4a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:49:59.361209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad37bf-aa68-4169-ad58-031c3aebd4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:49:59.361209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad37bf-aa68-4169-ad58-031c3aebd4a5 admin admin] PATH_INFO: `/v3/projects/69d7625000da4bf1a680fc7978381d15/users/f3ee01a3fac34a29bb90b1f06335dd0d/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:49:59.369975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad37bf-aa68-4169-ad58-031c3aebd4a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d7625000da4bf1a680fc7978381d15, user_id=f3ee01a3fac34a29bb90b1f06335dd0d, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:49:59.377118 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad37bf-aa68-4169-ad58-031c3aebd4a5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:49:59.418427 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 830/1662] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:49:59 2022] PUT /identity/v3/projects/69d7625000da4bf1a680fc7978381d15/users/f3ee01a3fac34a29bb90b1f06335dd0d/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:00.100796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171f60d-ae3f-4ea2-95d8-c0826f1927fc None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:00.100796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171f60d-ae3f-4ea2-95d8-c0826f1927fc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:00.100796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171f60d-ae3f-4ea2-95d8-c0826f1927fc None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:00.108536 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 833/1663] 10.222.0.81 () {54 vars in 960 bytes} [Wed May 4 17:50:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:50:00.119390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6d9e0-262e-42e0-a99e-b8aa30752ec3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:00.125829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6d9e0-262e-42e0-a99e-b8aa30752ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:00.126187 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6d9e0-262e-42e0-a99e-b8aa30752ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:00.156600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5ca6d9e0-262e-42e0-a99e-b8aa30752ec3 None None] MFA Rules not processed for user `4ff8c001247c43ccbc4ccb26daa17201`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:00.157851 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5ca6d9e0-262e-42e0-a99e-b8aa30752ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:00.279682 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 831/1664] 10.222.0.81 () {58 vars in 1057 bytes} [Wed May 4 17:50:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:00.281241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171f60d-ae3f-4ea2-95d8-c0826f1927fc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:00.300795 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171f60d-ae3f-4ea2-95d8-c0826f1927fc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:00.310709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085ae99-be2f-426e-94d8-ef183a673e59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ff8c001247c43ccbc4ccb26daa17201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:00.311848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085ae99-be2f-426e-94d8-ef183a673e59 service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:00.312767 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085ae99-be2f-426e-94d8-ef183a673e59 service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:00.315887 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085ae99-be2f-426e-94d8-ef183a673e59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:00.316207 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0085ae99-be2f-426e-94d8-ef183a673e59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:00.356752 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085ae99-be2f-426e-94d8-ef183a673e59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:00.356752 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085ae99-be2f-426e-94d8-ef183a673e59 service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:00.380505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 834/1665] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:00.518929 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6d9e0-262e-42e0-a99e-b8aa30752ec3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:00.521149 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5ca6d9e0-262e-42e0-a99e-b8aa30752ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:00.624247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6d9e0-262e-42e0-a99e-b8aa30752ec3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:00.635254 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7d500-c878-452f-acc4-052afc144b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:00.636246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7d500-c878-452f-acc4-052afc144b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:00.636556 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7d500-c878-452f-acc4-052afc144b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:00.636834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7d500-c878-452f-acc4-052afc144b6e admin admin] PATH_INFO: `/v3/projects/841c32d11e35444e81cf00767e54eb4a` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:00.638596 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7d500-c878-452f-acc4-052afc144b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=841c32d11e35444e81cf00767e54eb4a)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:00.642514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7d500-c878-452f-acc4-052afc144b6e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:00.816768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-37a7d500-c878-452f-acc4-052afc144b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '841c32d11e35444e81cf00767e54eb4a', 'request_id': 'req-37a7d500-c878-452f-acc4-052afc144b6e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:00.825549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-37a7d500-c878-452f-acc4-052afc144b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '841c32d11e35444e81cf00767e54eb4a', 'request_id': 'req-37a7d500-c878-452f-acc4-052afc144b6e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:00.916576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-37a7d500-c878-452f-acc4-052afc144b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '841c32d11e35444e81cf00767e54eb4a', 'request_id': 'req-37a7d500-c878-452f-acc4-052afc144b6e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:00.938881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-37a7d500-c878-452f-acc4-052afc144b6e admin admin] The token cache is being invalidate because project 841c32d11e35444e81cf00767e54eb4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:00.939118 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-37a7d500-c878-452f-acc4-052afc144b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:00.941011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-37a7d500-c878-452f-acc4-052afc144b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:00.947124 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 832/1666] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:00 2022] DELETE /identity/v3/projects/841c32d11e35444e81cf00767e54eb4a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:00.948872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0dea4-a051-41cd-af16-14359c1a79bf None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:00.949823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0dea4-a051-41cd-af16-14359c1a79bf None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:00.949823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0dea4-a051-41cd-af16-14359c1a79bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:00.989548 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7eb0dea4-a051-41cd-af16-14359c1a79bf None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:00.990858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7eb0dea4-a051-41cd-af16-14359c1a79bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:01.136536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7d500-c878-452f-acc4-052afc144b6e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:01.139553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-37a7d500-c878-452f-acc4-052afc144b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:01.223562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 835/1667] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:01.229316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e0c5b-f2d9-46ed-a88b-0c55d70d5c4f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:01.230938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e0c5b-f2d9-46ed-a88b-0c55d70d5c4f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:01.231681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e0c5b-f2d9-46ed-a88b-0c55d70d5c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:01.263142 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-922e0c5b-f2d9-46ed-a88b-0c55d70d5c4f None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:01.264497 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-922e0c5b-f2d9-46ed-a88b-0c55d70d5c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:01.281166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 836/1668] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:01.283118 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e0c5b-f2d9-46ed-a88b-0c55d70d5c4f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:01.307463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e0c5b-f2d9-46ed-a88b-0c55d70d5c4f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:01.316563 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d522b70-1799-48f5-82ae-4b48d9376d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:01.317302 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d522b70-1799-48f5-82ae-4b48d9376d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:01.317787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d522b70-1799-48f5-82ae-4b48d9376d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:01.318232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d522b70-1799-48f5-82ae-4b48d9376d71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:01.319239 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d522b70-1799-48f5-82ae-4b48d9376d71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:50:01.319691 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d522b70-1799-48f5-82ae-4b48d9376d71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:01.323533 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d522b70-1799-48f5-82ae-4b48d9376d71 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:01.355652 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 837/1669] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:50:01.357260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d522b70-1799-48f5-82ae-4b48d9376d71 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:01.384896 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7d500-c878-452f-acc4-052afc144b6e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:01.390946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d522b70-1799-48f5-82ae-4b48d9376d71 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:01.417808 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fe2d3-4443-47fa-9b71-09ee1294b45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:01.420645 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2190403-bd84-43c3-b06f-3c804b621ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:01.421560 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2190403-bd84-43c3-b06f-3c804b621ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:01.421843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2190403-bd84-43c3-b06f-3c804b621ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:01.422117 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2190403-bd84-43c3-b06f-3c804b621ec7 admin admin] PATH_INFO: `/v3/users/c6f2f2a51c7543c3af725aad92c8c678` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:01.423783 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fe2d3-4443-47fa-9b71-09ee1294b45f admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:01.424278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fe2d3-4443-47fa-9b71-09ee1294b45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:01.424883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fe2d3-4443-47fa-9b71-09ee1294b45f admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:01.425834 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fe2d3-4443-47fa-9b71-09ee1294b45f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:01.426001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2190403-bd84-43c3-b06f-3c804b621ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6f2f2a51c7543c3af725aad92c8c678)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:01.428040 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2190403-bd84-43c3-b06f-3c804b621ec7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:01.428381 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fe2d3-4443-47fa-9b71-09ee1294b45f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:01.594051 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 838/1670] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:01 2022] POST /identity/v3/projects => generated 357 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:01.599163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fe2d3-4443-47fa-9b71-09ee1294b45f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:01.728002 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a2190403-bd84-43c3-b06f-3c804b621ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6f2f2a51c7543c3af725aad92c8c678'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:01.766901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fe2d3-4443-47fa-9b71-09ee1294b45f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:01.772126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a2190403-bd84-43c3-b06f-3c804b621ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6f2f2a51c7543c3af725aad92c8c678'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:01.781898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cd1e7-3835-497d-b5da-5bb9c682ea19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:01.782198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cd1e7-3835-497d-b5da-5bb9c682ea19 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:01.782579 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cd1e7-3835-497d-b5da-5bb9c682ea19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:01.782953 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cd1e7-3835-497d-b5da-5bb9c682ea19 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:01.783940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cd1e7-3835-497d-b5da-5bb9c682ea19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:01.788457 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cd1e7-3835-497d-b5da-5bb9c682ea19 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:01.901829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a2190403-bd84-43c3-b06f-3c804b621ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6f2f2a51c7543c3af725aad92c8c678'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:01.911516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a2190403-bd84-43c3-b06f-3c804b621ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6f2f2a51c7543c3af725aad92c8c678'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:01.913517 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a2190403-bd84-43c3-b06f-3c804b621ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6f2f2a51c7543c3af725aad92c8c678'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:01.932880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 833/1671] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:50:01 2022] DELETE /identity/v3/users/c6f2f2a51c7543c3af725aad92c8c678 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:01.935805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bac5d-40aa-4102-93d7-fc28e4055cd3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:01.936113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bac5d-40aa-4102-93d7-fc28e4055cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:01.936601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bac5d-40aa-4102-93d7-fc28e4055cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:01.941652 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 839/1672] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:01 2022] POST /identity/v3/users => generated 279 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:50:01.945420 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cd1e7-3835-497d-b5da-5bb9c682ea19 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:01.948185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7d1cd1e7-3835-497d-b5da-5bb9c682ea19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:01.985780 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bb9bac5d-40aa-4102-93d7-fc28e4055cd3 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:01.986468 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cd1e7-3835-497d-b5da-5bb9c682ea19 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:01.988732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bb9bac5d-40aa-4102-93d7-fc28e4055cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:02.169487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75e51d-2ff4-4c7c-86f0-5ee6664e2d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:02.170341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75e51d-2ff4-4c7c-86f0-5ee6664e2d3e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:02.170632 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75e51d-2ff4-4c7c-86f0-5ee6664e2d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:02.170908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75e51d-2ff4-4c7c-86f0-5ee6664e2d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:02.171296 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 834/1673] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:02.171645 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75e51d-2ff4-4c7c-86f0-5ee6664e2d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:02.173315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75e51d-2ff4-4c7c-86f0-5ee6664e2d3e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:02.186367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bac5d-40aa-4102-93d7-fc28e4055cd3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:02.187956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bb9bac5d-40aa-4102-93d7-fc28e4055cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:02.209281 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 840/1674] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:50:02.213840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75e51d-2ff4-4c7c-86f0-5ee6664e2d3e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:02.270767 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75e51d-2ff4-4c7c-86f0-5ee6664e2d3e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:02.294080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa3000-48be-4388-8ca6-55de16425f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:02.294783 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa3000-48be-4388-8ca6-55de16425f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:02.295061 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa3000-48be-4388-8ca6-55de16425f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:02.295337 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa3000-48be-4388-8ca6-55de16425f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:02.299690 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa3000-48be-4388-8ca6-55de16425f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:02.301363 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa3000-48be-4388-8ca6-55de16425f05 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:02.306836 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bac5d-40aa-4102-93d7-fc28e4055cd3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:02.319865 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b32ed-f8e6-4615-ab63-e3a66f1425c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:02.320677 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b32ed-f8e6-4615-ab63-e3a66f1425c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:02.324999 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b32ed-f8e6-4615-ab63-e3a66f1425c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:02.324999 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b32ed-f8e6-4615-ab63-e3a66f1425c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:02.338526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 841/1675] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:02.343269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa3000-48be-4388-8ca6-55de16425f05 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:02.346232 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b32ed-f8e6-4615-ab63-e3a66f1425c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:02.350182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b32ed-f8e6-4615-ab63-e3a66f1425c2 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:02.369043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa3000-48be-4388-8ca6-55de16425f05 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:02.377360 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 835/1676] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:02.381681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a7c07-1424-4a16-8437-b2d3a8e6b1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:02.382618 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a7c07-1424-4a16-8437-b2d3a8e6b1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:02.382904 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a7c07-1424-4a16-8437-b2d3a8e6b1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:02.383185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a7c07-1424-4a16-8437-b2d3a8e6b1d8 admin admin] PATH_INFO: `/v3/projects/57c6ef6db48549ce8e5acbcc5e434262/users/3e6b5e67bd574513a2555a14ff966115/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:02.407012 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a7c07-1424-4a16-8437-b2d3a8e6b1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c6ef6db48549ce8e5acbcc5e434262, user_id=3e6b5e67bd574513a2555a14ff966115, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:02.411429 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a7c07-1424-4a16-8437-b2d3a8e6b1d8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:02.532771 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 842/1677] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:02 2022] PUT /identity/v3/projects/57c6ef6db48549ce8e5acbcc5e434262/users/3e6b5e67bd574513a2555a14ff966115/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:02.543697 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94964bf-2949-49c6-8b40-7bda249a4f01 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:02.544083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94964bf-2949-49c6-8b40-7bda249a4f01 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:02.544433 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94964bf-2949-49c6-8b40-7bda249a4f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:02.601411 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e94964bf-2949-49c6-8b40-7bda249a4f01 None None] MFA Rules not processed for user `3e6b5e67bd574513a2555a14ff966115`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:02.606703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e94964bf-2949-49c6-8b40-7bda249a4f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:02.730603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 836/1678] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:02 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:02.731532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a7c07-1424-4a16-8437-b2d3a8e6b1d8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:02.874838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a7c07-1424-4a16-8437-b2d3a8e6b1d8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:02.881323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96399c0-4d73-41d6-a599-4b9b65b2a417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:02.882149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96399c0-4d73-41d6-a599-4b9b65b2a417 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:02.882522 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96399c0-4d73-41d6-a599-4b9b65b2a417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:02.882801 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96399c0-4d73-41d6-a599-4b9b65b2a417 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:02.883561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96399c0-4d73-41d6-a599-4b9b65b2a417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:02.886693 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96399c0-4d73-41d6-a599-4b9b65b2a417 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:03.029950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 843/1679] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:02 2022] POST /identity/v3/projects => generated 357 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:03.034001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94964bf-2949-49c6-8b40-7bda249a4f01 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:03.054730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94964bf-2949-49c6-8b40-7bda249a4f01 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:03.192957 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4c8c8-985b-40e7-9135-d2f2d1a4587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:03.194063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4c8c8-985b-40e7-9135-d2f2d1a4587a admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:03.194546 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4c8c8-985b-40e7-9135-d2f2d1a4587a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:03.195020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4c8c8-985b-40e7-9135-d2f2d1a4587a admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:03.195924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4c8c8-985b-40e7-9135-d2f2d1a4587a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:03.214204 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4c8c8-985b-40e7-9135-d2f2d1a4587a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:03.342468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 837/1680] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:03 2022] POST /identity/v3/users => generated 285 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:03.343947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96399c0-4d73-41d6-a599-4b9b65b2a417 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:03.361270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96399c0-4d73-41d6-a599-4b9b65b2a417 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:03.376136 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e54e4a-d87f-48ae-a775-1a6405dfb231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:03.376968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e54e4a-d87f-48ae-a775-1a6405dfb231 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:03.377323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e54e4a-d87f-48ae-a775-1a6405dfb231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:03.377672 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e54e4a-d87f-48ae-a775-1a6405dfb231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:03.379239 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e54e4a-d87f-48ae-a775-1a6405dfb231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:03.382774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e54e4a-d87f-48ae-a775-1a6405dfb231 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:03.397058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 844/1681] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:50:03.403643 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4c8c8-985b-40e7-9135-d2f2d1a4587a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:03.418602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4c8c8-985b-40e7-9135-d2f2d1a4587a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:03.438557 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75bd9a-2445-4b4d-9e17-7d605381c912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:03.441168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75bd9a-2445-4b4d-9e17-7d605381c912 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:03.441469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75bd9a-2445-4b4d-9e17-7d605381c912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:03.441754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75bd9a-2445-4b4d-9e17-7d605381c912 admin admin] PATH_INFO: `/v3/projects/007c549413c84a9ab8cfec621bab695b/users/2a0219dc947640bfa339423e97c138da/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:03.477513 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75bd9a-2445-4b4d-9e17-7d605381c912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=007c549413c84a9ab8cfec621bab695b, user_id=2a0219dc947640bfa339423e97c138da, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:03.480877 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75bd9a-2445-4b4d-9e17-7d605381c912 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:03.566101 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 838/1682] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:03 2022] PUT /identity/v3/projects/007c549413c84a9ab8cfec621bab695b/users/2a0219dc947640bfa339423e97c138da/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:03.567410 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e54e4a-d87f-48ae-a775-1a6405dfb231 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:03.580505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e54e4a-d87f-48ae-a775-1a6405dfb231 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:03.685532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11fb33-0c32-4a4f-986c-26e40ce82858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:03.690941 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11fb33-0c32-4a4f-986c-26e40ce82858 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:03.690941 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11fb33-0c32-4a4f-986c-26e40ce82858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:03.690941 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11fb33-0c32-4a4f-986c-26e40ce82858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:03.691542 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11fb33-0c32-4a4f-986c-26e40ce82858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:03.694661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11fb33-0c32-4a4f-986c-26e40ce82858 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:03.712773 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 845/1683] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:03.713955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75bd9a-2445-4b4d-9e17-7d605381c912 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:03.734929 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75bd9a-2445-4b4d-9e17-7d605381c912 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:03.740959 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf240374-27fe-4cf1-95ee-dca7eb70f95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:03.742078 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240374-27fe-4cf1-95ee-dca7eb70f95d admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:03.742564 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240374-27fe-4cf1-95ee-dca7eb70f95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:03.743070 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240374-27fe-4cf1-95ee-dca7eb70f95d admin admin] PATH_INFO: `/v3/projects/007c549413c84a9ab8cfec621bab695b/users/2a0219dc947640bfa339423e97c138da/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:03.746271 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf240374-27fe-4cf1-95ee-dca7eb70f95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=007c549413c84a9ab8cfec621bab695b, user_id=2a0219dc947640bfa339423e97c138da, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:03.754778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf240374-27fe-4cf1-95ee-dca7eb70f95d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:03.772190 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 839/1684] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:03 2022] PUT /identity/v3/projects/007c549413c84a9ab8cfec621bab695b/users/2a0219dc947640bfa339423e97c138da/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:03.784321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a6ce5-8d06-42cb-97cf-35260b826d22 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:03.784839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a6ce5-8d06-42cb-97cf-35260b826d22 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:03.785398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a6ce5-8d06-42cb-97cf-35260b826d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:03.795704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf240374-27fe-4cf1-95ee-dca7eb70f95d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:03.803608 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bf240374-27fe-4cf1-95ee-dca7eb70f95d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:03.891261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-330a6ce5-8d06-42cb-97cf-35260b826d22 None None] MFA Rules not processed for user `2a0219dc947640bfa339423e97c138da`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:03.892355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-330a6ce5-8d06-42cb-97cf-35260b826d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:03.957853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf240374-27fe-4cf1-95ee-dca7eb70f95d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:03.969264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b02f2-1b58-4dac-b563-47e869f26697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:03.973491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b02f2-1b58-4dac-b563-47e869f26697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:03.974093 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b02f2-1b58-4dac-b563-47e869f26697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:03.974474 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b02f2-1b58-4dac-b563-47e869f26697 admin admin] PATH_INFO: `/v3/projects/56e43f1ac6b545459d949f659c6d7ef3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:03.979877 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b02f2-1b58-4dac-b563-47e869f26697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e43f1ac6b545459d949f659c6d7ef3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:03.982312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b02f2-1b58-4dac-b563-47e869f26697 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:04.096916 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 846/1685] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:04.105538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a6ce5-8d06-42cb-97cf-35260b826d22 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:04.107766 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-330a6ce5-8d06-42cb-97cf-35260b826d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:04.119604 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-356b02f2-1b58-4dac-b563-47e869f26697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e43f1ac6b545459d949f659c6d7ef3', 'request_id': 'req-356b02f2-1b58-4dac-b563-47e869f26697'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:04.146543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-356b02f2-1b58-4dac-b563-47e869f26697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e43f1ac6b545459d949f659c6d7ef3', 'request_id': 'req-356b02f2-1b58-4dac-b563-47e869f26697'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:04.223239 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a6ce5-8d06-42cb-97cf-35260b826d22 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:04.255185 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-356b02f2-1b58-4dac-b563-47e869f26697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e43f1ac6b545459d949f659c6d7ef3', 'request_id': 'req-356b02f2-1b58-4dac-b563-47e869f26697'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:04.277485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-356b02f2-1b58-4dac-b563-47e869f26697 admin admin] The token cache is being invalidate because project 56e43f1ac6b545459d949f659c6d7ef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:04.277790 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-356b02f2-1b58-4dac-b563-47e869f26697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:04.279911 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-356b02f2-1b58-4dac-b563-47e869f26697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:04.295306 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 840/1686] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:03 2022] DELETE /identity/v3/projects/56e43f1ac6b545459d949f659c6d7ef3 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:04.298268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd9104-633b-4058-a087-945e549832d5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:04.298745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd9104-633b-4058-a087-945e549832d5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:04.306024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd9104-633b-4058-a087-945e549832d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:04.368132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742e369-37ac-489b-b66b-d15e8ed79d16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:04.369494 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742e369-37ac-489b-b66b-d15e8ed79d16 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:04.370210 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742e369-37ac-489b-b66b-d15e8ed79d16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:04.371999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742e369-37ac-489b-b66b-d15e8ed79d16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:04.383676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4742e369-37ac-489b-b66b-d15e8ed79d16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:04.403514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-86cd9104-633b-4058-a087-945e549832d5 None None] MFA Rules not processed for user `f3ee01a3fac34a29bb90b1f06335dd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:04.405103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-86cd9104-633b-4058-a087-945e549832d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:04.508970 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742e369-37ac-489b-b66b-d15e8ed79d16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:04.509354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742e369-37ac-489b-b66b-d15e8ed79d16 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:04.536682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 847/1687] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:04 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:50:04.539623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31719088-19c4-4497-a79a-c030a1c5dd10 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:04.541792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31719088-19c4-4497-a79a-c030a1c5dd10 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:04.542352 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31719088-19c4-4497-a79a-c030a1c5dd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:04.561985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 841/1688] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:04 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:04.565300 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd9104-633b-4058-a087-945e549832d5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:04.569293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-86cd9104-633b-4058-a087-945e549832d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:04.657433 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-31719088-19c4-4497-a79a-c030a1c5dd10 None None] MFA Rules not processed for user `0bf039be83b54817ac2f340cf9dfad63`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:04.658846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-31719088-19c4-4497-a79a-c030a1c5dd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:04.765363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd9104-633b-4058-a087-945e549832d5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:04.771692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7db91-fa71-467d-9919-005358c0e6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:04.773513 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7db91-fa71-467d-9919-005358c0e6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:04.774032 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7db91-fa71-467d-9919-005358c0e6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:04.774501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7db91-fa71-467d-9919-005358c0e6a5 admin admin] PATH_INFO: `/v3/users/590d2e5995764733bf56522c2a9c2e9e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:04.776253 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7db91-fa71-467d-9919-005358c0e6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=590d2e5995764733bf56522c2a9c2e9e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:04.779074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7db91-fa71-467d-9919-005358c0e6a5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:04.856670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 848/1689] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:04.864190 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31719088-19c4-4497-a79a-c030a1c5dd10 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:04.865906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-31719088-19c4-4497-a79a-c030a1c5dd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:05.009413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31719088-19c4-4497-a79a-c030a1c5dd10 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:05.015251 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-25c7db91-fa71-467d-9919-005358c0e6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590d2e5995764733bf56522c2a9c2e9e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:05.017231 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29ae40-cd92-4125-8e1b-985c31c2869f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:05.017895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29ae40-cd92-4125-8e1b-985c31c2869f service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:05.019993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29ae40-cd92-4125-8e1b-985c31c2869f service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:05.020279 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29ae40-cd92-4125-8e1b-985c31c2869f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:05.046894 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29ae40-cd92-4125-8e1b-985c31c2869f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:05.048604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29ae40-cd92-4125-8e1b-985c31c2869f service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:05.066760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 849/1690] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:50:05.070146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-25c7db91-fa71-467d-9919-005358c0e6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590d2e5995764733bf56522c2a9c2e9e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:05.074947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29ae40-cd92-4125-8e1b-985c31c2869f service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:05.076677 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0e29ae40-cd92-4125-8e1b-985c31c2869f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:05.119054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29ae40-cd92-4125-8e1b-985c31c2869f service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:05.135050 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b09f3-db7f-44d2-9b6a-c5d150bcbff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:05.135765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b09f3-db7f-44d2-9b6a-c5d150bcbff7 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:05.136053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b09f3-db7f-44d2-9b6a-c5d150bcbff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:05.136328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b09f3-db7f-44d2-9b6a-c5d150bcbff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:05.138362 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b77b09f3-db7f-44d2-9b6a-c5d150bcbff7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:05.158619 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-25c7db91-fa71-467d-9919-005358c0e6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590d2e5995764733bf56522c2a9c2e9e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:05.180852 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-25c7db91-fa71-467d-9919-005358c0e6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590d2e5995764733bf56522c2a9c2e9e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:05.182347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-25c7db91-fa71-467d-9919-005358c0e6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590d2e5995764733bf56522c2a9c2e9e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:05.205296 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 842/1691] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:50:04 2022] DELETE /identity/v3/users/590d2e5995764733bf56522c2a9c2e9e => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:05.283636 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b09f3-db7f-44d2-9b6a-c5d150bcbff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:05.288589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b09f3-db7f-44d2-9b6a-c5d150bcbff7 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:05.330834 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 850/1692] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:05 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:05.475157 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445b54e-cfad-4a41-9026-ca90e2c5d9dc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:05.475488 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445b54e-cfad-4a41-9026-ca90e2c5d9dc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:05.475784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445b54e-cfad-4a41-9026-ca90e2c5d9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:05.514832 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a445b54e-cfad-4a41-9026-ca90e2c5d9dc None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:05.517590 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a445b54e-cfad-4a41-9026-ca90e2c5d9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:05.697290 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 843/1693] 10.222.0.81 () {58 vars in 1009 bytes} [Wed May 4 17:50:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:06.327287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b09f3-db7f-44d2-9b6a-c5d150bcbff7 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:06.328906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b77b09f3-db7f-44d2-9b6a-c5d150bcbff7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:06.489650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b09f3-db7f-44d2-9b6a-c5d150bcbff7 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:06.627907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf99c19-b27f-4cfd-92a0-92cb4864e657 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:06.628705 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf99c19-b27f-4cfd-92a0-92cb4864e657 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:06.628983 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf99c19-b27f-4cfd-92a0-92cb4864e657 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:06.629454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf99c19-b27f-4cfd-92a0-92cb4864e657 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:06.642027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf99c19-b27f-4cfd-92a0-92cb4864e657 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:06.643702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf99c19-b27f-4cfd-92a0-92cb4864e657 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:06.672477 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 851/1694] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 17:50:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 17:50:06.852764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445b54e-cfad-4a41-9026-ca90e2c5d9dc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:06.856717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a445b54e-cfad-4a41-9026-ca90e2c5d9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:07.076529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445b54e-cfad-4a41-9026-ca90e2c5d9dc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:07.110206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f83f5-6736-4d40-aca6-923c06331771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:07.120238 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f83f5-6736-4d40-aca6-923c06331771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:07.122317 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f83f5-6736-4d40-aca6-923c06331771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:07.124313 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f83f5-6736-4d40-aca6-923c06331771 admin admin] PATH_INFO: `/v3/users/f0b15660aa77430e80c252ed417cd1f2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:07.142275 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f83f5-6736-4d40-aca6-923c06331771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b15660aa77430e80c252ed417cd1f2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:07.150522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f83f5-6736-4d40-aca6-923c06331771 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:07.233905 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97330eae-1c7f-4718-81bf-c3ba4e1a85dc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:07.234292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97330eae-1c7f-4718-81bf-c3ba4e1a85dc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:07.234921 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97330eae-1c7f-4718-81bf-c3ba4e1a85dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:07.321897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-97330eae-1c7f-4718-81bf-c3ba4e1a85dc None None] MFA Rules not processed for user `3b220b08ef304644b329bcd31f0247f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:07.323229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-97330eae-1c7f-4718-81bf-c3ba4e1a85dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:07.438516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-df5f83f5-6736-4d40-aca6-923c06331771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b15660aa77430e80c252ed417cd1f2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:07.484041 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-df5f83f5-6736-4d40-aca6-923c06331771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b15660aa77430e80c252ed417cd1f2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:07.521992 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 852/1695] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:50:07.523370 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97330eae-1c7f-4718-81bf-c3ba4e1a85dc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:07.525395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-97330eae-1c7f-4718-81bf-c3ba4e1a85dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:07.563615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-df5f83f5-6736-4d40-aca6-923c06331771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b15660aa77430e80c252ed417cd1f2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:07.576634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-df5f83f5-6736-4d40-aca6-923c06331771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b15660aa77430e80c252ed417cd1f2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:07.578570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-df5f83f5-6736-4d40-aca6-923c06331771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b15660aa77430e80c252ed417cd1f2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:07.616353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 844/1696] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:50:06 2022] DELETE /identity/v3/users/f0b15660aa77430e80c252ed417cd1f2 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:07.618410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55994247-f693-4bc5-ba87-ff6f11e44bfc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:07.618772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55994247-f693-4bc5-ba87-ff6f11e44bfc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:07.619059 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55994247-f693-4bc5-ba87-ff6f11e44bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:07.687714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-55994247-f693-4bc5-ba87-ff6f11e44bfc None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:07.691223 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-55994247-f693-4bc5-ba87-ff6f11e44bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:07.742346 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97330eae-1c7f-4718-81bf-c3ba4e1a85dc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:08.033946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 845/1697] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:08.033946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55994247-f693-4bc5-ba87-ff6f11e44bfc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:08.033946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-55994247-f693-4bc5-ba87-ff6f11e44bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:08.035847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db6ad0-b7b9-451e-8d75-e0e6dd515255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:08.035847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db6ad0-b7b9-451e-8d75-e0e6dd515255 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:08.035847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db6ad0-b7b9-451e-8d75-e0e6dd515255 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:08.035847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db6ad0-b7b9-451e-8d75-e0e6dd515255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:08.036538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c8db6ad0-b7b9-451e-8d75-e0e6dd515255 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:08.036738 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55994247-f693-4bc5-ba87-ff6f11e44bfc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:08.036738 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d4620-3dbe-4d7b-b4e1-b7f4c9812d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:08.036738 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d4620-3dbe-4d7b-b4e1-b7f4c9812d8d service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:08.036738 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d4620-3dbe-4d7b-b4e1-b7f4c9812d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:08.037219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d4620-3dbe-4d7b-b4e1-b7f4c9812d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:08.037219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d4620-3dbe-4d7b-b4e1-b7f4c9812d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:08.037219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d4620-3dbe-4d7b-b4e1-b7f4c9812d8d service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:08.043222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 846/1698] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:08.082867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db6ad0-b7b9-451e-8d75-e0e6dd515255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:08.099861 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db6ad0-b7b9-451e-8d75-e0e6dd515255 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:08.125579 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 853/1699] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:08.607946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d4620-3dbe-4d7b-b4e1-b7f4c9812d8d service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:08.620973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a70d4620-3dbe-4d7b-b4e1-b7f4c9812d8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:08.643835 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d4620-3dbe-4d7b-b4e1-b7f4c9812d8d service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:08.698937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5003f-31f5-4c23-9cf7-413004c282eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:08.710072 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5003f-31f5-4c23-9cf7-413004c282eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:08.711427 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5003f-31f5-4c23-9cf7-413004c282eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:08.713076 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5003f-31f5-4c23-9cf7-413004c282eb admin admin] PATH_INFO: `/v3/projects/2691db18eb1845bcad4dc57272324005` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:08.719791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5003f-31f5-4c23-9cf7-413004c282eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2691db18eb1845bcad4dc57272324005)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:08.747617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5003f-31f5-4c23-9cf7-413004c282eb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:09.028491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-52d5003f-31f5-4c23-9cf7-413004c282eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2691db18eb1845bcad4dc57272324005', 'request_id': 'req-52d5003f-31f5-4c23-9cf7-413004c282eb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:09.051212 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-52d5003f-31f5-4c23-9cf7-413004c282eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2691db18eb1845bcad4dc57272324005', 'request_id': 'req-52d5003f-31f5-4c23-9cf7-413004c282eb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:09.156060 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-52d5003f-31f5-4c23-9cf7-413004c282eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2691db18eb1845bcad4dc57272324005', 'request_id': 'req-52d5003f-31f5-4c23-9cf7-413004c282eb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:09.192150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-52d5003f-31f5-4c23-9cf7-413004c282eb admin admin] The token cache is being invalidate because project 2691db18eb1845bcad4dc57272324005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:09.194646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-52d5003f-31f5-4c23-9cf7-413004c282eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:09.199997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-52d5003f-31f5-4c23-9cf7-413004c282eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:09.204587 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 847/1700] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:08 2022] DELETE /identity/v3/projects/2691db18eb1845bcad4dc57272324005 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:09.209380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2413cc-a14d-4444-be71-9432b75009ff None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:09.209915 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2413cc-a14d-4444-be71-9432b75009ff None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:09.210118 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2413cc-a14d-4444-be71-9432b75009ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:09.265563 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-bf2413cc-a14d-4444-be71-9432b75009ff None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:09.271509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bf2413cc-a14d-4444-be71-9432b75009ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:09.424784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff884f-e0b1-4117-9811-e7bb83e915d3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:09.426986 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff884f-e0b1-4117-9811-e7bb83e915d3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:09.428255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff884f-e0b1-4117-9811-e7bb83e915d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:09.485201 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 854/1701] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:09.488105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5f42-4a3f-4e8a-a8cf-49075ca08094 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:09.489099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-00ff884f-e0b1-4117-9811-e7bb83e915d3 None None] MFA Rules not processed for user `96f0feac2b384b509bc9f75b92b4df95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:09.489604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5f42-4a3f-4e8a-a8cf-49075ca08094 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:09.490860 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5f42-4a3f-4e8a-a8cf-49075ca08094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:09.490965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-00ff884f-e0b1-4117-9811-e7bb83e915d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:09.533743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1aea5f42-4a3f-4e8a-a8cf-49075ca08094 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:09.537210 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1aea5f42-4a3f-4e8a-a8cf-49075ca08094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:09.561317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 855/1702] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:09.566123 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea5f42-4a3f-4e8a-a8cf-49075ca08094 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:09.589463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea5f42-4a3f-4e8a-a8cf-49075ca08094 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:09.604014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0aa3f3-b4be-41f4-b9b1-9924d9873a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:09.605060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0aa3f3-b4be-41f4-b9b1-9924d9873a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:09.605570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0aa3f3-b4be-41f4-b9b1-9924d9873a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:09.606180 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0aa3f3-b4be-41f4-b9b1-9924d9873a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:09.607270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0aa3f3-b4be-41f4-b9b1-9924d9873a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:50:09.607817 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0aa3f3-b4be-41f4-b9b1-9924d9873a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:09.609787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0aa3f3-b4be-41f4-b9b1-9924d9873a6b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:09.646270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 856/1703] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:50:09.647761 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0aa3f3-b4be-41f4-b9b1-9924d9873a6b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:09.667911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0aa3f3-b4be-41f4-b9b1-9924d9873a6b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:09.669521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 848/1704] 10.222.0.86 () {58 vars in 1015 bytes} [Wed May 4 17:50:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:50:09.683608 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518d49-a79d-42fd-ac02-805d6b9a6032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:09.684874 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518d49-a79d-42fd-ac02-805d6b9a6032 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:09.685386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518d49-a79d-42fd-ac02-805d6b9a6032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:09.685923 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518d49-a79d-42fd-ac02-805d6b9a6032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:09.686902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b518d49-a79d-42fd-ac02-805d6b9a6032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:09.689318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b518d49-a79d-42fd-ac02-805d6b9a6032 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:09.895492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 857/1705] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:09 2022] POST /identity/v3/projects => generated 379 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:09.900869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff884f-e0b1-4117-9811-e7bb83e915d3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:09.928426 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff884f-e0b1-4117-9811-e7bb83e915d3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:10.078149 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11306dc8-2c83-4dd2-851a-b07c6c5f9883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:10.078847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11306dc8-2c83-4dd2-851a-b07c6c5f9883 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:10.081764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11306dc8-2c83-4dd2-851a-b07c6c5f9883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:10.082160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11306dc8-2c83-4dd2-851a-b07c6c5f9883 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:10.085796 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11306dc8-2c83-4dd2-851a-b07c6c5f9883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:10.088154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11306dc8-2c83-4dd2-851a-b07c6c5f9883 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:10.223229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518d49-a79d-42fd-ac02-805d6b9a6032 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:10.242935 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7b518d49-a79d-42fd-ac02-805d6b9a6032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:10.258729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 849/1706] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:09 2022] POST /identity/v3/users => generated 290 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:10.267342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11306dc8-2c83-4dd2-851a-b07c6c5f9883 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:10.343399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11306dc8-2c83-4dd2-851a-b07c6c5f9883 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:10.375528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa3e2c-5fab-494b-b17e-e4a7642b4781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:10.382875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa3e2c-5fab-494b-b17e-e4a7642b4781 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:10.382875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa3e2c-5fab-494b-b17e-e4a7642b4781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:10.401988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa3e2c-5fab-494b-b17e-e4a7642b4781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:10.403668 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa3e2c-5fab-494b-b17e-e4a7642b4781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:10.406975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa3e2c-5fab-494b-b17e-e4a7642b4781 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:10.449538 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 850/1707] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:10.453753 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa3e2c-5fab-494b-b17e-e4a7642b4781 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:10.488819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa3e2c-5fab-494b-b17e-e4a7642b4781 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:10.525468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda2729-225e-4440-9c26-8728e5cd50eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:10.529890 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda2729-225e-4440-9c26-8728e5cd50eb admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:10.529890 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda2729-225e-4440-9c26-8728e5cd50eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:10.529890 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda2729-225e-4440-9c26-8728e5cd50eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:10.540637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda2729-225e-4440-9c26-8728e5cd50eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:10.548295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518d49-a79d-42fd-ac02-805d6b9a6032 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:10.551702 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda2729-225e-4440-9c26-8728e5cd50eb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:10.556156 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17877a-45f0-4729-b35d-b34a7b63f9fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:10.566040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17877a-45f0-4729-b35d-b34a7b63f9fd service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:10.566040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17877a-45f0-4729-b35d-b34a7b63f9fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:10.566040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17877a-45f0-4729-b35d-b34a7b63f9fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:10.578081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17877a-45f0-4729-b35d-b34a7b63f9fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:10.579762 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17877a-45f0-4729-b35d-b34a7b63f9fd service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:10.599970 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 851/1708] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:10.601760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda2729-225e-4440-9c26-8728e5cd50eb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:10.608854 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 858/1709] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:10.628768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda2729-225e-4440-9c26-8728e5cd50eb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:10.650736 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d114c12-410e-43ee-b655-b64e7b8830c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:10.653037 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d114c12-410e-43ee-b655-b64e7b8830c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:10.654202 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d114c12-410e-43ee-b655-b64e7b8830c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:10.654793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d114c12-410e-43ee-b655-b64e7b8830c6 admin admin] PATH_INFO: `/v3/projects/4d20668e54b349d780b21e9253b8a91c/users/6dfbe728c4834164879916804947719c/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:10.706704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d114c12-410e-43ee-b655-b64e7b8830c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d20668e54b349d780b21e9253b8a91c, user_id=6dfbe728c4834164879916804947719c, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:10.724522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d114c12-410e-43ee-b655-b64e7b8830c6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:10.841286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 852/1710] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:10 2022] PUT /identity/v3/projects/4d20668e54b349d780b21e9253b8a91c/users/6dfbe728c4834164879916804947719c/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:50:10.851627 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3860423-402a-428a-92bf-5d6e672af8e2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:10.852173 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3860423-402a-428a-92bf-5d6e672af8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:10.852644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3860423-402a-428a-92bf-5d6e672af8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:10.974526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a3860423-402a-428a-92bf-5d6e672af8e2 None None] MFA Rules not processed for user `6dfbe728c4834164879916804947719c`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:10.975978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a3860423-402a-428a-92bf-5d6e672af8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:11.030389 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d114c12-410e-43ee-b655-b64e7b8830c6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:11.033056 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0d114c12-410e-43ee-b655-b64e7b8830c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:11.230530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 859/1711] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:11.235932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3860423-402a-428a-92bf-5d6e672af8e2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:11.265080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d114c12-410e-43ee-b655-b64e7b8830c6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:11.286571 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba277b44-30a3-4942-a410-2497f4439144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:11.287723 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba277b44-30a3-4942-a410-2497f4439144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:11.288173 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba277b44-30a3-4942-a410-2497f4439144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:11.288637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba277b44-30a3-4942-a410-2497f4439144 admin admin] PATH_INFO: `/v3/projects/1e86d64e07b5439c8ff99dbebc95ca72` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:11.291300 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba277b44-30a3-4942-a410-2497f4439144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e86d64e07b5439c8ff99dbebc95ca72)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:11.293643 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba277b44-30a3-4942-a410-2497f4439144 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:11.410463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3860423-402a-428a-92bf-5d6e672af8e2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:11.426427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08373988-0798-446c-b19b-4d00c38d3c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:11.427117 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08373988-0798-446c-b19b-4d00c38d3c37 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:11.427400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08373988-0798-446c-b19b-4d00c38d3c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:11.427679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08373988-0798-446c-b19b-4d00c38d3c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:11.430513 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08373988-0798-446c-b19b-4d00c38d3c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:11.444595 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08373988-0798-446c-b19b-4d00c38d3c37 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:11.538443 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ba277b44-30a3-4942-a410-2497f4439144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e86d64e07b5439c8ff99dbebc95ca72', 'request_id': 'req-ba277b44-30a3-4942-a410-2497f4439144'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:11.559260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ba277b44-30a3-4942-a410-2497f4439144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e86d64e07b5439c8ff99dbebc95ca72', 'request_id': 'req-ba277b44-30a3-4942-a410-2497f4439144'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:11.599338 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 860/1712] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:11 2022] POST /identity/v3/projects => generated 379 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:11.603493 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08373988-0798-446c-b19b-4d00c38d3c37 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:11.659001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ba277b44-30a3-4942-a410-2497f4439144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e86d64e07b5439c8ff99dbebc95ca72', 'request_id': 'req-ba277b44-30a3-4942-a410-2497f4439144'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:11.680394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ba277b44-30a3-4942-a410-2497f4439144 admin admin] The token cache is being invalidate because project 1e86d64e07b5439c8ff99dbebc95ca72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:11.680607 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ba277b44-30a3-4942-a410-2497f4439144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:11.684893 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ba277b44-30a3-4942-a410-2497f4439144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:11.689998 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 853/1713] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:11 2022] DELETE /identity/v3/projects/1e86d64e07b5439c8ff99dbebc95ca72 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:50:11.707256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec27f84-df94-4ed3-81d6-8fe4b9fe0f9b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:11.707256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec27f84-df94-4ed3-81d6-8fe4b9fe0f9b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:11.707256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec27f84-df94-4ed3-81d6-8fe4b9fe0f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:11.809358 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8ec27f84-df94-4ed3-81d6-8fe4b9fe0f9b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:11.810736 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8ec27f84-df94-4ed3-81d6-8fe4b9fe0f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:11.848167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 854/1714] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:11.849067 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec27f84-df94-4ed3-81d6-8fe4b9fe0f9b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:11.862437 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08373988-0798-446c-b19b-4d00c38d3c37 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:11.864235 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8ec27f84-df94-4ed3-81d6-8fe4b9fe0f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:11.881107 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd837a9-d8d3-4ed0-9e34-984b5586b7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:11.881805 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd837a9-d8d3-4ed0-9e34-984b5586b7aa admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:11.882110 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd837a9-d8d3-4ed0-9e34-984b5586b7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:11.882356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd837a9-d8d3-4ed0-9e34-984b5586b7aa admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:11.883073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd837a9-d8d3-4ed0-9e34-984b5586b7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:11.885149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd837a9-d8d3-4ed0-9e34-984b5586b7aa admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:11.920474 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec27f84-df94-4ed3-81d6-8fe4b9fe0f9b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:11.946010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbf296-37b8-45b1-9f92-c11b10e3937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:11.947055 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbf296-37b8-45b1-9f92-c11b10e3937b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:11.947492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbf296-37b8-45b1-9f92-c11b10e3937b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:11.947775 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbf296-37b8-45b1-9f92-c11b10e3937b admin admin] PATH_INFO: `/v3/users/d301f56693364b39b17a12eb015eb1ab` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:11.951265 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbf296-37b8-45b1-9f92-c11b10e3937b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d301f56693364b39b17a12eb015eb1ab)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:11.953303 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbf296-37b8-45b1-9f92-c11b10e3937b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:12.025872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 861/1715] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:11 2022] POST /identity/v3/users => generated 290 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:50:12.026602 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aee70d-d757-48ff-885b-b622e56bd4a4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:12.026898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aee70d-d757-48ff-885b-b622e56bd4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:12.027180 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aee70d-d757-48ff-885b-b622e56bd4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:12.091304 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-94aee70d-d757-48ff-885b-b622e56bd4a4 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:12.097695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-94aee70d-d757-48ff-885b-b622e56bd4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:12.109143 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 862/1716] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:12.110011 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aee70d-d757-48ff-885b-b622e56bd4a4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:12.111620 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-94aee70d-d757-48ff-885b-b622e56bd4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:12.127529 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aee70d-d757-48ff-885b-b622e56bd4a4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:12.135569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2a2fd-e0aa-4fd9-8229-245310d92fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:12.136823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2a2fd-e0aa-4fd9-8229-245310d92fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:12.137293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2a2fd-e0aa-4fd9-8229-245310d92fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:12.137574 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2a2fd-e0aa-4fd9-8229-245310d92fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:12.138318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2a2fd-e0aa-4fd9-8229-245310d92fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:12.141054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2a2fd-e0aa-4fd9-8229-245310d92fa9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:12.167389 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 863/1717] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:12.168321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2a2fd-e0aa-4fd9-8229-245310d92fa9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:12.199386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2a2fd-e0aa-4fd9-8229-245310d92fa9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:12.202250 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fabbf296-37b8-45b1-9f92-c11b10e3937b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd301f56693364b39b17a12eb015eb1ab'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:12.217235 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe669504-a8f2-48ab-84d2-cd91acad086c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:12.217912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe669504-a8f2-48ab-84d2-cd91acad086c admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:12.218192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe669504-a8f2-48ab-84d2-cd91acad086c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:12.218465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe669504-a8f2-48ab-84d2-cd91acad086c admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:12.219328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe669504-a8f2-48ab-84d2-cd91acad086c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:50:12.219635 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe669504-a8f2-48ab-84d2-cd91acad086c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:12.221914 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe669504-a8f2-48ab-84d2-cd91acad086c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:12.233746 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fabbf296-37b8-45b1-9f92-c11b10e3937b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd301f56693364b39b17a12eb015eb1ab'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:12.258275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 864/1718] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:50:12.260680 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe669504-a8f2-48ab-84d2-cd91acad086c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:12.271752 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe669504-a8f2-48ab-84d2-cd91acad086c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:12.288946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac194545-d0b4-4bd0-aee8-a6a0ed896180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:12.290228 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac194545-d0b4-4bd0-aee8-a6a0ed896180 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:12.291167 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac194545-d0b4-4bd0-aee8-a6a0ed896180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:12.291720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac194545-d0b4-4bd0-aee8-a6a0ed896180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:12.292722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac194545-d0b4-4bd0-aee8-a6a0ed896180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:12.294633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac194545-d0b4-4bd0-aee8-a6a0ed896180 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:12.320161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 865/1719] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:12.320612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fabbf296-37b8-45b1-9f92-c11b10e3937b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd301f56693364b39b17a12eb015eb1ab'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:12.322615 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac194545-d0b4-4bd0-aee8-a6a0ed896180 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:12.345532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac194545-d0b4-4bd0-aee8-a6a0ed896180 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:12.357848 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fabbf296-37b8-45b1-9f92-c11b10e3937b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd301f56693364b39b17a12eb015eb1ab'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:12.357848 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fabbf296-37b8-45b1-9f92-c11b10e3937b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd301f56693364b39b17a12eb015eb1ab'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:12.366378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30a7e9-2cb6-4a50-9c63-fadc4e0ea4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:12.367065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30a7e9-2cb6-4a50-9c63-fadc4e0ea4ca admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:12.367352 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30a7e9-2cb6-4a50-9c63-fadc4e0ea4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:12.367674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30a7e9-2cb6-4a50-9c63-fadc4e0ea4ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:12.368481 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30a7e9-2cb6-4a50-9c63-fadc4e0ea4ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:12.371480 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 855/1720] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:50:11 2022] DELETE /identity/v3/users/d301f56693364b39b17a12eb015eb1ab => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:12.373216 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbf296-37b8-45b1-9f92-c11b10e3937b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:12.375180 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fabbf296-37b8-45b1-9f92-c11b10e3937b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:12.376429 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30a7e9-2cb6-4a50-9c63-fadc4e0ea4ca admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:12.537100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 866/1721] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:12 2022] POST /identity/v3/projects => generated 371 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:12.538227 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30a7e9-2cb6-4a50-9c63-fadc4e0ea4ca admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:12.550266 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5b30a7e9-2cb6-4a50-9c63-fadc4e0ea4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:12.606192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbf296-37b8-45b1-9f92-c11b10e3937b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:12.787574 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30a7e9-2cb6-4a50-9c63-fadc4e0ea4ca admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:12.826824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4a4d0-4bdc-4dfc-9ef6-4524fc307a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:12.827909 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4a4d0-4bdc-4dfc-9ef6-4524fc307a73 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:12.828087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4a4d0-4bdc-4dfc-9ef6-4524fc307a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:12.828367 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4a4d0-4bdc-4dfc-9ef6-4524fc307a73 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:12.829371 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4a4d0-4bdc-4dfc-9ef6-4524fc307a73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:12.832247 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4a4d0-4bdc-4dfc-9ef6-4524fc307a73 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:12.902548 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3eb8a-b312-4d86-91b8-2d6cc7efc974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:12.904171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3eb8a-b312-4d86-91b8-2d6cc7efc974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:12.904508 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3eb8a-b312-4d86-91b8-2d6cc7efc974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:12.904766 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3eb8a-b312-4d86-91b8-2d6cc7efc974 admin admin] PATH_INFO: `/v3/projects/14bbb26a5abf4539880491723ebd2306/users/035bbeee983440c7b8b18cdc76b86dc3/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:13.012723 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3eb8a-b312-4d86-91b8-2d6cc7efc974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14bbb26a5abf4539880491723ebd2306, user_id=035bbeee983440c7b8b18cdc76b86dc3, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:13.015626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3eb8a-b312-4d86-91b8-2d6cc7efc974 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:13.037809 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 867/1722] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:12 2022] POST /identity/v3/users => generated 286 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:13.038995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4a4d0-4bdc-4dfc-9ef6-4524fc307a73 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:13.067207 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4a4d0-4bdc-4dfc-9ef6-4524fc307a73 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:13.089776 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394404eb-a7a2-451a-b260-e8514625687e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:13.090526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394404eb-a7a2-451a-b260-e8514625687e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:13.090778 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394404eb-a7a2-451a-b260-e8514625687e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:13.091057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394404eb-a7a2-451a-b260-e8514625687e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:13.091812 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394404eb-a7a2-451a-b260-e8514625687e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:13.093750 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394404eb-a7a2-451a-b260-e8514625687e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:13.135426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 868/1723] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:50:13.135426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394404eb-a7a2-451a-b260-e8514625687e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:13.138276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394404eb-a7a2-451a-b260-e8514625687e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:13.175799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 856/1724] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:12 2022] PUT /identity/v3/projects/14bbb26a5abf4539880491723ebd2306/users/035bbeee983440c7b8b18cdc76b86dc3/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:13.192917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8797568-c82c-4fcf-9f98-cd4fa478489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:13.195059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797568-c82c-4fcf-9f98-cd4fa478489c admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:13.196628 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797568-c82c-4fcf-9f98-cd4fa478489c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:13.198889 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797568-c82c-4fcf-9f98-cd4fa478489c admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:13.201095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8797568-c82c-4fcf-9f98-cd4fa478489c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:13.204016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8797568-c82c-4fcf-9f98-cd4fa478489c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:13.209490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a66f0-23de-4a22-8baa-8d350a8fbe8c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:13.210035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a66f0-23de-4a22-8baa-8d350a8fbe8c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:13.210473 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a66f0-23de-4a22-8baa-8d350a8fbe8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:13.265218 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 869/1725] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:13.278981 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8797568-c82c-4fcf-9f98-cd4fa478489c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:13.295302 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-630a66f0-23de-4a22-8baa-8d350a8fbe8c None None] MFA Rules not processed for user `035bbeee983440c7b8b18cdc76b86dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:13.298107 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-630a66f0-23de-4a22-8baa-8d350a8fbe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:13.342589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8797568-c82c-4fcf-9f98-cd4fa478489c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:13.559956 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad8cb3-823f-403f-a021-b4d9679279ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:13.562317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad8cb3-823f-403f-a021-b4d9679279ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:13.562317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad8cb3-823f-403f-a021-b4d9679279ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:13.562317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad8cb3-823f-403f-a021-b4d9679279ea admin admin] PATH_INFO: `/v3/projects/8ae10404eb4c45889b684d3ec230227f/users/0141b021a89f4337833fe0ef2bf2c206/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:13.582566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 857/1726] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:13.586839 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a66f0-23de-4a22-8baa-8d350a8fbe8c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:13.613177 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a66f0-23de-4a22-8baa-8d350a8fbe8c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:13.615383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad8cb3-823f-403f-a021-b4d9679279ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae10404eb4c45889b684d3ec230227f, user_id=0141b021a89f4337833fe0ef2bf2c206, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:13.619186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad8cb3-823f-403f-a021-b4d9679279ea admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:13.621786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4790944-a449-4c4c-b804-6f5b832af7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:13.624577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4790944-a449-4c4c-b804-6f5b832af7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:13.624577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4790944-a449-4c4c-b804-6f5b832af7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:13.624577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4790944-a449-4c4c-b804-6f5b832af7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:13.624577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4790944-a449-4c4c-b804-6f5b832af7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:13.633969 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4790944-a449-4c4c-b804-6f5b832af7e1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:13.746810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 870/1727] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:13 2022] PUT /identity/v3/projects/8ae10404eb4c45889b684d3ec230227f/users/0141b021a89f4337833fe0ef2bf2c206/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:13.760992 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0376e-affa-4eef-95bc-ba33b9f2b414 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:13.761283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0376e-affa-4eef-95bc-ba33b9f2b414 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:13.762416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0376e-affa-4eef-95bc-ba33b9f2b414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:13.771364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 858/1728] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:13 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:13.779204 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4790944-a449-4c4c-b804-6f5b832af7e1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:13.848118 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7ff0376e-affa-4eef-95bc-ba33b9f2b414 None None] MFA Rules not processed for user `0141b021a89f4337833fe0ef2bf2c206`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:13.850184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7ff0376e-affa-4eef-95bc-ba33b9f2b414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:13.943660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4790944-a449-4c4c-b804-6f5b832af7e1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:14.012060 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95555cad-1f64-42f7-a77b-e4ca75ea1859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:14.023819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555cad-1f64-42f7-a77b-e4ca75ea1859 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:14.035555 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555cad-1f64-42f7-a77b-e4ca75ea1859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:14.036166 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555cad-1f64-42f7-a77b-e4ca75ea1859 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:14.037517 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95555cad-1f64-42f7-a77b-e4ca75ea1859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:14.040246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95555cad-1f64-42f7-a77b-e4ca75ea1859 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:14.055715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 871/1729] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:14.057541 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0376e-affa-4eef-95bc-ba33b9f2b414 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:14.074016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0376e-affa-4eef-95bc-ba33b9f2b414 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:14.083194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfedd7-7927-4407-8853-7108d230fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:14.084575 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfedd7-7927-4407-8853-7108d230fe8e admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:14.091030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfedd7-7927-4407-8853-7108d230fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:14.091030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfedd7-7927-4407-8853-7108d230fe8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:14.106514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfedd7-7927-4407-8853-7108d230fe8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:14.121514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfedd7-7927-4407-8853-7108d230fe8e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:14.191889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 859/1730] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:13 2022] POST /identity/v3/users => generated 296 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:50:14.195823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95555cad-1f64-42f7-a77b-e4ca75ea1859 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:14.204503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-95555cad-1f64-42f7-a77b-e4ca75ea1859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:14.245593 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95555cad-1f64-42f7-a77b-e4ca75ea1859 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:14.269670 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08deeb76-ea2d-41c8-980b-b8badc22d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:14.269670 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deeb76-ea2d-41c8-980b-b8badc22d84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:14.269670 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deeb76-ea2d-41c8-980b-b8badc22d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:14.269670 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deeb76-ea2d-41c8-980b-b8badc22d84d admin admin] PATH_INFO: `/v3/projects/e7af3b817ec64181be4ccda0d50d3660` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:14.270509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08deeb76-ea2d-41c8-980b-b8badc22d84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7af3b817ec64181be4ccda0d50d3660)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:14.270509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08deeb76-ea2d-41c8-980b-b8badc22d84d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:14.305143 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 872/1731] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:14 2022] POST /identity/v3/projects => generated 373 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:14.311588 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfedd7-7927-4407-8853-7108d230fe8e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:14.443737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-08deeb76-ea2d-41c8-980b-b8badc22d84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7af3b817ec64181be4ccda0d50d3660', 'request_id': 'req-08deeb76-ea2d-41c8-980b-b8badc22d84d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:14.451800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-08deeb76-ea2d-41c8-980b-b8badc22d84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7af3b817ec64181be4ccda0d50d3660', 'request_id': 'req-08deeb76-ea2d-41c8-980b-b8badc22d84d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:14.537901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-08deeb76-ea2d-41c8-980b-b8badc22d84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7af3b817ec64181be4ccda0d50d3660', 'request_id': 'req-08deeb76-ea2d-41c8-980b-b8badc22d84d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:14.571438 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfedd7-7927-4407-8853-7108d230fe8e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:14.580829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-08deeb76-ea2d-41c8-980b-b8badc22d84d admin admin] The token cache is being invalidate because project e7af3b817ec64181be4ccda0d50d3660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:14.582031 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-08deeb76-ea2d-41c8-980b-b8badc22d84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:14.587513 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-08deeb76-ea2d-41c8-980b-b8badc22d84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:14.598498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 860/1732] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:14 2022] DELETE /identity/v3/projects/e7af3b817ec64181be4ccda0d50d3660 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:14.599728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08deeb76-ea2d-41c8-980b-b8badc22d84d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:14.605815 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-08deeb76-ea2d-41c8-980b-b8badc22d84d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:14.831087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613483c2-538b-4e67-b1d7-1bf1905a4312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:14.831777 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613483c2-538b-4e67-b1d7-1bf1905a4312 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:14.832053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613483c2-538b-4e67-b1d7-1bf1905a4312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:14.832323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613483c2-538b-4e67-b1d7-1bf1905a4312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:14.833094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613483c2-538b-4e67-b1d7-1bf1905a4312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:14.834729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613483c2-538b-4e67-b1d7-1bf1905a4312 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:14.867170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08deeb76-ea2d-41c8-980b-b8badc22d84d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:14.876940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 873/1733] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 568 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:14.877911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613483c2-538b-4e67-b1d7-1bf1905a4312 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:14.882611 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb9e11-6c00-4dcc-bea8-8417470fa878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:14.883293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb9e11-6c00-4dcc-bea8-8417470fa878 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:14.883576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb9e11-6c00-4dcc-bea8-8417470fa878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:14.883856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb9e11-6c00-4dcc-bea8-8417470fa878 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:14.884758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb9e11-6c00-4dcc-bea8-8417470fa878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:14.886755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb9e11-6c00-4dcc-bea8-8417470fa878 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:14.888633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-613483c2-538b-4e67-b1d7-1bf1905a4312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:14.938379 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613483c2-538b-4e67-b1d7-1bf1905a4312 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:14.945626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f261c30-9606-4df2-acc6-28e61deb1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:14.947196 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f261c30-9606-4df2-acc6-28e61deb1024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:14.947748 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f261c30-9606-4df2-acc6-28e61deb1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:14.948164 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f261c30-9606-4df2-acc6-28e61deb1024 admin admin] PATH_INFO: `/v3/users/f3ee01a3fac34a29bb90b1f06335dd0d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:14.949705 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f261c30-9606-4df2-acc6-28e61deb1024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ee01a3fac34a29bb90b1f06335dd0d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:14.952227 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f261c30-9606-4df2-acc6-28e61deb1024 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:15.004543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 861/1734] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:14 2022] POST /identity/v3/users => generated 293 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:15.004543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3154fac-acaa-453a-a460-1c46da7dd912 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:15.004543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3154fac-acaa-453a-a460-1c46da7dd912 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:15.004543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3154fac-acaa-453a-a460-1c46da7dd912 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:15.009678 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 862/1735] 10.222.0.81 () {54 vars in 921 bytes} [Wed May 4 17:50:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:50:15.010929 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3154fac-acaa-453a-a460-1c46da7dd912 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:15.017238 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a3154fac-acaa-453a-a460-1c46da7dd912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:15.059996 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3154fac-acaa-453a-a460-1c46da7dd912 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:15.070764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e20d9-887b-45cd-b68e-722f78ff2832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:15.072161 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e20d9-887b-45cd-b68e-722f78ff2832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:15.074471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e20d9-887b-45cd-b68e-722f78ff2832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:15.074931 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e20d9-887b-45cd-b68e-722f78ff2832 admin admin] PATH_INFO: `/v3/projects/aef4b3d38e754bd2a50fee7918e4ec6a/users/4b0b1e3f5ce44cbba504e2090c54bc0e/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:15.121164 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e20d9-887b-45cd-b68e-722f78ff2832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef4b3d38e754bd2a50fee7918e4ec6a, user_id=4b0b1e3f5ce44cbba504e2090c54bc0e, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:15.126336 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e20d9-887b-45cd-b68e-722f78ff2832 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:15.152657 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1f261c30-9606-4df2-acc6-28e61deb1024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ee01a3fac34a29bb90b1f06335dd0d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:15.216617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 863/1736] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:15 2022] PUT /identity/v3/projects/aef4b3d38e754bd2a50fee7918e4ec6a/users/4b0b1e3f5ce44cbba504e2090c54bc0e/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:15.220542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e20d9-887b-45cd-b68e-722f78ff2832 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:15.259671 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1f261c30-9606-4df2-acc6-28e61deb1024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ee01a3fac34a29bb90b1f06335dd0d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:15.260744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1f261c30-9606-4df2-acc6-28e61deb1024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ee01a3fac34a29bb90b1f06335dd0d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:15.284292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1f261c30-9606-4df2-acc6-28e61deb1024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ee01a3fac34a29bb90b1f06335dd0d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:15.319653 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1f261c30-9606-4df2-acc6-28e61deb1024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ee01a3fac34a29bb90b1f06335dd0d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:15.341248 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 874/1737] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:50:14 2022] DELETE /identity/v3/users/f3ee01a3fac34a29bb90b1f06335dd0d => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:15.342843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6d2d7-af68-4b67-8fa7-1ce141848ef5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:15.343343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6d2d7-af68-4b67-8fa7-1ce141848ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:15.343714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6d2d7-af68-4b67-8fa7-1ce141848ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:15.376700 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4cd6d2d7-af68-4b67-8fa7-1ce141848ef5 None None] MFA Rules not processed for user `d4a073d8f47a485cbb22db01530f3b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:15.379456 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4cd6d2d7-af68-4b67-8fa7-1ce141848ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:15.500652 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e20d9-887b-45cd-b68e-722f78ff2832 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:15.504106 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 875/1738] 10.222.0.81 () {58 vars in 1018 bytes} [Wed May 4 17:50:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:15.506100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6d2d7-af68-4b67-8fa7-1ce141848ef5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:15.510356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4cd6d2d7-af68-4b67-8fa7-1ce141848ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:15.630860 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6d2d7-af68-4b67-8fa7-1ce141848ef5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:15.639812 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8666e-d377-429b-84df-21d071bc0195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:15.641225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8666e-d377-429b-84df-21d071bc0195 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:15.641732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8666e-d377-429b-84df-21d071bc0195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:15.642124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8666e-d377-429b-84df-21d071bc0195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:15.643005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8666e-d377-429b-84df-21d071bc0195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:15.644971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8666e-d377-429b-84df-21d071bc0195 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:15.661943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 876/1739] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:15.664617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8666e-d377-429b-84df-21d071bc0195 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:15.678078 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8666e-d377-429b-84df-21d071bc0195 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:15.690529 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138302a2-975c-4e89-8222-75e96b08c5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:15.692284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138302a2-975c-4e89-8222-75e96b08c5be admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:15.693096 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138302a2-975c-4e89-8222-75e96b08c5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:15.694084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138302a2-975c-4e89-8222-75e96b08c5be admin admin] PATH_INFO: `/v3/projects/aef4b3d38e754bd2a50fee7918e4ec6a/users/4b0b1e3f5ce44cbba504e2090c54bc0e/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:15.697726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138302a2-975c-4e89-8222-75e96b08c5be admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef4b3d38e754bd2a50fee7918e4ec6a, user_id=4b0b1e3f5ce44cbba504e2090c54bc0e, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:15.707981 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138302a2-975c-4e89-8222-75e96b08c5be admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:15.735764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850fcc0-5ac6-40bc-bc5f-e93c7e2e6b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:15.736471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850fcc0-5ac6-40bc-bc5f-e93c7e2e6b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:15.736783 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850fcc0-5ac6-40bc-bc5f-e93c7e2e6b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:15.737059 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850fcc0-5ac6-40bc-bc5f-e93c7e2e6b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:15.739511 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850fcc0-5ac6-40bc-bc5f-e93c7e2e6b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:15.742745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850fcc0-5ac6-40bc-bc5f-e93c7e2e6b24 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:15.755487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 877/1740] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:15 2022] PUT /identity/v3/projects/aef4b3d38e754bd2a50fee7918e4ec6a/users/4b0b1e3f5ce44cbba504e2090c54bc0e/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:15.757664 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc85de-40c5-4be6-b38d-27394477471a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:15.758012 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc85de-40c5-4be6-b38d-27394477471a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:15.773441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc85de-40c5-4be6-b38d-27394477471a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:15.774029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 864/1741] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 551 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:15.774029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850fcc0-5ac6-40bc-bc5f-e93c7e2e6b24 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:15.802260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9850fcc0-5ac6-40bc-bc5f-e93c7e2e6b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:15.845515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850fcc0-5ac6-40bc-bc5f-e93c7e2e6b24 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:15.863701 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e4dc85de-40c5-4be6-b38d-27394477471a None None] MFA Rules not processed for user `4b0b1e3f5ce44cbba504e2090c54bc0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:15.872433 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e4dc85de-40c5-4be6-b38d-27394477471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:15.997773 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958172a-4b83-4cad-b6dc-e63982f98989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:15.999071 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958172a-4b83-4cad-b6dc-e63982f98989 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:15.999595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958172a-4b83-4cad-b6dc-e63982f98989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:16.000112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958172a-4b83-4cad-b6dc-e63982f98989 admin admin] PATH_INFO: `/v3/projects/b3ed80062dad48d6b230afcc2f8daea2/users/cda88f2993e04496842dc48facf21409/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:16.057790 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958172a-4b83-4cad-b6dc-e63982f98989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ed80062dad48d6b230afcc2f8daea2, user_id=cda88f2993e04496842dc48facf21409, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:16.065581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958172a-4b83-4cad-b6dc-e63982f98989 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:16.108625 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 878/1742] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:16.152115 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc85de-40c5-4be6-b38d-27394477471a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:16.154894 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e4dc85de-40c5-4be6-b38d-27394477471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:16.173679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 865/1743] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:15 2022] PUT /identity/v3/projects/b3ed80062dad48d6b230afcc2f8daea2/users/cda88f2993e04496842dc48facf21409/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:16.177474 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958172a-4b83-4cad-b6dc-e63982f98989 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:16.377839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc85de-40c5-4be6-b38d-27394477471a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:16.435392 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958172a-4b83-4cad-b6dc-e63982f98989 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:16.465222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5140691-5b65-4e35-8fcc-9f08de6db982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:16.465990 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5140691-5b65-4e35-8fcc-9f08de6db982 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:16.466285 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5140691-5b65-4e35-8fcc-9f08de6db982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:16.466626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5140691-5b65-4e35-8fcc-9f08de6db982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:16.467492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5140691-5b65-4e35-8fcc-9f08de6db982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:16.474502 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5140691-5b65-4e35-8fcc-9f08de6db982 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:16.502297 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 866/1744] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:16.503567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5140691-5b65-4e35-8fcc-9f08de6db982 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:16.505408 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d5140691-5b65-4e35-8fcc-9f08de6db982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:16.526102 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b5868-5787-473f-83df-1335186afe72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:16.526773 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b5868-5787-473f-83df-1335186afe72 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:16.527059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b5868-5787-473f-83df-1335186afe72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:16.527339 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b5868-5787-473f-83df-1335186afe72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:16.670259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b5868-5787-473f-83df-1335186afe72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:16.680406 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b5868-5787-473f-83df-1335186afe72 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:16.696932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 879/1745] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:16.698398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c893e-3bf0-4701-9e8c-beb4d0ae6523 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:16.699991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c893e-3bf0-4701-9e8c-beb4d0ae6523 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:16.700333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c893e-3bf0-4701-9e8c-beb4d0ae6523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:16.720714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5140691-5b65-4e35-8fcc-9f08de6db982 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:16.755189 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2e830-5243-427d-9b5b-0678126e88f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:16.756671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2e830-5243-427d-9b5b-0678126e88f9 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:16.757212 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2e830-5243-427d-9b5b-0678126e88f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:16.757671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2e830-5243-427d-9b5b-0678126e88f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:16.761809 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ab6c893e-3bf0-4701-9e8c-beb4d0ae6523 None None] MFA Rules not processed for user `4f49f50b0a7841c4a117cc5e2e1dccb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:16.764068 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ab6c893e-3bf0-4701-9e8c-beb4d0ae6523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:16.775255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2e830-5243-427d-9b5b-0678126e88f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:16.779928 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2e830-5243-427d-9b5b-0678126e88f9 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:16.807465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 867/1746] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:16.809815 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2e830-5243-427d-9b5b-0678126e88f9 service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:16.835032 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2e830-5243-427d-9b5b-0678126e88f9 service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:16.866154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4981e6-00bd-44e3-ace6-da220847311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:16.868452 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4981e6-00bd-44e3-ace6-da220847311f admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:16.871197 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4981e6-00bd-44e3-ace6-da220847311f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:16.874331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4981e6-00bd-44e3-ace6-da220847311f admin admin] PATH_INFO: `/v3/projects/b3ed80062dad48d6b230afcc2f8daea2/users/cda88f2993e04496842dc48facf21409/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:16.880945 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4981e6-00bd-44e3-ace6-da220847311f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ed80062dad48d6b230afcc2f8daea2, user_id=cda88f2993e04496842dc48facf21409, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:16.888613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4981e6-00bd-44e3-ace6-da220847311f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:16.952166 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 868/1747] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:16 2022] PUT /identity/v3/projects/b3ed80062dad48d6b230afcc2f8daea2/users/cda88f2993e04496842dc48facf21409/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:16.952166 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4981e6-00bd-44e3-ace6-da220847311f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:16.979860 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 880/1748] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:16.982347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b86ae8-70ad-4cf6-acf7-e156cd83dcc7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:16.989562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b86ae8-70ad-4cf6-acf7-e156cd83dcc7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:16.990104 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b86ae8-70ad-4cf6-acf7-e156cd83dcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:17.096011 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-06b86ae8-70ad-4cf6-acf7-e156cd83dcc7 None None] MFA Rules not processed for user `cda88f2993e04496842dc48facf21409`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:17.099585 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-06b86ae8-70ad-4cf6-acf7-e156cd83dcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:17.210430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4981e6-00bd-44e3-ace6-da220847311f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:17.247325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a9dad-de70-458f-8305-9fe4dd6c515c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:17.249128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a9dad-de70-458f-8305-9fe4dd6c515c service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:17.249128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a9dad-de70-458f-8305-9fe4dd6c515c service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:17.249128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a9dad-de70-458f-8305-9fe4dd6c515c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:17.253151 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-523a9dad-de70-458f-8305-9fe4dd6c515c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:17.295936 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 881/1749] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:17.300852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacca95-bdff-4607-a245-dedc14996047 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:17.300852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacca95-bdff-4607-a245-dedc14996047 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:17.300852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacca95-bdff-4607-a245-dedc14996047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:17.343327 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9eacca95-bdff-4607-a245-dedc14996047 None None] MFA Rules not processed for user `4f49f50b0a7841c4a117cc5e2e1dccb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:17.344780 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9eacca95-bdff-4607-a245-dedc14996047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:17.420227 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a9dad-de70-458f-8305-9fe4dd6c515c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:17.424008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a9dad-de70-458f-8305-9fe4dd6c515c service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:17.460746 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 869/1750] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:17.461844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a9dad-de70-458f-8305-9fe4dd6c515c service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:17.465282 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-523a9dad-de70-458f-8305-9fe4dd6c515c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:17.492550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 882/1751] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:17.505538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacca95-bdff-4607-a245-dedc14996047 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:17.510022 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9eacca95-bdff-4607-a245-dedc14996047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:17.518855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a9dad-de70-458f-8305-9fe4dd6c515c service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:17.541322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd83ead-a5d2-483d-9819-02779aed9c13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:17.542026 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd83ead-a5d2-483d-9819-02779aed9c13 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:17.542352 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd83ead-a5d2-483d-9819-02779aed9c13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:17.542744 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd83ead-a5d2-483d-9819-02779aed9c13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:17.587031 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd83ead-a5d2-483d-9819-02779aed9c13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:17.591857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd83ead-a5d2-483d-9819-02779aed9c13 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:17.613096 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 870/1752] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:17.707533 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacca95-bdff-4607-a245-dedc14996047 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:17.718704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c3b2e-41b6-4517-bbbb-c0803dbbb360 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:17.719545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c3b2e-41b6-4517-bbbb-c0803dbbb360 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:17.720402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c3b2e-41b6-4517-bbbb-c0803dbbb360 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:17.721169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c3b2e-41b6-4517-bbbb-c0803dbbb360 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:17.754204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c3b2e-41b6-4517-bbbb-c0803dbbb360 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:17.758600 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c3b2e-41b6-4517-bbbb-c0803dbbb360 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:17.794019 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 883/1753] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:17.922007 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd83ead-a5d2-483d-9819-02779aed9c13 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:17.933771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd83ead-a5d2-483d-9819-02779aed9c13 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:17.954570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa246f-2de7-4115-8628-33e50cc68490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:17.955373 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa246f-2de7-4115-8628-33e50cc68490 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:17.955770 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa246f-2de7-4115-8628-33e50cc68490 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:17.959263 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa246f-2de7-4115-8628-33e50cc68490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:17.961829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b7aa246f-2de7-4115-8628-33e50cc68490 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:18.196791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa246f-2de7-4115-8628-33e50cc68490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:18.202512 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa246f-2de7-4115-8628-33e50cc68490 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:18.269735 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 871/1754] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:18.326167 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858a0f0-6c0e-45d9-9d43-d41c26035dc1 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:18.326678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858a0f0-6c0e-45d9-9d43-d41c26035dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:18.327123 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858a0f0-6c0e-45d9-9d43-d41c26035dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:18.362580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1858a0f0-6c0e-45d9-9d43-d41c26035dc1 None None] MFA Rules not processed for user `0bf039be83b54817ac2f340cf9dfad63`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:18.364858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1858a0f0-6c0e-45d9-9d43-d41c26035dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:18.483745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa246f-2de7-4115-8628-33e50cc68490 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:18.485541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b7aa246f-2de7-4115-8628-33e50cc68490 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:18.532551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 884/1755] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:18.719706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa246f-2de7-4115-8628-33e50cc68490 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:18.725431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf76618-e082-49fb-ad45-9013235ad13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:18.726365 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf76618-e082-49fb-ad45-9013235ad13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:18.726365 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf76618-e082-49fb-ad45-9013235ad13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:18.726915 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf76618-e082-49fb-ad45-9013235ad13f admin admin] PATH_INFO: `/v3/projects/69d7625000da4bf1a680fc7978381d15` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:18.736605 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf76618-e082-49fb-ad45-9013235ad13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d7625000da4bf1a680fc7978381d15)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:18.745694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf76618-e082-49fb-ad45-9013235ad13f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:18.894019 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ee7e1-e5a2-499f-97e6-138ccd50e8e9 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:18.894767 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ee7e1-e5a2-499f-97e6-138ccd50e8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:18.895189 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ee7e1-e5a2-499f-97e6-138ccd50e8e9 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:18.897156 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 885/1756] 10.222.0.81 () {54 vars in 912 bytes} [Wed May 4 17:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:50:18.908277 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd0bd3-0d00-40f7-b482-af4d2d9b99c7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:18.908943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd0bd3-0d00-40f7-b482-af4d2d9b99c7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:18.909185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd0bd3-0d00-40f7-b482-af4d2d9b99c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:18.956047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e3fd0bd3-0d00-40f7-b482-af4d2d9b99c7 None None] MFA Rules not processed for user `3b220b08ef304644b329bcd31f0247f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:18.957864 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e3fd0bd3-0d00-40f7-b482-af4d2d9b99c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:19.073892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-caf76618-e082-49fb-ad45-9013235ad13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d7625000da4bf1a680fc7978381d15', 'request_id': 'req-caf76618-e082-49fb-ad45-9013235ad13f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:19.088838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-caf76618-e082-49fb-ad45-9013235ad13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d7625000da4bf1a680fc7978381d15', 'request_id': 'req-caf76618-e082-49fb-ad45-9013235ad13f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:19.185284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 886/1757] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:50:19.187767 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9b33e-78f2-4510-be24-ba34ad9e3091 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:19.188068 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9b33e-78f2-4510-be24-ba34ad9e3091 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:19.188351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9b33e-78f2-4510-be24-ba34ad9e3091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:19.224922 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-caf76618-e082-49fb-ad45-9013235ad13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d7625000da4bf1a680fc7978381d15', 'request_id': 'req-caf76618-e082-49fb-ad45-9013235ad13f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:19.237232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-42d9b33e-78f2-4510-be24-ba34ad9e3091 None None] MFA Rules not processed for user `96f0feac2b384b509bc9f75b92b4df95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:19.238611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-42d9b33e-78f2-4510-be24-ba34ad9e3091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:19.254547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-caf76618-e082-49fb-ad45-9013235ad13f admin admin] The token cache is being invalidate because project 69d7625000da4bf1a680fc7978381d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:19.255033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-caf76618-e082-49fb-ad45-9013235ad13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:19.261382 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-caf76618-e082-49fb-ad45-9013235ad13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:19.271277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 872/1758] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:18 2022] DELETE /identity/v3/projects/69d7625000da4bf1a680fc7978381d15 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:19.273061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c889c-00f1-46ad-b483-96eadee634cd None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:19.279963 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c889c-00f1-46ad-b483-96eadee634cd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:19.280504 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c889c-00f1-46ad-b483-96eadee634cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:19.342405 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-277c889c-00f1-46ad-b483-96eadee634cd None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:19.344419 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-277c889c-00f1-46ad-b483-96eadee634cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:19.417474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 887/1759] 10.222.0.81 () {58 vars in 1009 bytes} [Wed May 4 17:50:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:19.430521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9b33e-78f2-4510-be24-ba34ad9e3091 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:19.433014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-42d9b33e-78f2-4510-be24-ba34ad9e3091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:19.459158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9b33e-78f2-4510-be24-ba34ad9e3091 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:19.475340 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 873/1760] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:19.477168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a1c8e-62dc-4513-ac95-f1878bc7d735 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:19.477662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a1c8e-62dc-4513-ac95-f1878bc7d735 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:19.478120 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a1c8e-62dc-4513-ac95-f1878bc7d735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:19.497275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87f35a-8e4d-41db-bda8-599cdf5dddca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:19.498993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87f35a-8e4d-41db-bda8-599cdf5dddca service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:19.500645 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87f35a-8e4d-41db-bda8-599cdf5dddca service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:19.502353 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87f35a-8e4d-41db-bda8-599cdf5dddca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:19.508302 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-229a1c8e-62dc-4513-ac95-f1878bc7d735 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:19.508302 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-229a1c8e-62dc-4513-ac95-f1878bc7d735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:19.522820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 874/1761] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:19.524384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a1c8e-62dc-4513-ac95-f1878bc7d735 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:19.528381 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87f35a-8e4d-41db-bda8-599cdf5dddca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:19.533205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87f35a-8e4d-41db-bda8-599cdf5dddca service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:19.542608 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a1c8e-62dc-4513-ac95-f1878bc7d735 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:19.550845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b2e0c-26c1-4adc-829c-5a11c7bca55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:19.551793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b2e0c-26c1-4adc-829c-5a11c7bca55a admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:19.552276 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b2e0c-26c1-4adc-829c-5a11c7bca55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:19.552777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b2e0c-26c1-4adc-829c-5a11c7bca55a admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:19.554128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b2e0c-26c1-4adc-829c-5a11c7bca55a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:50:19.554708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b2e0c-26c1-4adc-829c-5a11c7bca55a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:19.556879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b2e0c-26c1-4adc-829c-5a11c7bca55a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:19.569636 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 888/1762] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:19.598444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87f35a-8e4d-41db-bda8-599cdf5dddca service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:19.599334 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 875/1763] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:50:19.625724 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87f35a-8e4d-41db-bda8-599cdf5dddca service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:19.636119 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1cebc-0223-46b3-921b-aacfe32a6880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:19.636856 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1cebc-0223-46b3-921b-aacfe32a6880 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:19.637137 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1cebc-0223-46b3-921b-aacfe32a6880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:19.639752 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1cebc-0223-46b3-921b-aacfe32a6880 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:19.640784 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1cebc-0223-46b3-921b-aacfe32a6880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:19.646075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1cebc-0223-46b3-921b-aacfe32a6880 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:19.821666 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 889/1764] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:19 2022] POST /identity/v3/projects => generated 377 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:19.827340 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b2e0c-26c1-4adc-829c-5a11c7bca55a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:19.888357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b2e0c-26c1-4adc-829c-5a11c7bca55a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:20.221528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990c841-3972-41da-8abf-73dd05774db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:20.222525 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990c841-3972-41da-8abf-73dd05774db1 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:20.222825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990c841-3972-41da-8abf-73dd05774db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:20.226542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990c841-3972-41da-8abf-73dd05774db1 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:20.226542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990c841-3972-41da-8abf-73dd05774db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:20.226542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990c841-3972-41da-8abf-73dd05774db1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:20.372681 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 876/1765] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:19 2022] POST /identity/v3/users => generated 289 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:20.374217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1cebc-0223-46b3-921b-aacfe32a6880 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:20.389413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1cebc-0223-46b3-921b-aacfe32a6880 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:20.400296 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8e2b5-b944-4981-8db7-1f2754b64be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:20.402455 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8e2b5-b944-4981-8db7-1f2754b64be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:20.402856 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8e2b5-b944-4981-8db7-1f2754b64be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:20.404159 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8e2b5-b944-4981-8db7-1f2754b64be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:20.405026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8e2b5-b944-4981-8db7-1f2754b64be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:20.409718 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8e2b5-b944-4981-8db7-1f2754b64be8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:20.447102 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 890/1766] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:20.451595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990c841-3972-41da-8abf-73dd05774db1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:20.470023 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990c841-3972-41da-8abf-73dd05774db1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:20.483847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b1425-d771-4270-94e2-441a67f47bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:20.484993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b1425-d771-4270-94e2-441a67f47bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:20.485554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b1425-d771-4270-94e2-441a67f47bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:20.486005 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b1425-d771-4270-94e2-441a67f47bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:20.504207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b1425-d771-4270-94e2-441a67f47bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:20.504207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b1425-d771-4270-94e2-441a67f47bb6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:20.571060 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 877/1767] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:50:20.573230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8e2b5-b944-4981-8db7-1f2754b64be8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:20.591026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8e2b5-b944-4981-8db7-1f2754b64be8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:20.602236 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7f4bf-9a9c-4773-b3f4-40cf76ea7dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:20.605421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7f4bf-9a9c-4773-b3f4-40cf76ea7dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:20.607035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7f4bf-9a9c-4773-b3f4-40cf76ea7dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:20.607889 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7f4bf-9a9c-4773-b3f4-40cf76ea7dd1 admin admin] PATH_INFO: `/v3/projects/d9072fb16ee0458c86d7b1f3f3bb2015/users/d15f87b17a04411e858aa6709c2ae444/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:20.688986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7f4bf-9a9c-4773-b3f4-40cf76ea7dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9072fb16ee0458c86d7b1f3f3bb2015, user_id=d15f87b17a04411e858aa6709c2ae444, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:20.698066 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7f4bf-9a9c-4773-b3f4-40cf76ea7dd1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:20.818802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 891/1768] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:20 2022] PUT /identity/v3/projects/d9072fb16ee0458c86d7b1f3f3bb2015/users/d15f87b17a04411e858aa6709c2ae444/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:20.822540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfa048-aeb9-4707-bd89-5cbf77f32db5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:20.822854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfa048-aeb9-4707-bd89-5cbf77f32db5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:20.823185 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfa048-aeb9-4707-bd89-5cbf77f32db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:20.908246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d9cfa048-aeb9-4707-bd89-5cbf77f32db5 None None] MFA Rules not processed for user `d15f87b17a04411e858aa6709c2ae444`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:20.933822 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d9cfa048-aeb9-4707-bd89-5cbf77f32db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:21.289307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 878/1769] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:21.291674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7f4bf-9a9c-4773-b3f4-40cf76ea7dd1 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:21.734773 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7f4bf-9a9c-4773-b3f4-40cf76ea7dd1 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:21.745329 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4b258-e100-4ed1-bfee-3b6e2e33ef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:21.746483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4b258-e100-4ed1-bfee-3b6e2e33ef2b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:21.746973 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4b258-e100-4ed1-bfee-3b6e2e33ef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:21.747412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4b258-e100-4ed1-bfee-3b6e2e33ef2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:21.748698 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4b258-e100-4ed1-bfee-3b6e2e33ef2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:21.751119 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4b258-e100-4ed1-bfee-3b6e2e33ef2b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:21.944543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfa048-aeb9-4707-bd89-5cbf77f32db5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:21.944763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 892/1770] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:21 2022] POST /identity/v3/projects => generated 379 bytes in 655 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:21.966942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfa048-aeb9-4707-bd89-5cbf77f32db5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:22.039719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525d9f6-0d8b-4c01-afe4-245541f400a9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:22.039719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525d9f6-0d8b-4c01-afe4-245541f400a9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:22.039719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525d9f6-0d8b-4c01-afe4-245541f400a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:22.039719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6525d9f6-0d8b-4c01-afe4-245541f400a9 None None] MFA Rules not processed for user `4f49f50b0a7841c4a117cc5e2e1dccb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:22.039719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6525d9f6-0d8b-4c01-afe4-245541f400a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:22.108336 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4433b8-1ce1-4af1-afb4-3dfc5b39249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:22.108336 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4433b8-1ce1-4af1-afb4-3dfc5b39249e admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:22.108336 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4433b8-1ce1-4af1-afb4-3dfc5b39249e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:22.108336 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4433b8-1ce1-4af1-afb4-3dfc5b39249e admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:22.108771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4433b8-1ce1-4af1-afb4-3dfc5b39249e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:22.115827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4433b8-1ce1-4af1-afb4-3dfc5b39249e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:22.209531 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 893/1771] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:50:22.395091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 879/1772] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:21 2022] POST /identity/v3/users => generated 296 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:50:22.396461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525d9f6-0d8b-4c01-afe4-245541f400a9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:22.411697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525d9f6-0d8b-4c01-afe4-245541f400a9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:22.436863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544ad71-836a-45ef-81da-7a44c6ccff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:22.438087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ad71-836a-45ef-81da-7a44c6ccff4b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:22.438667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ad71-836a-45ef-81da-7a44c6ccff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:22.439197 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ad71-836a-45ef-81da-7a44c6ccff4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:22.440529 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544ad71-836a-45ef-81da-7a44c6ccff4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:22.443101 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544ad71-836a-45ef-81da-7a44c6ccff4b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:22.474876 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 894/1773] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:22.479217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4433b8-1ce1-4af1-afb4-3dfc5b39249e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:22.501115 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4433b8-1ce1-4af1-afb4-3dfc5b39249e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:22.509179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dfc43-2095-4971-bbe7-d96b4d1348e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:22.511793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dfc43-2095-4971-bbe7-d96b4d1348e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:22.512074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dfc43-2095-4971-bbe7-d96b4d1348e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:22.512711 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dfc43-2095-4971-bbe7-d96b4d1348e8 admin admin] PATH_INFO: `/v3/projects/4197bfef7ac34835a647c0286bc7724d/users/0831f54040874afebe4557efe9715630/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:22.534309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dfc43-2095-4971-bbe7-d96b4d1348e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4197bfef7ac34835a647c0286bc7724d, user_id=0831f54040874afebe4557efe9715630, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:22.538122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dfc43-2095-4971-bbe7-d96b4d1348e8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:22.683636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 880/1774] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:22 2022] PUT /identity/v3/projects/4197bfef7ac34835a647c0286bc7724d/users/0831f54040874afebe4557efe9715630/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:22.687503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544ad71-836a-45ef-81da-7a44c6ccff4b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:22.715649 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544ad71-836a-45ef-81da-7a44c6ccff4b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:23.046813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec01bd3-d9dd-4644-99f8-d85ac60a268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:23.054991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec01bd3-d9dd-4644-99f8-d85ac60a268e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:23.054991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec01bd3-d9dd-4644-99f8-d85ac60a268e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:23.054991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec01bd3-d9dd-4644-99f8-d85ac60a268e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:23.055729 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec01bd3-d9dd-4644-99f8-d85ac60a268e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:23.061175 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec01bd3-d9dd-4644-99f8-d85ac60a268e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:23.089294 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 895/1775] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:23.095475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dfc43-2095-4971-bbe7-d96b4d1348e8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:23.123202 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dfc43-2095-4971-bbe7-d96b4d1348e8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:23.136315 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd1e80-e9c5-46cc-bfb4-6501ba73a60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:23.140066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd1e80-e9c5-46cc-bfb4-6501ba73a60e admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:23.140733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd1e80-e9c5-46cc-bfb4-6501ba73a60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:23.142430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd1e80-e9c5-46cc-bfb4-6501ba73a60e admin admin] PATH_INFO: `/v3/projects/4197bfef7ac34835a647c0286bc7724d/users/0831f54040874afebe4557efe9715630/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:23.150815 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd1e80-e9c5-46cc-bfb4-6501ba73a60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4197bfef7ac34835a647c0286bc7724d, user_id=0831f54040874afebe4557efe9715630, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:23.155177 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd1e80-e9c5-46cc-bfb4-6501ba73a60e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:23.183785 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 881/1776] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:23 2022] PUT /identity/v3/projects/4197bfef7ac34835a647c0286bc7724d/users/0831f54040874afebe4557efe9715630/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:50:23.195437 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d7df-f924-47dd-a2ac-eff61b0fef82 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:23.195735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d7df-f924-47dd-a2ac-eff61b0fef82 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:23.196015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d7df-f924-47dd-a2ac-eff61b0fef82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:23.233494 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5324d7df-f924-47dd-a2ac-eff61b0fef82 None None] MFA Rules not processed for user `0831f54040874afebe4557efe9715630`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:23.235355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5324d7df-f924-47dd-a2ac-eff61b0fef82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:23.358169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 896/1777] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:23.370848 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd1e80-e9c5-46cc-bfb4-6501ba73a60e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:23.373219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-67cd1e80-e9c5-46cc-bfb4-6501ba73a60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:23.492483 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd1e80-e9c5-46cc-bfb4-6501ba73a60e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:23.506310 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47160259-b0b3-48e4-804e-3ae3971fa441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:23.507203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47160259-b0b3-48e4-804e-3ae3971fa441 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:23.508746 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47160259-b0b3-48e4-804e-3ae3971fa441 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:23.509182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47160259-b0b3-48e4-804e-3ae3971fa441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:23.521900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47160259-b0b3-48e4-804e-3ae3971fa441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:23.523825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47160259-b0b3-48e4-804e-3ae3971fa441 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:23.535676 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 882/1778] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:23.864816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d7df-f924-47dd-a2ac-eff61b0fef82 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:23.866457 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5324d7df-f924-47dd-a2ac-eff61b0fef82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:23.887358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d7df-f924-47dd-a2ac-eff61b0fef82 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:23.888961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cfd96-4668-4d48-a745-5a40f122e542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:23.889754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cfd96-4668-4d48-a745-5a40f122e542 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:23.890099 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cfd96-4668-4d48-a745-5a40f122e542 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:23.890479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cfd96-4668-4d48-a745-5a40f122e542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:23.974275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cfd96-4668-4d48-a745-5a40f122e542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:23.976300 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cfd96-4668-4d48-a745-5a40f122e542 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:23.990548 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 897/1779] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:24.170038 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47160259-b0b3-48e4-804e-3ae3971fa441 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:24.171560 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-47160259-b0b3-48e4-804e-3ae3971fa441 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:24.243754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47160259-b0b3-48e4-804e-3ae3971fa441 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:24.255586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112d5c4-b53b-43b7-be0a-77fd486ffcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:24.255586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112d5c4-b53b-43b7-be0a-77fd486ffcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:24.255586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112d5c4-b53b-43b7-be0a-77fd486ffcda admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:24.255586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112d5c4-b53b-43b7-be0a-77fd486ffcda admin admin] PATH_INFO: `/v3/users/6dfbe728c4834164879916804947719c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:24.255984 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112d5c4-b53b-43b7-be0a-77fd486ffcda admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dfbe728c4834164879916804947719c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:24.258151 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112d5c4-b53b-43b7-be0a-77fd486ffcda admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:24.548880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f112d5c4-b53b-43b7-be0a-77fd486ffcda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dfbe728c4834164879916804947719c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:24.564607 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f112d5c4-b53b-43b7-be0a-77fd486ffcda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dfbe728c4834164879916804947719c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:24.636970 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f112d5c4-b53b-43b7-be0a-77fd486ffcda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dfbe728c4834164879916804947719c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:24.653940 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f112d5c4-b53b-43b7-be0a-77fd486ffcda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dfbe728c4834164879916804947719c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:24.655103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f112d5c4-b53b-43b7-be0a-77fd486ffcda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dfbe728c4834164879916804947719c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:24.668560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c186a0-7cd8-48e6-be6f-6383f432fdd8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:24.669178 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c186a0-7cd8-48e6-be6f-6383f432fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:24.669374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c186a0-7cd8-48e6-be6f-6383f432fdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:24.671232 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 883/1780] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:50:24 2022] DELETE /identity/v3/users/6dfbe728c4834164879916804947719c => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:24.687987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e5c186a0-7cd8-48e6-be6f-6383f432fdd8 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:24.689336 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e5c186a0-7cd8-48e6-be6f-6383f432fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:24.751840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 898/1781] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:24.763422 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112d5c4-b53b-43b7-be0a-77fd486ffcda admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:24.769154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f112d5c4-b53b-43b7-be0a-77fd486ffcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:24.829730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112d5c4-b53b-43b7-be0a-77fd486ffcda admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:24.833393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68b85c-f74e-4d95-9855-d4d226116c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:24.834040 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68b85c-f74e-4d95-9855-d4d226116c0e service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:24.834326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68b85c-f74e-4d95-9855-d4d226116c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:24.834602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68b85c-f74e-4d95-9855-d4d226116c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:24.844130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68b85c-f74e-4d95-9855-d4d226116c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:24.845588 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68b85c-f74e-4d95-9855-d4d226116c0e service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:24.855628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 884/1782] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:25.354491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c186a0-7cd8-48e6-be6f-6383f432fdd8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:25.355937 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e5c186a0-7cd8-48e6-be6f-6383f432fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:25.368040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c186a0-7cd8-48e6-be6f-6383f432fdd8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:25.373740 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289542d-6474-40f4-8e1c-aa5c679087fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:25.374879 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289542d-6474-40f4-8e1c-aa5c679087fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:25.375162 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289542d-6474-40f4-8e1c-aa5c679087fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:25.375436 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289542d-6474-40f4-8e1c-aa5c679087fb admin admin] PATH_INFO: `/v3/projects/4d20668e54b349d780b21e9253b8a91c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:25.376675 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289542d-6474-40f4-8e1c-aa5c679087fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d20668e54b349d780b21e9253b8a91c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:25.377985 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: WARNING py.warnings [None req-2289542d-6474-40f4-8e1c-aa5c679087fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 17:50:25.377985 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: warnings.warn(msg) May 04 17:50:25.377985 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: May 04 17:50:25.379139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289542d-6474-40f4-8e1c-aa5c679087fb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:25.524291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2289542d-6474-40f4-8e1c-aa5c679087fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d20668e54b349d780b21e9253b8a91c', 'request_id': 'req-2289542d-6474-40f4-8e1c-aa5c679087fb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:25.530787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2289542d-6474-40f4-8e1c-aa5c679087fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d20668e54b349d780b21e9253b8a91c', 'request_id': 'req-2289542d-6474-40f4-8e1c-aa5c679087fb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:25.546220 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2289542d-6474-40f4-8e1c-aa5c679087fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d20668e54b349d780b21e9253b8a91c', 'request_id': 'req-2289542d-6474-40f4-8e1c-aa5c679087fb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:25.633673 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2289542d-6474-40f4-8e1c-aa5c679087fb admin admin] The token cache is being invalidate because project 4d20668e54b349d780b21e9253b8a91c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:25.633963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2289542d-6474-40f4-8e1c-aa5c679087fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:25.634868 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2289542d-6474-40f4-8e1c-aa5c679087fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:25.636452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 899/1783] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:25 2022] DELETE /identity/v3/projects/4d20668e54b349d780b21e9253b8a91c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:25.644458 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68b85c-f74e-4d95-9855-d4d226116c0e service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:25.654904 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68b85c-f74e-4d95-9855-d4d226116c0e service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:25.734416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6c1a9-bca0-4213-af6f-ba11e2642f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:25.735437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6c1a9-bca0-4213-af6f-ba11e2642f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:25.735906 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6c1a9-bca0-4213-af6f-ba11e2642f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:25.736283 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6c1a9-bca0-4213-af6f-ba11e2642f45 admin admin] PATH_INFO: `/v3/users/035bbeee983440c7b8b18cdc76b86dc3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:25.737608 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6c1a9-bca0-4213-af6f-ba11e2642f45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=035bbeee983440c7b8b18cdc76b86dc3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:25.740041 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6c1a9-bca0-4213-af6f-ba11e2642f45 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:25.949865 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6ed6c1a9-bca0-4213-af6f-ba11e2642f45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '035bbeee983440c7b8b18cdc76b86dc3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:25.961214 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6ed6c1a9-bca0-4213-af6f-ba11e2642f45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '035bbeee983440c7b8b18cdc76b86dc3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:26.055835 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6ed6c1a9-bca0-4213-af6f-ba11e2642f45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '035bbeee983440c7b8b18cdc76b86dc3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:26.063994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6ed6c1a9-bca0-4213-af6f-ba11e2642f45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '035bbeee983440c7b8b18cdc76b86dc3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:26.064930 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6ed6c1a9-bca0-4213-af6f-ba11e2642f45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '035bbeee983440c7b8b18cdc76b86dc3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:26.071496 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 885/1784] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:50:25 2022] DELETE /identity/v3/users/035bbeee983440c7b8b18cdc76b86dc3 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:26.537503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289542d-6474-40f4-8e1c-aa5c679087fb admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:26.538972 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2289542d-6474-40f4-8e1c-aa5c679087fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:26.553490 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289542d-6474-40f4-8e1c-aa5c679087fb admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:26.741309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de0747-2663-4371-a7a4-9e30dde941ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:26.742206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de0747-2663-4371-a7a4-9e30dde941ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:26.742422 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de0747-2663-4371-a7a4-9e30dde941ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:26.742687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de0747-2663-4371-a7a4-9e30dde941ef admin admin] PATH_INFO: `/v3/projects/14bbb26a5abf4539880491723ebd2306` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:26.743846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de0747-2663-4371-a7a4-9e30dde941ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=14bbb26a5abf4539880491723ebd2306)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:26.746069 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de0747-2663-4371-a7a4-9e30dde941ef admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:27.013099 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f5de0747-2663-4371-a7a4-9e30dde941ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14bbb26a5abf4539880491723ebd2306', 'request_id': 'req-f5de0747-2663-4371-a7a4-9e30dde941ef'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:27.019699 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f5de0747-2663-4371-a7a4-9e30dde941ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14bbb26a5abf4539880491723ebd2306', 'request_id': 'req-f5de0747-2663-4371-a7a4-9e30dde941ef'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:27.027174 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f5de0747-2663-4371-a7a4-9e30dde941ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14bbb26a5abf4539880491723ebd2306', 'request_id': 'req-f5de0747-2663-4371-a7a4-9e30dde941ef'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:27.200206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f5de0747-2663-4371-a7a4-9e30dde941ef admin admin] The token cache is being invalidate because project 14bbb26a5abf4539880491723ebd2306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:27.200790 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f5de0747-2663-4371-a7a4-9e30dde941ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:27.201443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f5de0747-2663-4371-a7a4-9e30dde941ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:27.206468 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 900/1785] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:26 2022] DELETE /identity/v3/projects/14bbb26a5abf4539880491723ebd2306 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:27.210707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6c1a9-bca0-4213-af6f-ba11e2642f45 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:27.210707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6ed6c1a9-bca0-4213-af6f-ba11e2642f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:27.224428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6c1a9-bca0-4213-af6f-ba11e2642f45 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:27.312346 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422aa47-2426-4953-8452-23129a49e735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:27.313268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422aa47-2426-4953-8452-23129a49e735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:27.313600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422aa47-2426-4953-8452-23129a49e735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:27.313884 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422aa47-2426-4953-8452-23129a49e735 admin admin] PATH_INFO: `/v3/users/4b0b1e3f5ce44cbba504e2090c54bc0e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:27.315175 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422aa47-2426-4953-8452-23129a49e735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b0b1e3f5ce44cbba504e2090c54bc0e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:27.317112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422aa47-2426-4953-8452-23129a49e735 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:28.553377 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d422aa47-2426-4953-8452-23129a49e735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b0b1e3f5ce44cbba504e2090c54bc0e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:28.565604 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d422aa47-2426-4953-8452-23129a49e735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b0b1e3f5ce44cbba504e2090c54bc0e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:28.696658 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d422aa47-2426-4953-8452-23129a49e735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b0b1e3f5ce44cbba504e2090c54bc0e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:28.704678 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d422aa47-2426-4953-8452-23129a49e735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b0b1e3f5ce44cbba504e2090c54bc0e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:28.712207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d422aa47-2426-4953-8452-23129a49e735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b0b1e3f5ce44cbba504e2090c54bc0e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:28.712207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 886/1786] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:50:27 2022] DELETE /identity/v3/users/4b0b1e3f5ce44cbba504e2090c54bc0e => generated 0 bytes in 1505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:29.240610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de0747-2663-4371-a7a4-9e30dde941ef admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:29.242383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f5de0747-2663-4371-a7a4-9e30dde941ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:29.265855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de0747-2663-4371-a7a4-9e30dde941ef admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:29.372014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17bd87-c875-40b0-bcb2-7eb82fd200a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:29.373205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17bd87-c875-40b0-bcb2-7eb82fd200a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:29.373480 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17bd87-c875-40b0-bcb2-7eb82fd200a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:29.373753 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17bd87-c875-40b0-bcb2-7eb82fd200a4 admin admin] PATH_INFO: `/v3/projects/aef4b3d38e754bd2a50fee7918e4ec6a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:29.375283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17bd87-c875-40b0-bcb2-7eb82fd200a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef4b3d38e754bd2a50fee7918e4ec6a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:29.377554 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17bd87-c875-40b0-bcb2-7eb82fd200a4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:29.533722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-eb17bd87-c875-40b0-bcb2-7eb82fd200a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef4b3d38e754bd2a50fee7918e4ec6a', 'request_id': 'req-eb17bd87-c875-40b0-bcb2-7eb82fd200a4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:29.539621 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-eb17bd87-c875-40b0-bcb2-7eb82fd200a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef4b3d38e754bd2a50fee7918e4ec6a', 'request_id': 'req-eb17bd87-c875-40b0-bcb2-7eb82fd200a4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:29.546914 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-eb17bd87-c875-40b0-bcb2-7eb82fd200a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef4b3d38e754bd2a50fee7918e4ec6a', 'request_id': 'req-eb17bd87-c875-40b0-bcb2-7eb82fd200a4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:29.622214 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-eb17bd87-c875-40b0-bcb2-7eb82fd200a4 admin admin] The token cache is being invalidate because project aef4b3d38e754bd2a50fee7918e4ec6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:29.622530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-eb17bd87-c875-40b0-bcb2-7eb82fd200a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:29.623283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-eb17bd87-c875-40b0-bcb2-7eb82fd200a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:29.625257 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 901/1787] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:29 2022] DELETE /identity/v3/projects/aef4b3d38e754bd2a50fee7918e4ec6a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:29.631230 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854e55-79e5-4e31-823b-794ed179ac7f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:29.631744 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854e55-79e5-4e31-823b-794ed179ac7f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:29.631834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854e55-79e5-4e31-823b-794ed179ac7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:29.650437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-89854e55-79e5-4e31-823b-794ed179ac7f None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:29.653712 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-89854e55-79e5-4e31-823b-794ed179ac7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:29.712791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 887/1788] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:29.721934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff3b9-fef9-41cd-8dad-560b095211da None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:29.722293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff3b9-fef9-41cd-8dad-560b095211da None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:29.722487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff3b9-fef9-41cd-8dad-560b095211da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:29.750965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ce9ff3b9-fef9-41cd-8dad-560b095211da None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:29.752491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ce9ff3b9-fef9-41cd-8dad-560b095211da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:29.760959 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 902/1789] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:29.765264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89854e55-79e5-4e31-823b-794ed179ac7f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:29.775137 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89854e55-79e5-4e31-823b-794ed179ac7f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:29.786339 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606ad42-5e29-47a9-84e0-fbbb41291029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:29.787059 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606ad42-5e29-47a9-84e0-fbbb41291029 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:29.787585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606ad42-5e29-47a9-84e0-fbbb41291029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:29.788229 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606ad42-5e29-47a9-84e0-fbbb41291029 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:29.789226 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606ad42-5e29-47a9-84e0-fbbb41291029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:50:29.789689 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606ad42-5e29-47a9-84e0-fbbb41291029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:29.792009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606ad42-5e29-47a9-84e0-fbbb41291029 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:29.804405 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 888/1790] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:50:29.809158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ff3b9-fef9-41cd-8dad-560b095211da None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:29.823339 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ff3b9-fef9-41cd-8dad-560b095211da None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:29.828382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b4b17-e92e-4110-8ad8-d7bdaacee304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:29.829184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b4b17-e92e-4110-8ad8-d7bdaacee304 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:29.829604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b4b17-e92e-4110-8ad8-d7bdaacee304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:29.830237 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b4b17-e92e-4110-8ad8-d7bdaacee304 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:29.830945 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b4b17-e92e-4110-8ad8-d7bdaacee304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:29.833601 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b4b17-e92e-4110-8ad8-d7bdaacee304 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:29.968923 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 903/1791] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:29 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:29.980705 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606ad42-5e29-47a9-84e0-fbbb41291029 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:29.990908 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606ad42-5e29-47a9-84e0-fbbb41291029 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:30.057686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1c926-3655-4316-be4f-93b312dced33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:30.057686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1c926-3655-4316-be4f-93b312dced33 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:30.057686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1c926-3655-4316-be4f-93b312dced33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:30.057686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1c926-3655-4316-be4f-93b312dced33 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:30.057972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1c926-3655-4316-be4f-93b312dced33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:30.057972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1c926-3655-4316-be4f-93b312dced33 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:30.214147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 889/1792] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:29 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:50:30.215829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b4b17-e92e-4110-8ad8-d7bdaacee304 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:30.226454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b4b17-e92e-4110-8ad8-d7bdaacee304 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:30.232409 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efd42d-0050-4bbb-945f-117b3353adfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:30.233120 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efd42d-0050-4bbb-945f-117b3353adfb admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:30.236839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efd42d-0050-4bbb-945f-117b3353adfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:30.236839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efd42d-0050-4bbb-945f-117b3353adfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:30.236839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efd42d-0050-4bbb-945f-117b3353adfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:30.236839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efd42d-0050-4bbb-945f-117b3353adfb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:30.248035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 904/1793] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:30.252799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1c926-3655-4316-be4f-93b312dced33 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:30.265960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1c926-3655-4316-be4f-93b312dced33 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:30.273417 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4a27c-9eed-4175-831c-7f0f993b70a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:30.274245 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4a27c-9eed-4175-831c-7f0f993b70a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:30.274598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4a27c-9eed-4175-831c-7f0f993b70a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:30.275217 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4a27c-9eed-4175-831c-7f0f993b70a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:30.276749 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4a27c-9eed-4175-831c-7f0f993b70a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:30.278565 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4a27c-9eed-4175-831c-7f0f993b70a9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:30.296955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efd42d-0050-4bbb-945f-117b3353adfb admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:30.297182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 890/1794] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:30.307263 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efd42d-0050-4bbb-945f-117b3353adfb admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:30.338005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22431998-ee1e-45ee-beac-80c844ee1b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:30.340717 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22431998-ee1e-45ee-beac-80c844ee1b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:30.341281 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22431998-ee1e-45ee-beac-80c844ee1b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:30.341763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22431998-ee1e-45ee-beac-80c844ee1b26 admin admin] PATH_INFO: `/v3/projects/e038fbcd56b34c35aa58cc41a5993043/users/1a043b41c72245baa3fbc8773779e829/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:30.370363 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22431998-ee1e-45ee-beac-80c844ee1b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e038fbcd56b34c35aa58cc41a5993043, user_id=1a043b41c72245baa3fbc8773779e829, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:30.374029 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22431998-ee1e-45ee-beac-80c844ee1b26 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:30.481151 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 905/1795] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:30 2022] PUT /identity/v3/projects/e038fbcd56b34c35aa58cc41a5993043/users/1a043b41c72245baa3fbc8773779e829/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:50:30.495294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3feac5-ef66-4cef-b075-a5f0fe284033 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:30.495294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3feac5-ef66-4cef-b075-a5f0fe284033 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:30.495548 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3feac5-ef66-4cef-b075-a5f0fe284033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:30.561334 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2c3feac5-ef66-4cef-b075-a5f0fe284033 None None] MFA Rules not processed for user `1a043b41c72245baa3fbc8773779e829`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:30.566505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2c3feac5-ef66-4cef-b075-a5f0fe284033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:30.658941 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 891/1796] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:30.663298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22431998-ee1e-45ee-beac-80c844ee1b26 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:30.793433 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22431998-ee1e-45ee-beac-80c844ee1b26 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:30.800997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01de1ae-7bcb-4a2a-ae8b-731927d22ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:30.801810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01de1ae-7bcb-4a2a-ae8b-731927d22ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:30.802146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01de1ae-7bcb-4a2a-ae8b-731927d22ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:30.802516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01de1ae-7bcb-4a2a-ae8b-731927d22ac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:30.803410 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01de1ae-7bcb-4a2a-ae8b-731927d22ac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:30.805630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01de1ae-7bcb-4a2a-ae8b-731927d22ac4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:31.016475 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 906/1797] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:30 2022] POST /identity/v3/projects => generated 367 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:50:31.021256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3feac5-ef66-4cef-b075-a5f0fe284033 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:31.037820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3feac5-ef66-4cef-b075-a5f0fe284033 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:31.168569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5bc1c-b213-42f6-be63-c2eb6a88bc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:31.170234 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5bc1c-b213-42f6-be63-c2eb6a88bc3a admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:31.170682 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5bc1c-b213-42f6-be63-c2eb6a88bc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:31.171121 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5bc1c-b213-42f6-be63-c2eb6a88bc3a admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:31.172085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5bc1c-b213-42f6-be63-c2eb6a88bc3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:31.174216 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5bc1c-b213-42f6-be63-c2eb6a88bc3a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:31.256977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 892/1798] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:31 2022] POST /identity/v3/users => generated 290 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:31.261539 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01de1ae-7bcb-4a2a-ae8b-731927d22ac4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:31.277098 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01de1ae-7bcb-4a2a-ae8b-731927d22ac4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:31.284075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc26d87-4724-4ac3-a344-23a8e754a7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:31.285037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc26d87-4724-4ac3-a344-23a8e754a7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:31.289749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc26d87-4724-4ac3-a344-23a8e754a7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:31.289749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc26d87-4724-4ac3-a344-23a8e754a7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:31.301046 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc26d87-4724-4ac3-a344-23a8e754a7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:31.302761 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc26d87-4724-4ac3-a344-23a8e754a7c1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:31.342558 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 907/1799] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:50:31.349045 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5bc1c-b213-42f6-be63-c2eb6a88bc3a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:31.363208 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5bc1c-b213-42f6-be63-c2eb6a88bc3a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:31.367985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8ef31-964e-4d0b-aa57-1e76af597679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:31.368920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ef31-964e-4d0b-aa57-1e76af597679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:31.369198 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ef31-964e-4d0b-aa57-1e76af597679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:31.369705 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ef31-964e-4d0b-aa57-1e76af597679 admin admin] PATH_INFO: `/v3/projects/6353cf2ff3c0475f9c9bd67b91c55306/users/5b9f5302e178410582fb88f6bdbdc798/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:31.387845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8ef31-964e-4d0b-aa57-1e76af597679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6353cf2ff3c0475f9c9bd67b91c55306, user_id=5b9f5302e178410582fb88f6bdbdc798, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:31.390587 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8ef31-964e-4d0b-aa57-1e76af597679 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:31.473860 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 893/1800] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:31 2022] PUT /identity/v3/projects/6353cf2ff3c0475f9c9bd67b91c55306/users/5b9f5302e178410582fb88f6bdbdc798/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:31.475377 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc26d87-4724-4ac3-a344-23a8e754a7c1 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:31.487040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc26d87-4724-4ac3-a344-23a8e754a7c1 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:31.565655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8ef31-964e-4d0b-aa57-1e76af597679 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:31.567785 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-aee8ef31-964e-4d0b-aa57-1e76af597679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:31.601057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd7042-94e8-403d-a2ab-498764b151cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:31.606218 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd7042-94e8-403d-a2ab-498764b151cd admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:31.609582 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd7042-94e8-403d-a2ab-498764b151cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:31.611993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd7042-94e8-403d-a2ab-498764b151cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:31.613017 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd7042-94e8-403d-a2ab-498764b151cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:31.614963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd7042-94e8-403d-a2ab-498764b151cd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:31.640625 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 908/1801] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:31.644948 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd7042-94e8-403d-a2ab-498764b151cd admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:31.681148 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd7042-94e8-403d-a2ab-498764b151cd admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:31.695387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f1911-5ae8-487a-9ac8-db2efeeb4d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:31.696411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f1911-5ae8-487a-9ac8-db2efeeb4d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:31.696914 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f1911-5ae8-487a-9ac8-db2efeeb4d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:31.697197 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f1911-5ae8-487a-9ac8-db2efeeb4d69 admin admin] PATH_INFO: `/v3/projects/6353cf2ff3c0475f9c9bd67b91c55306/users/5b9f5302e178410582fb88f6bdbdc798/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:31.701276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f1911-5ae8-487a-9ac8-db2efeeb4d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6353cf2ff3c0475f9c9bd67b91c55306, user_id=5b9f5302e178410582fb88f6bdbdc798, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:31.708284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f1911-5ae8-487a-9ac8-db2efeeb4d69 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:31.712055 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8ef31-964e-4d0b-aa57-1e76af597679 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:31.721000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb146929-556c-440b-90e8-c423fdf626e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:31.721962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb146929-556c-440b-90e8-c423fdf626e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:31.722400 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb146929-556c-440b-90e8-c423fdf626e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:31.722682 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb146929-556c-440b-90e8-c423fdf626e2 admin admin] PATH_INFO: `/v3/users/3e6b5e67bd574513a2555a14ff966115` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:31.724064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb146929-556c-440b-90e8-c423fdf626e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e6b5e67bd574513a2555a14ff966115)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:31.726496 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb146929-556c-440b-90e8-c423fdf626e2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:31.745124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 909/1802] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:31 2022] PUT /identity/v3/projects/6353cf2ff3c0475f9c9bd67b91c55306/users/5b9f5302e178410582fb88f6bdbdc798/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:31.757735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a50b9-705d-4b81-a0b0-635c8e2e53f3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:31.758293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a50b9-705d-4b81-a0b0-635c8e2e53f3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:31.758512 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a50b9-705d-4b81-a0b0-635c8e2e53f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:31.801429 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-481a50b9-705d-4b81-a0b0-635c8e2e53f3 None None] MFA Rules not processed for user `5b9f5302e178410582fb88f6bdbdc798`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:31.802615 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-481a50b9-705d-4b81-a0b0-635c8e2e53f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:31.897519 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 910/1803] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:50:31.906089 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a50b9-705d-4b81-a0b0-635c8e2e53f3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:31.913517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-481a50b9-705d-4b81-a0b0-635c8e2e53f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:31.961872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fb146929-556c-440b-90e8-c423fdf626e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e6b5e67bd574513a2555a14ff966115'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:31.973329 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fb146929-556c-440b-90e8-c423fdf626e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e6b5e67bd574513a2555a14ff966115'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:31.976366 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a50b9-705d-4b81-a0b0-635c8e2e53f3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:31.980407 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf20ee-2706-445d-b2d1-28515911ae54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:31.981134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf20ee-2706-445d-b2d1-28515911ae54 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:31.981409 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf20ee-2706-445d-b2d1-28515911ae54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:31.981697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf20ee-2706-445d-b2d1-28515911ae54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:31.990645 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf20ee-2706-445d-b2d1-28515911ae54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:31.992092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf20ee-2706-445d-b2d1-28515911ae54 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:32.001870 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 911/1804] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:32.048381 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fb146929-556c-440b-90e8-c423fdf626e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e6b5e67bd574513a2555a14ff966115'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:32.055400 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fb146929-556c-440b-90e8-c423fdf626e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e6b5e67bd574513a2555a14ff966115'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:32.056022 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fb146929-556c-440b-90e8-c423fdf626e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e6b5e67bd574513a2555a14ff966115'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:32.062563 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 894/1805] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:50:31 2022] DELETE /identity/v3/users/3e6b5e67bd574513a2555a14ff966115 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:32.067212 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010375c-e386-41aa-b887-938ffdb520bc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:32.067497 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010375c-e386-41aa-b887-938ffdb520bc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:32.067769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010375c-e386-41aa-b887-938ffdb520bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:32.086276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4010375c-e386-41aa-b887-938ffdb520bc None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:32.087461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4010375c-e386-41aa-b887-938ffdb520bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:32.153878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 912/1806] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:32.163742 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb146929-556c-440b-90e8-c423fdf626e2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:32.168756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fb146929-556c-440b-90e8-c423fdf626e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:32.232712 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb146929-556c-440b-90e8-c423fdf626e2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:32.232879 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010375c-e386-41aa-b887-938ffdb520bc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:32.234341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4010375c-e386-41aa-b887-938ffdb520bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:32.237213 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77420f59-f524-4b9b-979c-92400f6a40da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:32.238075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77420f59-f524-4b9b-979c-92400f6a40da service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:32.238509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77420f59-f524-4b9b-979c-92400f6a40da service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:32.238956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77420f59-f524-4b9b-979c-92400f6a40da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:32.249501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77420f59-f524-4b9b-979c-92400f6a40da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:32.250931 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77420f59-f524-4b9b-979c-92400f6a40da service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:32.262214 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 895/1807] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:32.293698 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010375c-e386-41aa-b887-938ffdb520bc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:32.297968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334dd94-a691-468d-af47-f10186baccc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:32.298837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334dd94-a691-468d-af47-f10186baccc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:32.299060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334dd94-a691-468d-af47-f10186baccc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:32.299454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334dd94-a691-468d-af47-f10186baccc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:32.301624 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8334dd94-a691-468d-af47-f10186baccc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:32.360786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334dd94-a691-468d-af47-f10186baccc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:32.362223 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334dd94-a691-468d-af47-f10186baccc4 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:32.371007 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 913/1808] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:50:32.640209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77420f59-f524-4b9b-979c-92400f6a40da service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:32.641971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-77420f59-f524-4b9b-979c-92400f6a40da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:32.659904 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77420f59-f524-4b9b-979c-92400f6a40da service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:32.665225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bece02-02a2-4f1f-9114-a1d171311537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:32.666135 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bece02-02a2-4f1f-9114-a1d171311537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:32.666503 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bece02-02a2-4f1f-9114-a1d171311537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:32.666847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bece02-02a2-4f1f-9114-a1d171311537 admin admin] PATH_INFO: `/v3/projects/57c6ef6db48549ce8e5acbcc5e434262` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:32.668227 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bece02-02a2-4f1f-9114-a1d171311537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c6ef6db48549ce8e5acbcc5e434262)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:32.670154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bece02-02a2-4f1f-9114-a1d171311537 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:32.781375 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-57bece02-02a2-4f1f-9114-a1d171311537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c6ef6db48549ce8e5acbcc5e434262', 'request_id': 'req-57bece02-02a2-4f1f-9114-a1d171311537'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:32.787136 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-57bece02-02a2-4f1f-9114-a1d171311537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c6ef6db48549ce8e5acbcc5e434262', 'request_id': 'req-57bece02-02a2-4f1f-9114-a1d171311537'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:32.856452 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-57bece02-02a2-4f1f-9114-a1d171311537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c6ef6db48549ce8e5acbcc5e434262', 'request_id': 'req-57bece02-02a2-4f1f-9114-a1d171311537'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:32.868887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-57bece02-02a2-4f1f-9114-a1d171311537 admin admin] The token cache is being invalidate because project 57c6ef6db48549ce8e5acbcc5e434262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:32.869125 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-57bece02-02a2-4f1f-9114-a1d171311537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:32.870427 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-57bece02-02a2-4f1f-9114-a1d171311537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:32.872125 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 896/1809] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:32 2022] DELETE /identity/v3/projects/57c6ef6db48549ce8e5acbcc5e434262 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:50:32.876222 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334dd94-a691-468d-af47-f10186baccc4 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:32.887407 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334dd94-a691-468d-af47-f10186baccc4 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:32.950815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79f075-24e6-4136-a96a-0e2f99af85d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:32.951716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79f075-24e6-4136-a96a-0e2f99af85d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:32.951993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79f075-24e6-4136-a96a-0e2f99af85d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:32.952264 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79f075-24e6-4136-a96a-0e2f99af85d8 admin admin] PATH_INFO: `/v3/users/2a0219dc947640bfa339423e97c138da` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:32.953505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79f075-24e6-4136-a96a-0e2f99af85d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a0219dc947640bfa339423e97c138da)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:32.956308 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79f075-24e6-4136-a96a-0e2f99af85d8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:33.171071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7a79f075-24e6-4136-a96a-0e2f99af85d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a0219dc947640bfa339423e97c138da'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:33.256012 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7a79f075-24e6-4136-a96a-0e2f99af85d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a0219dc947640bfa339423e97c138da'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:33.256708 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7a79f075-24e6-4136-a96a-0e2f99af85d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a0219dc947640bfa339423e97c138da'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:33.264891 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7a79f075-24e6-4136-a96a-0e2f99af85d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a0219dc947640bfa339423e97c138da'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:33.277350 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7a79f075-24e6-4136-a96a-0e2f99af85d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a0219dc947640bfa339423e97c138da'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:33.284259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 914/1810] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:50:32 2022] DELETE /identity/v3/users/2a0219dc947640bfa339423e97c138da => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:33.914416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bece02-02a2-4f1f-9114-a1d171311537 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:33.916118 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-57bece02-02a2-4f1f-9114-a1d171311537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:33.946732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bece02-02a2-4f1f-9114-a1d171311537 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:34.051215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2fb60-2974-4e92-be5e-d5226d0aafcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:34.052110 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2fb60-2974-4e92-be5e-d5226d0aafcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:34.052759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2fb60-2974-4e92-be5e-d5226d0aafcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:34.052925 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2fb60-2974-4e92-be5e-d5226d0aafcb admin admin] PATH_INFO: `/v3/projects/007c549413c84a9ab8cfec621bab695b` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:34.056735 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2fb60-2974-4e92-be5e-d5226d0aafcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=007c549413c84a9ab8cfec621bab695b)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:34.061815 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2fb60-2974-4e92-be5e-d5226d0aafcb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:34.237811 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-69f2fb60-2974-4e92-be5e-d5226d0aafcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '007c549413c84a9ab8cfec621bab695b', 'request_id': 'req-69f2fb60-2974-4e92-be5e-d5226d0aafcb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:34.252809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-69f2fb60-2974-4e92-be5e-d5226d0aafcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '007c549413c84a9ab8cfec621bab695b', 'request_id': 'req-69f2fb60-2974-4e92-be5e-d5226d0aafcb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:34.342196 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-69f2fb60-2974-4e92-be5e-d5226d0aafcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '007c549413c84a9ab8cfec621bab695b', 'request_id': 'req-69f2fb60-2974-4e92-be5e-d5226d0aafcb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:34.359018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-69f2fb60-2974-4e92-be5e-d5226d0aafcb admin admin] The token cache is being invalidate because project 007c549413c84a9ab8cfec621bab695b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:34.359320 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-69f2fb60-2974-4e92-be5e-d5226d0aafcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:34.360039 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-69f2fb60-2974-4e92-be5e-d5226d0aafcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:34.362025 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 897/1811] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:33 2022] DELETE /identity/v3/projects/007c549413c84a9ab8cfec621bab695b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:34.368624 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e6a85-70e1-415a-8a33-9cb62f76941a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:34.369155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e6a85-70e1-415a-8a33-9cb62f76941a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:34.369228 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e6a85-70e1-415a-8a33-9cb62f76941a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:34.399163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-bf0e6a85-70e1-415a-8a33-9cb62f76941a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:34.402152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bf0e6a85-70e1-415a-8a33-9cb62f76941a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:34.516101 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 915/1812] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:34.523948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550a328-efbe-4b36-97ec-6f3ec9225c68 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:34.524320 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550a328-efbe-4b36-97ec-6f3ec9225c68 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:34.524698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550a328-efbe-4b36-97ec-6f3ec9225c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:34.554618 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7550a328-efbe-4b36-97ec-6f3ec9225c68 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:34.556354 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7550a328-efbe-4b36-97ec-6f3ec9225c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:34.573069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 898/1813] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:34.578152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e6a85-70e1-415a-8a33-9cb62f76941a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:34.590588 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e6a85-70e1-415a-8a33-9cb62f76941a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:34.595368 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c1ccd-2f10-48be-bf6a-e23f4bb7851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:34.596030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c1ccd-2f10-48be-bf6a-e23f4bb7851a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:34.596310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c1ccd-2f10-48be-bf6a-e23f4bb7851a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:34.596623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c1ccd-2f10-48be-bf6a-e23f4bb7851a admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:34.597365 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c1ccd-2f10-48be-bf6a-e23f4bb7851a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:50:34.597671 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c1ccd-2f10-48be-bf6a-e23f4bb7851a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:34.599263 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c1ccd-2f10-48be-bf6a-e23f4bb7851a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:34.611774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 916/1814] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:50:34.616197 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550a328-efbe-4b36-97ec-6f3ec9225c68 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:34.626112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550a328-efbe-4b36-97ec-6f3ec9225c68 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:34.650602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6359e-a1fa-45ca-8918-edc339ad61f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:34.651821 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6359e-a1fa-45ca-8918-edc339ad61f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:34.652173 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6359e-a1fa-45ca-8918-edc339ad61f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:34.652939 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6359e-a1fa-45ca-8918-edc339ad61f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:34.653264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6359e-a1fa-45ca-8918-edc339ad61f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:34.658825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6359e-a1fa-45ca-8918-edc339ad61f6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:34.824385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 899/1815] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:34 2022] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:50:34.826344 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c1ccd-2f10-48be-bf6a-e23f4bb7851a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:34.838151 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c1ccd-2f10-48be-bf6a-e23f4bb7851a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:34.939210 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91757d44-fb74-450f-a8d0-624469f81af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:34.940517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91757d44-fb74-450f-a8d0-624469f81af7 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:34.940948 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91757d44-fb74-450f-a8d0-624469f81af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:34.941368 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91757d44-fb74-450f-a8d0-624469f81af7 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:34.942227 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91757d44-fb74-450f-a8d0-624469f81af7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:34.944839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91757d44-fb74-450f-a8d0-624469f81af7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:35.079585 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 917/1816] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:34 2022] POST /identity/v3/users => generated 284 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:35.083741 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6359e-a1fa-45ca-8918-edc339ad61f6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:35.109121 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6359e-a1fa-45ca-8918-edc339ad61f6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:35.120528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6bfdf-2046-44ba-9f37-33a802be81f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:35.121262 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6bfdf-2046-44ba-9f37-33a802be81f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:35.121550 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6bfdf-2046-44ba-9f37-33a802be81f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:35.121829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6bfdf-2046-44ba-9f37-33a802be81f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:35.122607 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6bfdf-2046-44ba-9f37-33a802be81f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:35.124225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6bfdf-2046-44ba-9f37-33a802be81f9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:35.144394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91757d44-fb74-450f-a8d0-624469f81af7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:35.156253 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 900/1817] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:35.158175 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91757d44-fb74-450f-a8d0-624469f81af7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:35.164244 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba769f4f-31a3-498e-b316-8e1d5cb1aa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:35.165160 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba769f4f-31a3-498e-b316-8e1d5cb1aa4b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:35.165552 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba769f4f-31a3-498e-b316-8e1d5cb1aa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:35.165927 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba769f4f-31a3-498e-b316-8e1d5cb1aa4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:35.167392 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba769f4f-31a3-498e-b316-8e1d5cb1aa4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:35.169182 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba769f4f-31a3-498e-b316-8e1d5cb1aa4b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:35.187356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6bfdf-2046-44ba-9f37-33a802be81f9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:35.194493 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 918/1818] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:35.200467 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6bfdf-2046-44ba-9f37-33a802be81f9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:35.207058 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c166778-370f-4fa5-baf0-daf0434eb50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:35.208487 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c166778-370f-4fa5-baf0-daf0434eb50f admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:35.208983 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c166778-370f-4fa5-baf0-daf0434eb50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:35.209487 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c166778-370f-4fa5-baf0-daf0434eb50f admin admin] PATH_INFO: `/v3/projects/27841350e16e45c9b2216cd2f0a8b011/users/b7ce3177c80249eb9bc7920c64daa828/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:35.229392 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c166778-370f-4fa5-baf0-daf0434eb50f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27841350e16e45c9b2216cd2f0a8b011, user_id=b7ce3177c80249eb9bc7920c64daa828, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:35.232678 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c166778-370f-4fa5-baf0-daf0434eb50f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:35.332129 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 901/1819] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:35 2022] PUT /identity/v3/projects/27841350e16e45c9b2216cd2f0a8b011/users/b7ce3177c80249eb9bc7920c64daa828/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:35.347205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b27eea-313f-4ebf-88a8-c1b06bb542ae None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:35.347502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b27eea-313f-4ebf-88a8-c1b06bb542ae None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:35.347778 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b27eea-313f-4ebf-88a8-c1b06bb542ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:35.401270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-10b27eea-313f-4ebf-88a8-c1b06bb542ae None None] MFA Rules not processed for user `b7ce3177c80249eb9bc7920c64daa828`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:35.403280 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-10b27eea-313f-4ebf-88a8-c1b06bb542ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:35.574430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 919/1820] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:35.580430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c166778-370f-4fa5-baf0-daf0434eb50f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:35.706864 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c166778-370f-4fa5-baf0-daf0434eb50f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:35.717792 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dd769-8ef4-41dd-82a9-85904aae266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:35.717792 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dd769-8ef4-41dd-82a9-85904aae266b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:35.717792 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dd769-8ef4-41dd-82a9-85904aae266b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:35.717792 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dd769-8ef4-41dd-82a9-85904aae266b admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:35.719401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dd769-8ef4-41dd-82a9-85904aae266b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:35.722299 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dd769-8ef4-41dd-82a9-85904aae266b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:35.865693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 902/1821] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:35 2022] POST /identity/v3/projects => generated 367 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:35.870199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b27eea-313f-4ebf-88a8-c1b06bb542ae None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:35.890277 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b27eea-313f-4ebf-88a8-c1b06bb542ae None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:35.996372 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0b617-9a24-4381-9698-48d6cc546604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:35.997735 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8f891-64cb-4b41-9ab5-f542af88bb7a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:35.998216 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8f891-64cb-4b41-9ab5-f542af88bb7a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:35.998319 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0b617-9a24-4381-9698-48d6cc546604 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:35.998661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0b617-9a24-4381-9698-48d6cc546604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:35.998969 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8f891-64cb-4b41-9ab5-f542af88bb7a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:35.999082 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0b617-9a24-4381-9698-48d6cc546604 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:35.999959 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0b617-9a24-4381-9698-48d6cc546604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:36.000874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 903/1822] 10.222.0.81 () {54 vars in 921 bytes} [Wed May 4 17:50:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:50:36.002796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0b617-9a24-4381-9698-48d6cc546604 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:36.017250 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79ca86-2655-480c-b5ec-2f0f650a7a38 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:36.017782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79ca86-2655-480c-b5ec-2f0f650a7a38 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:36.018224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79ca86-2655-480c-b5ec-2f0f650a7a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:36.061422 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3c79ca86-2655-480c-b5ec-2f0f650a7a38 None None] MFA Rules not processed for user `d4a073d8f47a485cbb22db01530f3b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:36.063659 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3c79ca86-2655-480c-b5ec-2f0f650a7a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:36.121366 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 920/1823] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:35 2022] POST /identity/v3/users => generated 290 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:36.125244 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0b617-9a24-4381-9698-48d6cc546604 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:36.152749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0b617-9a24-4381-9698-48d6cc546604 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:36.165330 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6987a8b-286f-4492-b9ac-27f019c746c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:36.166027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6987a8b-286f-4492-b9ac-27f019c746c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:36.166689 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6987a8b-286f-4492-b9ac-27f019c746c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:36.166944 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6987a8b-286f-4492-b9ac-27f019c746c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:36.167746 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6987a8b-286f-4492-b9ac-27f019c746c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:36.169390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6987a8b-286f-4492-b9ac-27f019c746c7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:36.205938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 921/1824] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:36.213209 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6987a8b-286f-4492-b9ac-27f019c746c7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:36.235771 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6987a8b-286f-4492-b9ac-27f019c746c7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:36.251655 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1d526-3f66-4552-aff6-24cb13cb88d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:36.254744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1d526-3f66-4552-aff6-24cb13cb88d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:36.254744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1d526-3f66-4552-aff6-24cb13cb88d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:36.254744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1d526-3f66-4552-aff6-24cb13cb88d9 admin admin] PATH_INFO: `/v3/projects/b7c16c8cd7684f3785f594d05c854e7a/users/cef9c4fb5e4a46ec86792a2a2545fa2f/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:36.273057 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 904/1825] 10.222.0.81 () {58 vars in 1018 bytes} [Wed May 4 17:50:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:50:36.281842 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1d526-3f66-4552-aff6-24cb13cb88d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c16c8cd7684f3785f594d05c854e7a, user_id=cef9c4fb5e4a46ec86792a2a2545fa2f, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:36.285606 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1d526-3f66-4552-aff6-24cb13cb88d9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:36.371215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a3d2f-3059-4fca-ad99-fbffeb619d4f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:36.371901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a3d2f-3059-4fca-ad99-fbffeb619d4f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:36.372899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a3d2f-3059-4fca-ad99-fbffeb619d4f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:36.375296 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 905/1826] 10.222.0.81 () {54 vars in 921 bytes} [Wed May 4 17:50:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:50:36.392693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab224156-54b5-40c2-a7c3-952b9b1292c2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:36.393193 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab224156-54b5-40c2-a7c3-952b9b1292c2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:36.393633 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab224156-54b5-40c2-a7c3-952b9b1292c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:36.419414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ab224156-54b5-40c2-a7c3-952b9b1292c2 None None] MFA Rules not processed for user `d4a073d8f47a485cbb22db01530f3b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:36.422320 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ab224156-54b5-40c2-a7c3-952b9b1292c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:36.442027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 922/1827] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:36 2022] PUT /identity/v3/projects/b7c16c8cd7684f3785f594d05c854e7a/users/cef9c4fb5e4a46ec86792a2a2545fa2f/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:50:36.447573 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1d526-3f66-4552-aff6-24cb13cb88d9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:36.473905 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 906/1828] 10.222.0.81 () {58 vars in 1018 bytes} [Wed May 4 17:50:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:50:36.493036 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab224156-54b5-40c2-a7c3-952b9b1292c2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:36.496050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ab224156-54b5-40c2-a7c3-952b9b1292c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:36.539612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab224156-54b5-40c2-a7c3-952b9b1292c2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:36.599203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1d526-3f66-4552-aff6-24cb13cb88d9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:36.614348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd7ab5-0ae3-4c73-844f-ef1f93e7d359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:36.626487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7ab5-0ae3-4c73-844f-ef1f93e7d359 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:36.637171 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7ab5-0ae3-4c73-844f-ef1f93e7d359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:36.637735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7ab5-0ae3-4c73-844f-ef1f93e7d359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:36.639712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd7ab5-0ae3-4c73-844f-ef1f93e7d359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:36.645494 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd7ab5-0ae3-4c73-844f-ef1f93e7d359 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:36.675221 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 923/1829] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:36.681221 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd7ab5-0ae3-4c73-844f-ef1f93e7d359 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:36.699298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833062a-5080-454d-ac04-886b2bf014d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:36.700264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833062a-5080-454d-ac04-886b2bf014d0 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:36.705626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833062a-5080-454d-ac04-886b2bf014d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:36.705626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833062a-5080-454d-ac04-886b2bf014d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:36.705816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd7ab5-0ae3-4c73-844f-ef1f93e7d359 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:36.710478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a32d7-aeb1-4f75-8be0-69e97c14f669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:36.711398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a32d7-aeb1-4f75-8be0-69e97c14f669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:36.711660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833062a-5080-454d-ac04-886b2bf014d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:36.711762 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a32d7-aeb1-4f75-8be0-69e97c14f669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:36.712032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a32d7-aeb1-4f75-8be0-69e97c14f669 admin admin] PATH_INFO: `/v3/projects/b7c16c8cd7684f3785f594d05c854e7a/users/cef9c4fb5e4a46ec86792a2a2545fa2f/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:36.714413 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833062a-5080-454d-ac04-886b2bf014d0 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:36.715188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a32d7-aeb1-4f75-8be0-69e97c14f669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c16c8cd7684f3785f594d05c854e7a, user_id=cef9c4fb5e4a46ec86792a2a2545fa2f, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:36.718514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a32d7-aeb1-4f75-8be0-69e97c14f669 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:36.734564 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 907/1830] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:36.735039 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 924/1831] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:36 2022] PUT /identity/v3/projects/b7c16c8cd7684f3785f594d05c854e7a/users/cef9c4fb5e4a46ec86792a2a2545fa2f/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:36.746729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612ead-d183-4d39-bca5-32f5279ebc80 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:36.747270 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612ead-d183-4d39-bca5-32f5279ebc80 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:36.747624 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612ead-d183-4d39-bca5-32f5279ebc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:36.793625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f4612ead-d183-4d39-bca5-32f5279ebc80 None None] MFA Rules not processed for user `cef9c4fb5e4a46ec86792a2a2545fa2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:36.794855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f4612ead-d183-4d39-bca5-32f5279ebc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:36.837081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a32d7-aeb1-4f75-8be0-69e97c14f669 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:36.842678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-580a32d7-aeb1-4f75-8be0-69e97c14f669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:36.926099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 908/1832] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:36 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:50:36.955732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a32d7-aeb1-4f75-8be0-69e97c14f669 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:36.962887 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2ce79-ff85-4fe5-8e8d-9bf044611b20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:36.964423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2ce79-ff85-4fe5-8e8d-9bf044611b20 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:36.964744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2ce79-ff85-4fe5-8e8d-9bf044611b20 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:36.965050 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2ce79-ff85-4fe5-8e8d-9bf044611b20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:36.975732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2ce79-ff85-4fe5-8e8d-9bf044611b20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:36.977814 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2ce79-ff85-4fe5-8e8d-9bf044611b20 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:36.990241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 925/1833] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:50:37.001697 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4612ead-d183-4d39-bca5-32f5279ebc80 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:37.003327 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f4612ead-d183-4d39-bca5-32f5279ebc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:37.082316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4612ead-d183-4d39-bca5-32f5279ebc80 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:37.086084 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de825e47-483c-4926-9286-0a76781ea537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:37.086946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de825e47-483c-4926-9286-0a76781ea537 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:37.087295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de825e47-483c-4926-9286-0a76781ea537 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:37.087636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de825e47-483c-4926-9286-0a76781ea537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:37.099004 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de825e47-483c-4926-9286-0a76781ea537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:37.100710 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de825e47-483c-4926-9286-0a76781ea537 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:37.110849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 909/1834] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:40.059933 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2ce79-ff85-4fe5-8e8d-9bf044611b20 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:40.061860 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1df2ce79-ff85-4fe5-8e8d-9bf044611b20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:40.163777 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2ce79-ff85-4fe5-8e8d-9bf044611b20 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:40.168781 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43cb83-4402-4348-a9c0-6bcbd3c31b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:40.169785 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43cb83-4402-4348-a9c0-6bcbd3c31b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:40.170017 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43cb83-4402-4348-a9c0-6bcbd3c31b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:40.170305 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43cb83-4402-4348-a9c0-6bcbd3c31b84 admin admin] PATH_INFO: `/v3/users/d15f87b17a04411e858aa6709c2ae444` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:40.171759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43cb83-4402-4348-a9c0-6bcbd3c31b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d15f87b17a04411e858aa6709c2ae444)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:40.173771 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43cb83-4402-4348-a9c0-6bcbd3c31b84 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:40.392157 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5e43cb83-4402-4348-a9c0-6bcbd3c31b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd15f87b17a04411e858aa6709c2ae444'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:40.462394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5e43cb83-4402-4348-a9c0-6bcbd3c31b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd15f87b17a04411e858aa6709c2ae444'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:40.463641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5e43cb83-4402-4348-a9c0-6bcbd3c31b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd15f87b17a04411e858aa6709c2ae444'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:40.473129 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5e43cb83-4402-4348-a9c0-6bcbd3c31b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd15f87b17a04411e858aa6709c2ae444'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:40.486686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5e43cb83-4402-4348-a9c0-6bcbd3c31b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd15f87b17a04411e858aa6709c2ae444'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:40.494248 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 926/1835] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:50:40 2022] DELETE /identity/v3/users/d15f87b17a04411e858aa6709c2ae444 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:40.498688 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe21d2e-2c8e-4659-9b85-85547cdb7b0e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:40.502919 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe21d2e-2c8e-4659-9b85-85547cdb7b0e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:40.502919 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe21d2e-2c8e-4659-9b85-85547cdb7b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:40.518693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bbe21d2e-2c8e-4659-9b85-85547cdb7b0e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:40.520562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bbe21d2e-2c8e-4659-9b85-85547cdb7b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:40.598759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 910/1836] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:40.610376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43cb83-4402-4348-a9c0-6bcbd3c31b84 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:40.611784 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5e43cb83-4402-4348-a9c0-6bcbd3c31b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:40.676260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43cb83-4402-4348-a9c0-6bcbd3c31b84 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:40.680301 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162e417-a35c-437c-b659-47d07bb09de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:40.681001 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162e417-a35c-437c-b659-47d07bb09de6 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:40.681280 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162e417-a35c-437c-b659-47d07bb09de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:40.681592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162e417-a35c-437c-b659-47d07bb09de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:40.691294 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162e417-a35c-437c-b659-47d07bb09de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:40.692768 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162e417-a35c-437c-b659-47d07bb09de6 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:40.703362 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 927/1837] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:41.382097 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe21d2e-2c8e-4659-9b85-85547cdb7b0e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:41.383910 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bbe21d2e-2c8e-4659-9b85-85547cdb7b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:41.398105 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe21d2e-2c8e-4659-9b85-85547cdb7b0e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:41.403654 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:41.410345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:41.412169 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:41.412169 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd admin admin] PATH_INFO: `/v3/projects/d9072fb16ee0458c86d7b1f3f3bb2015` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:41.414285 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9072fb16ee0458c86d7b1f3f3bb2015)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:41.417593 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:41.697935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9072fb16ee0458c86d7b1f3f3bb2015', 'request_id': 'req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:41.722249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9072fb16ee0458c86d7b1f3f3bb2015', 'request_id': 'req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:41.931015 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9072fb16ee0458c86d7b1f3f3bb2015', 'request_id': 'req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:41.954834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd admin admin] The token cache is being invalidate because project d9072fb16ee0458c86d7b1f3f3bb2015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:41.954834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:41.954834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:41.954834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 911/1838] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:41 2022] DELETE /identity/v3/projects/d9072fb16ee0458c86d7b1f3f3bb2015 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:41.958693 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162e417-a35c-437c-b659-47d07bb09de6 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:41.980891 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162e417-a35c-437c-b659-47d07bb09de6 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:42.093708 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf265c-0346-45c0-b5a2-297138134521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:42.095731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf265c-0346-45c0-b5a2-297138134521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:42.096170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf265c-0346-45c0-b5a2-297138134521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:42.096492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf265c-0346-45c0-b5a2-297138134521 admin admin] PATH_INFO: `/v3/users/0831f54040874afebe4557efe9715630` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:42.097917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf265c-0346-45c0-b5a2-297138134521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0831f54040874afebe4557efe9715630)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:42.100952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf265c-0346-45c0-b5a2-297138134521 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:42.227092 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:42.228550 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:42.248408 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfcd6e-f9c6-402c-b830-abdcb8d104bd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:42.248408 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36513887-6b84-4387-85f1-7403e190c062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:42.249103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36513887-6b84-4387-85f1-7403e190c062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:42.249613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36513887-6b84-4387-85f1-7403e190c062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:42.250457 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36513887-6b84-4387-85f1-7403e190c062 admin admin] PATH_INFO: `/v3/users/1a043b41c72245baa3fbc8773779e829` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:42.251912 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36513887-6b84-4387-85f1-7403e190c062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a043b41c72245baa3fbc8773779e829)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:42.254179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36513887-6b84-4387-85f1-7403e190c062 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:42.377294 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6edf265c-0346-45c0-b5a2-297138134521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0831f54040874afebe4557efe9715630'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:42.491342 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6edf265c-0346-45c0-b5a2-297138134521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0831f54040874afebe4557efe9715630'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:42.492187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6edf265c-0346-45c0-b5a2-297138134521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0831f54040874afebe4557efe9715630'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:42.493170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-36513887-6b84-4387-85f1-7403e190c062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a043b41c72245baa3fbc8773779e829'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:42.503090 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6edf265c-0346-45c0-b5a2-297138134521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0831f54040874afebe4557efe9715630'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:42.514127 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-36513887-6b84-4387-85f1-7403e190c062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a043b41c72245baa3fbc8773779e829'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:42.518211 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6edf265c-0346-45c0-b5a2-297138134521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0831f54040874afebe4557efe9715630'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:42.524780 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 928/1839] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:50:41 2022] DELETE /identity/v3/users/0831f54040874afebe4557efe9715630 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:42.526459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf265c-0346-45c0-b5a2-297138134521 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:42.527872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6edf265c-0346-45c0-b5a2-297138134521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:42.586901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-36513887-6b84-4387-85f1-7403e190c062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a043b41c72245baa3fbc8773779e829'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:42.595566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-36513887-6b84-4387-85f1-7403e190c062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a043b41c72245baa3fbc8773779e829'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:42.596432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-36513887-6b84-4387-85f1-7403e190c062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a043b41c72245baa3fbc8773779e829'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:42.602581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 912/1840] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:50:42 2022] DELETE /identity/v3/users/1a043b41c72245baa3fbc8773779e829 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:42.605697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf265c-0346-45c0-b5a2-297138134521 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:42.607627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2a45a-09df-4180-ad05-903bebcb1cf9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:42.607919 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2a45a-09df-4180-ad05-903bebcb1cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:42.608195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2a45a-09df-4180-ad05-903bebcb1cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:42.626212 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-57c2a45a-09df-4180-ad05-903bebcb1cf9 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:42.627421 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-57c2a45a-09df-4180-ad05-903bebcb1cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:42.662857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e2015-1b7e-4791-a028-9ca1f9224e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:42.664006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e2015-1b7e-4791-a028-9ca1f9224e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:42.664503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e2015-1b7e-4791-a028-9ca1f9224e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:42.664780 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e2015-1b7e-4791-a028-9ca1f9224e8d admin admin] PATH_INFO: `/v3/users/b7ce3177c80249eb9bc7920c64daa828` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:42.665973 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e2015-1b7e-4791-a028-9ca1f9224e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ce3177c80249eb9bc7920c64daa828)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:42.668064 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e2015-1b7e-4791-a028-9ca1f9224e8d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:42.686801 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 913/1841] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:42.696472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2a45a-09df-4180-ad05-903bebcb1cf9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:42.698448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-57c2a45a-09df-4180-ad05-903bebcb1cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:42.759469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2a45a-09df-4180-ad05-903bebcb1cf9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:42.762982 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb735ce-ecec-438c-be9f-915a19fbc9c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:42.764233 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb735ce-ecec-438c-be9f-915a19fbc9c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:42.764863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb735ce-ecec-438c-be9f-915a19fbc9c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:42.765291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb735ce-ecec-438c-be9f-915a19fbc9c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:42.775394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb735ce-ecec-438c-be9f-915a19fbc9c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:42.777218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb735ce-ecec-438c-be9f-915a19fbc9c9 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:42.787257 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 914/1842] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:50:43.014588 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-852e2015-1b7e-4791-a028-9ca1f9224e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ce3177c80249eb9bc7920c64daa828'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:43.143149 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb735ce-ecec-438c-be9f-915a19fbc9c9 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:43.151343 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5cb735ce-ecec-438c-be9f-915a19fbc9c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:43.167876 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb735ce-ecec-438c-be9f-915a19fbc9c9 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:43.173653 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1f639-2cbd-4edd-945e-3acb91f21959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:43.174524 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1f639-2cbd-4edd-945e-3acb91f21959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:43.174809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1f639-2cbd-4edd-945e-3acb91f21959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:43.176985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1f639-2cbd-4edd-945e-3acb91f21959 admin admin] PATH_INFO: `/v3/projects/4197bfef7ac34835a647c0286bc7724d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:43.177529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1f639-2cbd-4edd-945e-3acb91f21959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4197bfef7ac34835a647c0286bc7724d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:43.179700 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-852e2015-1b7e-4791-a028-9ca1f9224e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ce3177c80249eb9bc7920c64daa828'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:43.179879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1f639-2cbd-4edd-945e-3acb91f21959 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:43.180491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-852e2015-1b7e-4791-a028-9ca1f9224e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ce3177c80249eb9bc7920c64daa828'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:43.197603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-852e2015-1b7e-4791-a028-9ca1f9224e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ce3177c80249eb9bc7920c64daa828'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:43.213958 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-852e2015-1b7e-4791-a028-9ca1f9224e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ce3177c80249eb9bc7920c64daa828'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:43.235687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 929/1843] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:50:42 2022] DELETE /identity/v3/users/b7ce3177c80249eb9bc7920c64daa828 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:43.237351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2330c2-0085-4471-816c-eda9fcd3e910 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:43.237718 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2330c2-0085-4471-816c-eda9fcd3e910 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:43.238215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2330c2-0085-4471-816c-eda9fcd3e910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:43.262130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-bb2330c2-0085-4471-816c-eda9fcd3e910 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:43.265915 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bb2330c2-0085-4471-816c-eda9fcd3e910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:43.320518 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d0e1f639-2cbd-4edd-945e-3acb91f21959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4197bfef7ac34835a647c0286bc7724d', 'request_id': 'req-d0e1f639-2cbd-4edd-945e-3acb91f21959'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:43.326528 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 930/1844] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:43.336106 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2330c2-0085-4471-816c-eda9fcd3e910 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:43.337638 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bb2330c2-0085-4471-816c-eda9fcd3e910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:43.340526 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d0e1f639-2cbd-4edd-945e-3acb91f21959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4197bfef7ac34835a647c0286bc7724d', 'request_id': 'req-d0e1f639-2cbd-4edd-945e-3acb91f21959'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:43.399455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d0e1f639-2cbd-4edd-945e-3acb91f21959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4197bfef7ac34835a647c0286bc7724d', 'request_id': 'req-d0e1f639-2cbd-4edd-945e-3acb91f21959'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:43.415673 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d0e1f639-2cbd-4edd-945e-3acb91f21959 admin admin] The token cache is being invalidate because project 4197bfef7ac34835a647c0286bc7724d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:43.416273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d0e1f639-2cbd-4edd-945e-3acb91f21959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:43.417511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2330c2-0085-4471-816c-eda9fcd3e910 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:43.417712 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d0e1f639-2cbd-4edd-945e-3acb91f21959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:43.420068 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 915/1845] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:43 2022] DELETE /identity/v3/projects/4197bfef7ac34835a647c0286bc7724d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:43.427230 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef9619-329a-4dca-b261-f3092dc36f1d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:43.427557 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef9619-329a-4dca-b261-f3092dc36f1d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:43.427989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef9619-329a-4dca-b261-f3092dc36f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:43.456348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1fef9619-329a-4dca-b261-f3092dc36f1d None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:43.457714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1fef9619-329a-4dca-b261-f3092dc36f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:43.473023 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1281e83-3ed2-47d9-ab12-b67393521346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:43.473679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1281e83-3ed2-47d9-ab12-b67393521346 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:43.473966 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1281e83-3ed2-47d9-ab12-b67393521346 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:43.474239 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1281e83-3ed2-47d9-ab12-b67393521346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:43.476095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f1281e83-3ed2-47d9-ab12-b67393521346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:43.595263 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 916/1846] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:43.596312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef9619-329a-4dca-b261-f3092dc36f1d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:43.597517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1281e83-3ed2-47d9-ab12-b67393521346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:43.599790 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1281e83-3ed2-47d9-ab12-b67393521346 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:43.607452 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1fef9619-329a-4dca-b261-f3092dc36f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:43.618741 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 931/1847] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:43.621522 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc19111-7cfd-4dc4-befa-f992ec3400df None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:43.622038 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc19111-7cfd-4dc4-befa-f992ec3400df None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:43.622900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc19111-7cfd-4dc4-befa-f992ec3400df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:43.634786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef9619-329a-4dca-b261-f3092dc36f1d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:43.645648 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04942949-6672-469a-998f-327ffc441ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:43.651377 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04942949-6672-469a-998f-327ffc441ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:43.651914 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04942949-6672-469a-998f-327ffc441ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:43.651914 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04942949-6672-469a-998f-327ffc441ab7 admin admin] PATH_INFO: `/v3/projects/e038fbcd56b34c35aa58cc41a5993043` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:43.655712 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04942949-6672-469a-998f-327ffc441ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e038fbcd56b34c35aa58cc41a5993043)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:43.658013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04942949-6672-469a-998f-327ffc441ab7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:43.671462 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3cc19111-7cfd-4dc4-befa-f992ec3400df None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:43.672842 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3cc19111-7cfd-4dc4-befa-f992ec3400df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:43.686093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 932/1848] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:43.690530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc19111-7cfd-4dc4-befa-f992ec3400df None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:43.711595 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc19111-7cfd-4dc4-befa-f992ec3400df None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:43.727522 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc7c85-0c4b-410b-be49-e1150bc52087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:43.728383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc7c85-0c4b-410b-be49-e1150bc52087 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:43.728792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc7c85-0c4b-410b-be49-e1150bc52087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:43.730331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc7c85-0c4b-410b-be49-e1150bc52087 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:43.731787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc7c85-0c4b-410b-be49-e1150bc52087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:50:43.731787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc7c85-0c4b-410b-be49-e1150bc52087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:43.733703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc7c85-0c4b-410b-be49-e1150bc52087 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:43.774087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 933/1849] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:50:43.778410 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc7c85-0c4b-410b-be49-e1150bc52087 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:43.814517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc7c85-0c4b-410b-be49-e1150bc52087 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:43.840733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-04942949-6672-469a-998f-327ffc441ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e038fbcd56b34c35aa58cc41a5993043', 'request_id': 'req-04942949-6672-469a-998f-327ffc441ab7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:43.868829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-04942949-6672-469a-998f-327ffc441ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e038fbcd56b34c35aa58cc41a5993043', 'request_id': 'req-04942949-6672-469a-998f-327ffc441ab7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:43.939865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e1e11-238d-4c07-83e5-4293922b3b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:43.940812 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e1e11-238d-4c07-83e5-4293922b3b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:43.941851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e1e11-238d-4c07-83e5-4293922b3b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:43.942577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e1e11-238d-4c07-83e5-4293922b3b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:43.943490 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e1e11-238d-4c07-83e5-4293922b3b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:43.945654 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e1e11-238d-4c07-83e5-4293922b3b07 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:44.035970 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-04942949-6672-469a-998f-327ffc441ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e038fbcd56b34c35aa58cc41a5993043', 'request_id': 'req-04942949-6672-469a-998f-327ffc441ab7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:44.053265 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-04942949-6672-469a-998f-327ffc441ab7 admin admin] The token cache is being invalidate because project e038fbcd56b34c35aa58cc41a5993043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:44.053953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-04942949-6672-469a-998f-327ffc441ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:44.054879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-04942949-6672-469a-998f-327ffc441ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:44.056872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 917/1850] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:43 2022] DELETE /identity/v3/projects/e038fbcd56b34c35aa58cc41a5993043 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:44.061232 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04942949-6672-469a-998f-327ffc441ab7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:44.064725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-04942949-6672-469a-998f-327ffc441ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:44.083812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04942949-6672-469a-998f-327ffc441ab7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:44.095415 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 934/1851] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:43 2022] POST /identity/v3/projects => generated 375 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:44.101564 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e1e11-238d-4c07-83e5-4293922b3b07 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:44.109670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-337e1e11-238d-4c07-83e5-4293922b3b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:44.249145 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bca75-6729-4eb8-8e82-843d03525a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:44.250126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bca75-6729-4eb8-8e82-843d03525a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:44.250414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bca75-6729-4eb8-8e82-843d03525a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:44.252831 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bca75-6729-4eb8-8e82-843d03525a0e admin admin] PATH_INFO: `/v3/users/5b9f5302e178410582fb88f6bdbdc798` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:44.255021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bca75-6729-4eb8-8e82-843d03525a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b9f5302e178410582fb88f6bdbdc798)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:44.258039 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bca75-6729-4eb8-8e82-843d03525a0e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:44.318068 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e1e11-238d-4c07-83e5-4293922b3b07 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:44.344236 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ea3c4-09f4-4460-a700-8478f7bf3f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:44.344962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ea3c4-09f4-4460-a700-8478f7bf3f5f admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:44.345245 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ea3c4-09f4-4460-a700-8478f7bf3f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:44.345515 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ea3c4-09f4-4460-a700-8478f7bf3f5f admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:44.346222 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ea3c4-09f4-4460-a700-8478f7bf3f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:44.348226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ea3c4-09f4-4460-a700-8478f7bf3f5f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:44.486665 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 935/1852] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:44 2022] POST /identity/v3/users => generated 288 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:44.489657 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ea3c4-09f4-4460-a700-8478f7bf3f5f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:44.511314 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0a8bca75-6729-4eb8-8e82-843d03525a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b9f5302e178410582fb88f6bdbdc798'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:44.521560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ea3c4-09f4-4460-a700-8478f7bf3f5f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:44.534637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0a8bca75-6729-4eb8-8e82-843d03525a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b9f5302e178410582fb88f6bdbdc798'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:44.535635 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e980b-3701-417a-a781-012053072f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:44.536357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e980b-3701-417a-a781-012053072f19 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:44.536674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e980b-3701-417a-a781-012053072f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:44.536945 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e980b-3701-417a-a781-012053072f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:44.537777 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e980b-3701-417a-a781-012053072f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:44.540483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e980b-3701-417a-a781-012053072f19 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:44.554114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 936/1853] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:44.555475 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e980b-3701-417a-a781-012053072f19 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:44.558020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ac2e980b-3701-417a-a781-012053072f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:44.584349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e980b-3701-417a-a781-012053072f19 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:44.592283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:44.593027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:44.593297 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:44.595784 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a admin admin] PATH_INFO: `/v3/projects/27841350e16e45c9b2216cd2f0a8b011` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:44.595784 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a admin admin] RBAC: Authorizing `identity:delete_project(project_id=27841350e16e45c9b2216cd2f0a8b011)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:44.598381 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:44.643570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0a8bca75-6729-4eb8-8e82-843d03525a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b9f5302e178410582fb88f6bdbdc798'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:44.653069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0a8bca75-6729-4eb8-8e82-843d03525a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b9f5302e178410582fb88f6bdbdc798'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:44.653851 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0a8bca75-6729-4eb8-8e82-843d03525a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b9f5302e178410582fb88f6bdbdc798'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:44.675612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 918/1854] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:50:44 2022] DELETE /identity/v3/users/5b9f5302e178410582fb88f6bdbdc798 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:50:44.676915 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bca75-6729-4eb8-8e82-843d03525a0e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:44.682132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0a8bca75-6729-4eb8-8e82-843d03525a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:44.769374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27841350e16e45c9b2216cd2f0a8b011', 'request_id': 'req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:44.777334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27841350e16e45c9b2216cd2f0a8b011', 'request_id': 'req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:44.787298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27841350e16e45c9b2216cd2f0a8b011', 'request_id': 'req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:44.797090 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bca75-6729-4eb8-8e82-843d03525a0e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:44.884258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73905b-367f-4b1b-97ff-62e8a6957de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:44.884258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73905b-367f-4b1b-97ff-62e8a6957de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:44.884258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73905b-367f-4b1b-97ff-62e8a6957de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:44.884258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73905b-367f-4b1b-97ff-62e8a6957de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:44.885150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73905b-367f-4b1b-97ff-62e8a6957de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:44.885150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73905b-367f-4b1b-97ff-62e8a6957de7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:44.894766 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 919/1855] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:44.899958 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73905b-367f-4b1b-97ff-62e8a6957de7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:44.912230 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73905b-367f-4b1b-97ff-62e8a6957de7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:44.920664 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729ca1d-3d89-48e6-81e0-f0f0be141d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:44.921624 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729ca1d-3d89-48e6-81e0-f0f0be141d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:44.921891 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729ca1d-3d89-48e6-81e0-f0f0be141d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:44.922167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729ca1d-3d89-48e6-81e0-f0f0be141d32 admin admin] PATH_INFO: `/v3/projects/62767f263b8a47aea19cf419115deeff/users/57b9a208a17641919153ba9b95a49b58/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:44.941085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729ca1d-3d89-48e6-81e0-f0f0be141d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62767f263b8a47aea19cf419115deeff, user_id=57b9a208a17641919153ba9b95a49b58, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:44.943851 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729ca1d-3d89-48e6-81e0-f0f0be141d32 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:44.998293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a admin admin] The token cache is being invalidate because project 27841350e16e45c9b2216cd2f0a8b011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:44.998633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:44.999357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:45.001716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 937/1856] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:44 2022] DELETE /identity/v3/projects/27841350e16e45c9b2216cd2f0a8b011 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:45.005548 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:45.006905 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:45.034065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585ef1a-4bd3-4b36-b3cb-15dce7d7187a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:45.039309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efbf75-3031-480e-a890-e16faf97aacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:45.040252 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efbf75-3031-480e-a890-e16faf97aacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:45.040631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efbf75-3031-480e-a890-e16faf97aacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:45.040965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efbf75-3031-480e-a890-e16faf97aacb admin admin] PATH_INFO: `/v3/users/cef9c4fb5e4a46ec86792a2a2545fa2f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:45.046392 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efbf75-3031-480e-a890-e16faf97aacb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef9c4fb5e4a46ec86792a2a2545fa2f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:45.046392 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efbf75-3031-480e-a890-e16faf97aacb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:45.074816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 920/1857] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:44 2022] PUT /identity/v3/projects/62767f263b8a47aea19cf419115deeff/users/57b9a208a17641919153ba9b95a49b58/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:50:45.084528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3bc17-76ea-4802-a0ac-20d1c8e5c661 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:45.084847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3bc17-76ea-4802-a0ac-20d1c8e5c661 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:45.085131 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3bc17-76ea-4802-a0ac-20d1c8e5c661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:45.154978 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0af3bc17-76ea-4802-a0ac-20d1c8e5c661 None None] MFA Rules not processed for user `57b9a208a17641919153ba9b95a49b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:45.154978 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0af3bc17-76ea-4802-a0ac-20d1c8e5c661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:45.230768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 921/1858] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:45.235414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3bc17-76ea-4802-a0ac-20d1c8e5c661 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:45.236875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0af3bc17-76ea-4802-a0ac-20d1c8e5c661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:45.266245 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e2efbf75-3031-480e-a890-e16faf97aacb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef9c4fb5e4a46ec86792a2a2545fa2f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:45.305179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3bc17-76ea-4802-a0ac-20d1c8e5c661 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:45.309850 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acabe0e-bf25-43fa-8db5-d95a92e72547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:45.310506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acabe0e-bf25-43fa-8db5-d95a92e72547 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:45.310793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acabe0e-bf25-43fa-8db5-d95a92e72547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:45.311072 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acabe0e-bf25-43fa-8db5-d95a92e72547 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:45.311761 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acabe0e-bf25-43fa-8db5-d95a92e72547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:45.313725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acabe0e-bf25-43fa-8db5-d95a92e72547 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:45.357943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e2efbf75-3031-480e-a890-e16faf97aacb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef9c4fb5e4a46ec86792a2a2545fa2f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:45.358726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e2efbf75-3031-480e-a890-e16faf97aacb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef9c4fb5e4a46ec86792a2a2545fa2f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:45.372827 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e2efbf75-3031-480e-a890-e16faf97aacb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef9c4fb5e4a46ec86792a2a2545fa2f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:45.391023 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e2efbf75-3031-480e-a890-e16faf97aacb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef9c4fb5e4a46ec86792a2a2545fa2f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:45.398000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 938/1859] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:50:45 2022] DELETE /identity/v3/users/cef9c4fb5e4a46ec86792a2a2545fa2f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:45.402443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efbf75-3031-480e-a890-e16faf97aacb admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:45.402443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e2efbf75-3031-480e-a890-e16faf97aacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:45.465930 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 922/1860] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:45 2022] POST /identity/v3/projects => generated 373 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:50:45.467597 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acabe0e-bf25-43fa-8db5-d95a92e72547 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:45.469393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0acabe0e-bf25-43fa-8db5-d95a92e72547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:45.486160 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efbf75-3031-480e-a890-e16faf97aacb admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:45.560175 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d478879-a858-430d-a75e-f74797d3c01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:45.561359 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d478879-a858-430d-a75e-f74797d3c01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:45.561865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d478879-a858-430d-a75e-f74797d3c01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:45.562354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d478879-a858-430d-a75e-f74797d3c01a admin admin] PATH_INFO: `/v3/projects/6353cf2ff3c0475f9c9bd67b91c55306` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:45.564202 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d478879-a858-430d-a75e-f74797d3c01a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6353cf2ff3c0475f9c9bd67b91c55306)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:45.566507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d478879-a858-430d-a75e-f74797d3c01a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:45.605376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acabe0e-bf25-43fa-8db5-d95a92e72547 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:45.609655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8331042-192b-499f-9ce7-69443e667ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:45.610338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8331042-192b-499f-9ce7-69443e667ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:45.610623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8331042-192b-499f-9ce7-69443e667ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:45.610901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8331042-192b-499f-9ce7-69443e667ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:45.611601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8331042-192b-499f-9ce7-69443e667ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:45.613567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8331042-192b-499f-9ce7-69443e667ec6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:45.714862 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1d478879-a858-430d-a75e-f74797d3c01a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6353cf2ff3c0475f9c9bd67b91c55306', 'request_id': 'req-1d478879-a858-430d-a75e-f74797d3c01a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:45.720640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1d478879-a858-430d-a75e-f74797d3c01a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6353cf2ff3c0475f9c9bd67b91c55306', 'request_id': 'req-1d478879-a858-430d-a75e-f74797d3c01a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:45.726881 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1d478879-a858-430d-a75e-f74797d3c01a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6353cf2ff3c0475f9c9bd67b91c55306', 'request_id': 'req-1d478879-a858-430d-a75e-f74797d3c01a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:45.736372 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 923/1861] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:45 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:50:45.740391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8331042-192b-499f-9ce7-69443e667ec6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:45.751306 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8331042-192b-499f-9ce7-69443e667ec6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:45.811498 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1d478879-a858-430d-a75e-f74797d3c01a admin admin] The token cache is being invalidate because project 6353cf2ff3c0475f9c9bd67b91c55306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:45.812115 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1d478879-a858-430d-a75e-f74797d3c01a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:45.813340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1d478879-a858-430d-a75e-f74797d3c01a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:45.815468 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 939/1862] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:45 2022] DELETE /identity/v3/projects/6353cf2ff3c0475f9c9bd67b91c55306 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:45.819101 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9f51d-1601-41a1-be81-c570957781e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:45.819101 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9f51d-1601-41a1-be81-c570957781e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:45.819101 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9f51d-1601-41a1-be81-c570957781e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:45.819434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9f51d-1601-41a1-be81-c570957781e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:45.819918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9f51d-1601-41a1-be81-c570957781e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:45.821548 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9f51d-1601-41a1-be81-c570957781e9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:45.821813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e34a78-bb1f-4642-ad16-178065e755d9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:45.822296 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e34a78-bb1f-4642-ad16-178065e755d9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:45.822849 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e34a78-bb1f-4642-ad16-178065e755d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:45.831816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 924/1863] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:45.836190 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9f51d-1601-41a1-be81-c570957781e9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:45.838968 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0cf9f51d-1601-41a1-be81-c570957781e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:45.844255 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-39e34a78-bb1f-4642-ad16-178065e755d9 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:45.846053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-39e34a78-bb1f-4642-ad16-178065e755d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:45.852912 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9f51d-1601-41a1-be81-c570957781e9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:45.857126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7b6af-b4fe-454b-b37e-047cc4db2262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:45.858155 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7b6af-b4fe-454b-b37e-047cc4db2262 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:45.858446 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7b6af-b4fe-454b-b37e-047cc4db2262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:45.858723 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7b6af-b4fe-454b-b37e-047cc4db2262 admin admin] PATH_INFO: `/v3/projects/c3d2f1e9a26243aeb77bfa6a6dd9cc04/users/8b55c37421f748b2a537a113b2cd1270/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:45.863799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 940/1864] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:45.865577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d37b5a-4c29-4363-aba3-c1b42daee17b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:45.865577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d37b5a-4c29-4363-aba3-c1b42daee17b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:45.865891 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d37b5a-4c29-4363-aba3-c1b42daee17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:45.882770 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7b6af-b4fe-454b-b37e-047cc4db2262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d2f1e9a26243aeb77bfa6a6dd9cc04, user_id=8b55c37421f748b2a537a113b2cd1270, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:45.887117 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7b6af-b4fe-454b-b37e-047cc4db2262 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:45.891814 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-07d37b5a-4c29-4363-aba3-c1b42daee17b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:45.893107 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-07d37b5a-4c29-4363-aba3-c1b42daee17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:45.902390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 941/1865] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:45.903240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d37b5a-4c29-4363-aba3-c1b42daee17b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:45.907439 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-07d37b5a-4c29-4363-aba3-c1b42daee17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:45.919201 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d37b5a-4c29-4363-aba3-c1b42daee17b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:45.924282 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122ec97-d1e3-4a2a-aa91-567eb0010930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:45.925256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122ec97-d1e3-4a2a-aa91-567eb0010930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:45.925674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122ec97-d1e3-4a2a-aa91-567eb0010930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:45.925958 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122ec97-d1e3-4a2a-aa91-567eb0010930 admin admin] PATH_INFO: `/v3/projects/b7c16c8cd7684f3785f594d05c854e7a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:45.927229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122ec97-d1e3-4a2a-aa91-567eb0010930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c16c8cd7684f3785f594d05c854e7a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:45.930277 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122ec97-d1e3-4a2a-aa91-567eb0010930 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:45.995972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 925/1866] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:45 2022] PUT /identity/v3/projects/c3d2f1e9a26243aeb77bfa6a6dd9cc04/users/8b55c37421f748b2a537a113b2cd1270/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:50:45.997043 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7b6af-b4fe-454b-b37e-047cc4db2262 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:46.063568 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7b6af-b4fe-454b-b37e-047cc4db2262 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:46.068397 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d8e44-29eb-4533-bfbc-991a9e886267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:46.069555 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d8e44-29eb-4533-bfbc-991a9e886267 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:46.070015 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d8e44-29eb-4533-bfbc-991a9e886267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:46.070518 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d8e44-29eb-4533-bfbc-991a9e886267 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:46.071464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d8e44-29eb-4533-bfbc-991a9e886267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:50:46.071902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d8e44-29eb-4533-bfbc-991a9e886267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:46.074194 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d8e44-29eb-4533-bfbc-991a9e886267 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:46.092858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 926/1867] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:50:46.092858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d8e44-29eb-4533-bfbc-991a9e886267 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:46.100022 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d8e44-29eb-4533-bfbc-991a9e886267 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:46.105535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c3b86-b5a7-45cf-a3c7-5f0901eb4d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:46.106462 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c3b86-b5a7-45cf-a3c7-5f0901eb4d5a admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:46.106572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c3b86-b5a7-45cf-a3c7-5f0901eb4d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:46.106904 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c3b86-b5a7-45cf-a3c7-5f0901eb4d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:46.107702 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c3b86-b5a7-45cf-a3c7-5f0901eb4d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:46.109418 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c3b86-b5a7-45cf-a3c7-5f0901eb4d5a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:46.139017 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6122ec97-d1e3-4a2a-aa91-567eb0010930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c16c8cd7684f3785f594d05c854e7a', 'request_id': 'req-6122ec97-d1e3-4a2a-aa91-567eb0010930'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:46.145477 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6122ec97-d1e3-4a2a-aa91-567eb0010930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c16c8cd7684f3785f594d05c854e7a', 'request_id': 'req-6122ec97-d1e3-4a2a-aa91-567eb0010930'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:46.149049 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 927/1868] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:46.149049 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c3b86-b5a7-45cf-a3c7-5f0901eb4d5a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:46.160847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6122ec97-d1e3-4a2a-aa91-567eb0010930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c16c8cd7684f3785f594d05c854e7a', 'request_id': 'req-6122ec97-d1e3-4a2a-aa91-567eb0010930'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:46.168319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c3b86-b5a7-45cf-a3c7-5f0901eb4d5a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:46.228638 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019a91c-4d49-49ba-bea8-5bd784891b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:46.229341 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019a91c-4d49-49ba-bea8-5bd784891b9f admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:46.229626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019a91c-4d49-49ba-bea8-5bd784891b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:46.229913 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019a91c-4d49-49ba-bea8-5bd784891b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:46.230606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019a91c-4d49-49ba-bea8-5bd784891b9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:46.232600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019a91c-4d49-49ba-bea8-5bd784891b9f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:46.264024 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6122ec97-d1e3-4a2a-aa91-567eb0010930 admin admin] The token cache is being invalidate because project b7c16c8cd7684f3785f594d05c854e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:50:46.264380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6122ec97-d1e3-4a2a-aa91-567eb0010930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:46.268908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6122ec97-d1e3-4a2a-aa91-567eb0010930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:50:46.272132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 942/1869] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:50:45 2022] DELETE /identity/v3/projects/b7c16c8cd7684f3785f594d05c854e7a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:46.272132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122ec97-d1e3-4a2a-aa91-567eb0010930 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:46.277291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6122ec97-d1e3-4a2a-aa91-567eb0010930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:46.295980 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122ec97-d1e3-4a2a-aa91-567eb0010930 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:46.303121 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5ff96-51a2-4649-a58b-c7a8a31b11de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:46.304224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5ff96-51a2-4649-a58b-c7a8a31b11de admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:46.304632 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5ff96-51a2-4649-a58b-c7a8a31b11de admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:46.304981 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5ff96-51a2-4649-a58b-c7a8a31b11de admin admin] PATH_INFO: `/v3/projects/c3d2f1e9a26243aeb77bfa6a6dd9cc04/users/8b55c37421f748b2a537a113b2cd1270/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:46.308688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5ff96-51a2-4649-a58b-c7a8a31b11de admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d2f1e9a26243aeb77bfa6a6dd9cc04, user_id=8b55c37421f748b2a537a113b2cd1270, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:46.312730 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5ff96-51a2-4649-a58b-c7a8a31b11de admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:46.323460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 928/1870] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:46 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:46.323460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbefd6-6ab3-4d50-97c0-867ba9c95712 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:46.323460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbefd6-6ab3-4d50-97c0-867ba9c95712 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:46.323460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbefd6-6ab3-4d50-97c0-867ba9c95712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:46.341025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 943/1871] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:46 2022] PUT /identity/v3/projects/c3d2f1e9a26243aeb77bfa6a6dd9cc04/users/8b55c37421f748b2a537a113b2cd1270/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:46.342243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5ff96-51a2-4649-a58b-c7a8a31b11de admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:46.344234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bcc5ff96-51a2-4649-a58b-c7a8a31b11de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:46.362851 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5efbefd6-6ab3-4d50-97c0-867ba9c95712 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:46.364791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5efbefd6-6ab3-4d50-97c0-867ba9c95712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:46.437259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5ff96-51a2-4649-a58b-c7a8a31b11de admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:46.459490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 929/1872] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:46.461147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14c18e-83c2-4c62-87d3-5afdbaf75be1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:46.461589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14c18e-83c2-4c62-87d3-5afdbaf75be1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:46.461874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14c18e-83c2-4c62-87d3-5afdbaf75be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:46.494351 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ce14c18e-83c2-4c62-87d3-5afdbaf75be1 None None] MFA Rules not processed for user `8b55c37421f748b2a537a113b2cd1270`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:46.496143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ce14c18e-83c2-4c62-87d3-5afdbaf75be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:46.516365 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd79bb7-8c77-451b-94ad-021459b3d2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:46.517695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79bb7-8c77-451b-94ad-021459b3d2ea admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:46.518045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79bb7-8c77-451b-94ad-021459b3d2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:46.518582 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79bb7-8c77-451b-94ad-021459b3d2ea admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:46.519728 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd79bb7-8c77-451b-94ad-021459b3d2ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:46.523406 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd79bb7-8c77-451b-94ad-021459b3d2ea admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:46.586673 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 930/1873] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:46.588002 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ebd94-0664-4960-9cd4-9ebcaa9702e7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:46.588851 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ebd94-0664-4960-9cd4-9ebcaa9702e7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:46.589242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ebd94-0664-4960-9cd4-9ebcaa9702e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:46.609331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0c0ebd94-0664-4960-9cd4-9ebcaa9702e7 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:46.610542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0c0ebd94-0664-4960-9cd4-9ebcaa9702e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:46.618651 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 931/1874] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:46.621888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ebd94-0664-4960-9cd4-9ebcaa9702e7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:46.621888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0c0ebd94-0664-4960-9cd4-9ebcaa9702e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:46.646786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 944/1875] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:46 2022] POST /identity/v3/users => generated 293 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:46.647611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd79bb7-8c77-451b-94ad-021459b3d2ea admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:46.670922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd79bb7-8c77-451b-94ad-021459b3d2ea admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:46.676472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f9087-7670-4fbc-b9c0-64dbaeafa9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:46.681528 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f9087-7670-4fbc-b9c0-64dbaeafa9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:46.681528 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f9087-7670-4fbc-b9c0-64dbaeafa9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:46.681528 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f9087-7670-4fbc-b9c0-64dbaeafa9a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:46.681528 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f9087-7670-4fbc-b9c0-64dbaeafa9a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:50:46.681528 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f9087-7670-4fbc-b9c0-64dbaeafa9a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:46.681528 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f9087-7670-4fbc-b9c0-64dbaeafa9a4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:46.694598 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 945/1876] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:50:46.695594 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f9087-7670-4fbc-b9c0-64dbaeafa9a4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:46.698279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ebd94-0664-4960-9cd4-9ebcaa9702e7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:46.702629 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de1e22-757b-4be4-a4d7-77f22ab3e74f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:46.703348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de1e22-757b-4be4-a4d7-77f22ab3e74f service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:46.703636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de1e22-757b-4be4-a4d7-77f22ab3e74f service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:46.703911 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de1e22-757b-4be4-a4d7-77f22ab3e74f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:46.706225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-90de1e22-757b-4be4-a4d7-77f22ab3e74f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:46.706844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f9087-7670-4fbc-b9c0-64dbaeafa9a4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:46.711697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cb5fd-c816-4868-9285-f6f56a3af3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:46.712413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cb5fd-c816-4868-9285-f6f56a3af3bc admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:46.722459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cb5fd-c816-4868-9285-f6f56a3af3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:46.722459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cb5fd-c816-4868-9285-f6f56a3af3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:46.722459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9cb5fd-c816-4868-9285-f6f56a3af3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:46.722459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9cb5fd-c816-4868-9285-f6f56a3af3bc admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:46.726968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 946/1877] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:46.730178 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cb5fd-c816-4868-9285-f6f56a3af3bc admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:46.739902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cb5fd-c816-4868-9285-f6f56a3af3bc admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:46.745030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c0188-8579-4a38-b35e-d69df7b9a2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:46.747614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c0188-8579-4a38-b35e-d69df7b9a2cd admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:46.747614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c0188-8579-4a38-b35e-d69df7b9a2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:46.747614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c0188-8579-4a38-b35e-d69df7b9a2cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:46.747614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c0188-8579-4a38-b35e-d69df7b9a2cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:46.749003 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c0188-8579-4a38-b35e-d69df7b9a2cd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:46.772406 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de1e22-757b-4be4-a4d7-77f22ab3e74f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:46.773889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de1e22-757b-4be4-a4d7-77f22ab3e74f service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:46.783734 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 932/1878] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:46.784568 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de1e22-757b-4be4-a4d7-77f22ab3e74f service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:46.795727 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de1e22-757b-4be4-a4d7-77f22ab3e74f service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:46.800543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bc58a-e9ca-45fa-948a-572256504424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:46.801211 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bc58a-e9ca-45fa-948a-572256504424 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:46.801556 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bc58a-e9ca-45fa-948a-572256504424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:46.801784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bc58a-e9ca-45fa-948a-572256504424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:46.802605 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bc58a-e9ca-45fa-948a-572256504424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:46.804200 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bc58a-e9ca-45fa-948a-572256504424 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:46.818592 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 933/1879] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:46.819675 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bc58a-e9ca-45fa-948a-572256504424 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:46.830410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bc58a-e9ca-45fa-948a-572256504424 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:46.835248 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbaa0d4-2b92-46c7-9d34-3f47ed51b7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:46.836771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbaa0d4-2b92-46c7-9d34-3f47ed51b7e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:46.836771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbaa0d4-2b92-46c7-9d34-3f47ed51b7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:46.836771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbaa0d4-2b92-46c7-9d34-3f47ed51b7e6 admin admin] PATH_INFO: `/v3/projects/48767fd65ba24f7895a9d996cfea5fcd/users/78718b28202446f784f9c50b58d63a60/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:46.852330 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbaa0d4-2b92-46c7-9d34-3f47ed51b7e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48767fd65ba24f7895a9d996cfea5fcd, user_id=78718b28202446f784f9c50b58d63a60, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:46.855639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbaa0d4-2b92-46c7-9d34-3f47ed51b7e6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:46.920474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 947/1880] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:46 2022] POST /identity/v3/projects => generated 399 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:46.924776 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c0188-8579-4a38-b35e-d69df7b9a2cd admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:46.986406 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 934/1881] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:46 2022] PUT /identity/v3/projects/48767fd65ba24f7895a9d996cfea5fcd/users/78718b28202446f784f9c50b58d63a60/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:50:46.986949 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c0188-8579-4a38-b35e-d69df7b9a2cd admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:46.997311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d158e-19bd-4190-aecf-7e6ecb4812b8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:46.997597 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d158e-19bd-4190-aecf-7e6ecb4812b8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:46.997978 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d158e-19bd-4190-aecf-7e6ecb4812b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:47.025538 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fd6d158e-19bd-4190-aecf-7e6ecb4812b8 None None] MFA Rules not processed for user `78718b28202446f784f9c50b58d63a60`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:47.027598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fd6d158e-19bd-4190-aecf-7e6ecb4812b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:47.045511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624a862-d447-4b23-b3a5-a0905f1eedd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:47.046186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624a862-d447-4b23-b3a5-a0905f1eedd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:47.046465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624a862-d447-4b23-b3a5-a0905f1eedd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:47.046770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624a862-d447-4b23-b3a5-a0905f1eedd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:47.047460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624a862-d447-4b23-b3a5-a0905f1eedd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:47.049537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624a862-d447-4b23-b3a5-a0905f1eedd0 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:47.092298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 935/1882] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:50:47.096864 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d158e-19bd-4190-aecf-7e6ecb4812b8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:47.107779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d158e-19bd-4190-aecf-7e6ecb4812b8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:47.112540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f822221-beae-412a-a64e-3d3209fe397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:47.113200 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f822221-beae-412a-a64e-3d3209fe397c admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:47.113481 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f822221-beae-412a-a64e-3d3209fe397c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:47.113763 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f822221-beae-412a-a64e-3d3209fe397c admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:47.114481 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f822221-beae-412a-a64e-3d3209fe397c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:47.116349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f822221-beae-412a-a64e-3d3209fe397c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:47.126394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 948/1883] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:46 2022] POST /identity/v3/users => generated 300 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:50:47.130466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624a862-d447-4b23-b3a5-a0905f1eedd0 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:47.143317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624a862-d447-4b23-b3a5-a0905f1eedd0 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:47.151834 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcaaed-c0d1-429b-a10d-34a2decad1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:47.153024 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcaaed-c0d1-429b-a10d-34a2decad1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:47.154546 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcaaed-c0d1-429b-a10d-34a2decad1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:47.154969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcaaed-c0d1-429b-a10d-34a2decad1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:47.155827 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcaaed-c0d1-429b-a10d-34a2decad1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:47.157862 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcaaed-c0d1-429b-a10d-34a2decad1a4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:47.170262 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 949/1884] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:50:47.173793 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcaaed-c0d1-429b-a10d-34a2decad1a4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:47.191423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcaaed-c0d1-429b-a10d-34a2decad1a4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:47.196511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f23bf-b0c2-4022-8929-1d9a9b4f3636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:47.197196 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f23bf-b0c2-4022-8929-1d9a9b4f3636 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:47.197479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f23bf-b0c2-4022-8929-1d9a9b4f3636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:47.198513 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f23bf-b0c2-4022-8929-1d9a9b4f3636 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:47.199493 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f23bf-b0c2-4022-8929-1d9a9b4f3636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:47.201136 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f23bf-b0c2-4022-8929-1d9a9b4f3636 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:47.209522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 936/1885] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:47 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:50:47.213491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f822221-beae-412a-a64e-3d3209fe397c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:47.220490 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 950/1886] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:50:47.222476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f23bf-b0c2-4022-8929-1d9a9b4f3636 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:47.234272 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f23bf-b0c2-4022-8929-1d9a9b4f3636 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:47.296587 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f822221-beae-412a-a64e-3d3209fe397c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:47.318199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae64aaa-3170-44b0-a64f-b0b1f8b14896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:47.318955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64aaa-3170-44b0-a64f-b0b1f8b14896 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:47.319249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64aaa-3170-44b0-a64f-b0b1f8b14896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:47.319528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64aaa-3170-44b0-a64f-b0b1f8b14896 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:47.327719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae64aaa-3170-44b0-a64f-b0b1f8b14896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:47.327719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae64aaa-3170-44b0-a64f-b0b1f8b14896 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:47.344376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480d03-a924-4832-a1b7-9dc0c6296172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:47.345751 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480d03-a924-4832-a1b7-9dc0c6296172 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:47.349767 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480d03-a924-4832-a1b7-9dc0c6296172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:47.350144 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480d03-a924-4832-a1b7-9dc0c6296172 admin admin] PATH_INFO: `/v3/projects/98b1eb4200e840b3a2bfdfac7133c593/users/d324665a9fbb48fa8e2e43d63d9f4b34/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:47.377332 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480d03-a924-4832-a1b7-9dc0c6296172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b1eb4200e840b3a2bfdfac7133c593, user_id=d324665a9fbb48fa8e2e43d63d9f4b34, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:47.382810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480d03-a924-4832-a1b7-9dc0c6296172 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:47.459877 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 937/1887] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:47 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:47.463654 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae64aaa-3170-44b0-a64f-b0b1f8b14896 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:47.475927 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae64aaa-3170-44b0-a64f-b0b1f8b14896 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:47.482170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4188d-9fe1-4048-95c5-9356709452e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:47.483119 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4188d-9fe1-4048-95c5-9356709452e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:47.483631 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4188d-9fe1-4048-95c5-9356709452e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:47.484110 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4188d-9fe1-4048-95c5-9356709452e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:47.485113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4188d-9fe1-4048-95c5-9356709452e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:47.486995 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4188d-9fe1-4048-95c5-9356709452e8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:47.515676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 951/1888] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:47 2022] PUT /identity/v3/projects/98b1eb4200e840b3a2bfdfac7133c593/users/d324665a9fbb48fa8e2e43d63d9f4b34/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:47.516156 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 938/1889] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:50:47.520852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480d03-a924-4832-a1b7-9dc0c6296172 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:47.530648 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba0f80-f7d6-452a-b88e-2b12fcb3c05f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:47.531102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba0f80-f7d6-452a-b88e-2b12fcb3c05f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:47.532627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba0f80-f7d6-452a-b88e-2b12fcb3c05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:47.619551 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-31ba0f80-f7d6-452a-b88e-2b12fcb3c05f None None] MFA Rules not processed for user `d324665a9fbb48fa8e2e43d63d9f4b34`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:47.621435 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-31ba0f80-f7d6-452a-b88e-2b12fcb3c05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:47.653048 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480d03-a924-4832-a1b7-9dc0c6296172 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:47.659892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf5b39-6efe-4a5f-9e9d-9387f85242ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:47.660069 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf5b39-6efe-4a5f-9e9d-9387f85242ee admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:47.660342 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf5b39-6efe-4a5f-9e9d-9387f85242ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:47.660647 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf5b39-6efe-4a5f-9e9d-9387f85242ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:47.661386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf5b39-6efe-4a5f-9e9d-9387f85242ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:47.662990 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf5b39-6efe-4a5f-9e9d-9387f85242ee admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:47.693277 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 952/1890] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:47.696420 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf5b39-6efe-4a5f-9e9d-9387f85242ee admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:47.710428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf5b39-6efe-4a5f-9e9d-9387f85242ee admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:47.717904 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b1ddd-da21-4b62-b9d8-15f704ea5257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:47.719548 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b1ddd-da21-4b62-b9d8-15f704ea5257 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:47.719962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b1ddd-da21-4b62-b9d8-15f704ea5257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:47.720251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b1ddd-da21-4b62-b9d8-15f704ea5257 admin admin] PATH_INFO: `/v3/projects/3af21f31131641829e774a36c12fd69b/users/6df56e88fedf461f9dc7d3747f5ad1dc/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:47.743961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b1ddd-da21-4b62-b9d8-15f704ea5257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af21f31131641829e774a36c12fd69b, user_id=6df56e88fedf461f9dc7d3747f5ad1dc, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:47.747626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b1ddd-da21-4b62-b9d8-15f704ea5257 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:47.774811 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 939/1891] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:47.782979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba0f80-f7d6-452a-b88e-2b12fcb3c05f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:47.801530 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba0f80-f7d6-452a-b88e-2b12fcb3c05f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:47.816772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a01c03-8892-4084-95ab-7417906d4127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:47.816772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a01c03-8892-4084-95ab-7417906d4127 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:47.816772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a01c03-8892-4084-95ab-7417906d4127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:47.816772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a01c03-8892-4084-95ab-7417906d4127 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:47.817064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a01c03-8892-4084-95ab-7417906d4127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:47.817064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a01c03-8892-4084-95ab-7417906d4127 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:47.867054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 953/1892] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:47 2022] PUT /identity/v3/projects/3af21f31131641829e774a36c12fd69b/users/6df56e88fedf461f9dc7d3747f5ad1dc/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:47.878663 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026be175-dd3a-491e-9449-3ff87c4f2117 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:47.879713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026be175-dd3a-491e-9449-3ff87c4f2117 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:47.880199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026be175-dd3a-491e-9449-3ff87c4f2117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:47.920181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 940/1893] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:47 2022] POST /identity/v3/projects => generated 401 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:47.924221 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a01c03-8892-4084-95ab-7417906d4127 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:47.924360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-026be175-dd3a-491e-9449-3ff87c4f2117 None None] MFA Rules not processed for user `6df56e88fedf461f9dc7d3747f5ad1dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:47.926437 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-026be175-dd3a-491e-9449-3ff87c4f2117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:48.030517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 954/1894] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:48.035166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026be175-dd3a-491e-9449-3ff87c4f2117 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:48.043349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a01c03-8892-4084-95ab-7417906d4127 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:48.046509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026be175-dd3a-491e-9449-3ff87c4f2117 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:48.048095 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b491e-80a6-422e-938d-7b3f2d64d6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:48.048997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b491e-80a6-422e-938d-7b3f2d64d6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:48.049392 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b491e-80a6-422e-938d-7b3f2d64d6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:48.049698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b491e-80a6-422e-938d-7b3f2d64d6b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:48.050534 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b491e-80a6-422e-938d-7b3f2d64d6b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:48.051507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88130a-c321-40f0-a111-b982dc1e46a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:48.052157 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88130a-c321-40f0-a111-b982dc1e46a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:48.052459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88130a-c321-40f0-a111-b982dc1e46a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:48.052751 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88130a-c321-40f0-a111-b982dc1e46a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:48.052841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b491e-80a6-422e-938d-7b3f2d64d6b8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:48.053451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88130a-c321-40f0-a111-b982dc1e46a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:48.055429 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88130a-c321-40f0-a111-b982dc1e46a5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:48.170307 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 941/1895] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:47 2022] POST /identity/v3/users => generated 307 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:50:48.172677 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 955/1896] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:50:48 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:50:48.176707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b491e-80a6-422e-938d-7b3f2d64d6b8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:48.177170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88130a-c321-40f0-a111-b982dc1e46a5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:48.187991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b491e-80a6-422e-938d-7b3f2d64d6b8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:48.259108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b6118-c048-4e9c-bb6a-278c4d122f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:48.259963 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b6118-c048-4e9c-bb6a-278c4d122f7a admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:48.260560 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b6118-c048-4e9c-bb6a-278c4d122f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:48.260954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b6118-c048-4e9c-bb6a-278c4d122f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:48.261576 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88130a-c321-40f0-a111-b982dc1e46a5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:48.263276 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b6118-c048-4e9c-bb6a-278c4d122f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:48.264472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b6118-c048-4e9c-bb6a-278c4d122f7a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:48.267766 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3696c-d7c0-4994-8095-55e8f87946d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:48.269810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3696c-d7c0-4994-8095-55e8f87946d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:48.270100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3696c-d7c0-4994-8095-55e8f87946d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:48.270380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3696c-d7c0-4994-8095-55e8f87946d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:48.271798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3696c-d7c0-4994-8095-55e8f87946d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:48.274550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3696c-d7c0-4994-8095-55e8f87946d8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:48.279866 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 942/1897] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:50:48.281352 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b6118-c048-4e9c-bb6a-278c4d122f7a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:48.293115 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b6118-c048-4e9c-bb6a-278c4d122f7a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:48.298293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14e6ba-830f-41b5-bdd1-c4a17c2cc408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:48.299268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14e6ba-830f-41b5-bdd1-c4a17c2cc408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:48.299584 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14e6ba-830f-41b5-bdd1-c4a17c2cc408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:48.299866 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14e6ba-830f-41b5-bdd1-c4a17c2cc408 admin admin] PATH_INFO: `/v3/projects/5d78547599e04f7e9bd0d946e41a42ad/users/d9cda8dd3b1d4cab90006ecebffe35c9/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:48.316472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14e6ba-830f-41b5-bdd1-c4a17c2cc408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d78547599e04f7e9bd0d946e41a42ad, user_id=d9cda8dd3b1d4cab90006ecebffe35c9, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:48.319138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14e6ba-830f-41b5-bdd1-c4a17c2cc408 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:48.381841 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 956/1898] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:50:48 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:50:48.385824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3696c-d7c0-4994-8095-55e8f87946d8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:48.397805 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3696c-d7c0-4994-8095-55e8f87946d8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:48.403045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a80ba0-625e-4704-ac05-17c2cb6f3c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:48.403796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a80ba0-625e-4704-ac05-17c2cb6f3c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:48.404075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a80ba0-625e-4704-ac05-17c2cb6f3c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:48.404353 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a80ba0-625e-4704-ac05-17c2cb6f3c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:48.405120 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a80ba0-625e-4704-ac05-17c2cb6f3c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:48.406809 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a80ba0-625e-4704-ac05-17c2cb6f3c48 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:48.420644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 957/1899] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:50:48.424409 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a80ba0-625e-4704-ac05-17c2cb6f3c48 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:48.437161 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 943/1900] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:48 2022] PUT /identity/v3/projects/5d78547599e04f7e9bd0d946e41a42ad/users/d9cda8dd3b1d4cab90006ecebffe35c9/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:50:48.441273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14e6ba-830f-41b5-bdd1-c4a17c2cc408 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:48.450891 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a80ba0-625e-4704-ac05-17c2cb6f3c48 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:48.538501 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671e322-e6c0-46a5-9ead-8aada9f33c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:48.539437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14e6ba-830f-41b5-bdd1-c4a17c2cc408 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:48.540243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671e322-e6c0-46a5-9ead-8aada9f33c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:48.540720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671e322-e6c0-46a5-9ead-8aada9f33c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:48.541140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671e322-e6c0-46a5-9ead-8aada9f33c77 admin admin] PATH_INFO: `/v3/projects/15916e695efb4237971ff5d0ac14b78e/users/d23aff95abd1462c8bd8037b40c857d7/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:48.551576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ce5f1-aa15-4187-8d0b-7e5596efcb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:48.554027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ce5f1-aa15-4187-8d0b-7e5596efcb5c admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:48.554966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ce5f1-aa15-4187-8d0b-7e5596efcb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:48.556183 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ce5f1-aa15-4187-8d0b-7e5596efcb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:48.561055 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ce5f1-aa15-4187-8d0b-7e5596efcb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:48.565130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ce5f1-aa15-4187-8d0b-7e5596efcb5c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:48.579265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671e322-e6c0-46a5-9ead-8aada9f33c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15916e695efb4237971ff5d0ac14b78e, user_id=d23aff95abd1462c8bd8037b40c857d7, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:48.587056 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671e322-e6c0-46a5-9ead-8aada9f33c77 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:48.598092 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 944/1901] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:50:48.600042 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ce5f1-aa15-4187-8d0b-7e5596efcb5c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:48.619990 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ce5f1-aa15-4187-8d0b-7e5596efcb5c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:48.623222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867eee3c-a5fe-4813-80e8-5c84966b00fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:48.624220 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867eee3c-a5fe-4813-80e8-5c84966b00fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:48.624701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867eee3c-a5fe-4813-80e8-5c84966b00fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:48.625127 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867eee3c-a5fe-4813-80e8-5c84966b00fd admin admin] PATH_INFO: `/v3/projects/5d78547599e04f7e9bd0d946e41a42ad/users/d9cda8dd3b1d4cab90006ecebffe35c9/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:48.627420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867eee3c-a5fe-4813-80e8-5c84966b00fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d78547599e04f7e9bd0d946e41a42ad, user_id=d9cda8dd3b1d4cab90006ecebffe35c9, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:48.631842 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867eee3c-a5fe-4813-80e8-5c84966b00fd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:48.648723 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 945/1902] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:48 2022] PUT /identity/v3/projects/5d78547599e04f7e9bd0d946e41a42ad/users/d9cda8dd3b1d4cab90006ecebffe35c9/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:50:48.658347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75465099-5b1f-4a34-bbcf-e64ab6045c6e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:48.658347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75465099-5b1f-4a34-bbcf-e64ab6045c6e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:48.658347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75465099-5b1f-4a34-bbcf-e64ab6045c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:48.677731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 958/1903] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:48 2022] PUT /identity/v3/projects/15916e695efb4237971ff5d0ac14b78e/users/d23aff95abd1462c8bd8037b40c857d7/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:50:48.682704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671e322-e6c0-46a5-9ead-8aada9f33c77 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:48.695900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-75465099-5b1f-4a34-bbcf-e64ab6045c6e None None] MFA Rules not processed for user `d9cda8dd3b1d4cab90006ecebffe35c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:48.697831 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-75465099-5b1f-4a34-bbcf-e64ab6045c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:48.794875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671e322-e6c0-46a5-9ead-8aada9f33c77 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:48.800339 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 946/1904] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:48 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:50:48.800467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32c85c-a6bf-4fba-9d6f-a23ba88476ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:48.801261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32c85c-a6bf-4fba-9d6f-a23ba88476ff admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:48.801366 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32c85c-a6bf-4fba-9d6f-a23ba88476ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:48.801653 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32c85c-a6bf-4fba-9d6f-a23ba88476ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:48.802430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32c85c-a6bf-4fba-9d6f-a23ba88476ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:48.804092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32c85c-a6bf-4fba-9d6f-a23ba88476ff admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:48.814919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 959/1905] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:50:48.815161 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75465099-5b1f-4a34-bbcf-e64ab6045c6e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:48.816577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-75465099-5b1f-4a34-bbcf-e64ab6045c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:48.818844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32c85c-a6bf-4fba-9d6f-a23ba88476ff admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:48.829395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32c85c-a6bf-4fba-9d6f-a23ba88476ff admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:48.834120 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a121da-72e2-4edf-aa3e-1e499d6b63d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:48.835747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a121da-72e2-4edf-aa3e-1e499d6b63d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:48.835747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a121da-72e2-4edf-aa3e-1e499d6b63d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:48.835747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a121da-72e2-4edf-aa3e-1e499d6b63d2 admin admin] PATH_INFO: `/v3/projects/15916e695efb4237971ff5d0ac14b78e/users/d23aff95abd1462c8bd8037b40c857d7/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:48.837918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a121da-72e2-4edf-aa3e-1e499d6b63d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15916e695efb4237971ff5d0ac14b78e, user_id=d23aff95abd1462c8bd8037b40c857d7, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:48.841205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a121da-72e2-4edf-aa3e-1e499d6b63d2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:48.851442 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 960/1906] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:50:48 2022] PUT /identity/v3/projects/15916e695efb4237971ff5d0ac14b78e/users/d23aff95abd1462c8bd8037b40c857d7/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:50:48.863113 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f91aa3-d5f9-4677-a93d-aab13ab8361f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:48.863395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f91aa3-d5f9-4677-a93d-aab13ab8361f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:48.863673 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f91aa3-d5f9-4677-a93d-aab13ab8361f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:48.881537 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75465099-5b1f-4a34-bbcf-e64ab6045c6e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:48.891297 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e6f91aa3-d5f9-4677-a93d-aab13ab8361f None None] MFA Rules not processed for user `d23aff95abd1462c8bd8037b40c857d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:50:48.892907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e6f91aa3-d5f9-4677-a93d-aab13ab8361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:50:48.939845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37c996-1603-4e7d-b879-19751c658695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:48.940539 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37c996-1603-4e7d-b879-19751c658695 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:48.940822 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37c996-1603-4e7d-b879-19751c658695 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:48.941114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37c996-1603-4e7d-b879-19751c658695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:48.988657 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 961/1907] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:50:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:50:49.036758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37c996-1603-4e7d-b879-19751c658695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:49.038246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37c996-1603-4e7d-b879-19751c658695 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:49.048946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 947/1908] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:48 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:50:49.155215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f91aa3-d5f9-4677-a93d-aab13ab8361f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:49.167255 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f91aa3-d5f9-4677-a93d-aab13ab8361f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:49.173393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7948718-e598-4856-872f-a520b3c45f91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:49.174142 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7948718-e598-4856-872f-a520b3c45f91 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:49.174496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7948718-e598-4856-872f-a520b3c45f91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:49.174860 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7948718-e598-4856-872f-a520b3c45f91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:49.241778 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7948718-e598-4856-872f-a520b3c45f91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:49.243246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7948718-e598-4856-872f-a520b3c45f91 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:49.253034 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 962/1909] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:50:49.442748 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37c996-1603-4e7d-b879-19751c658695 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:49.451693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37c996-1603-4e7d-b879-19751c658695 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:49.475199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7c68f-ddca-46ca-9bca-340e069cfd90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:49.476465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c68f-ddca-46ca-9bca-340e069cfd90 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:49.477368 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c68f-ddca-46ca-9bca-340e069cfd90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:49.478281 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c68f-ddca-46ca-9bca-340e069cfd90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:49.569145 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7c68f-ddca-46ca-9bca-340e069cfd90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:49.571422 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7c68f-ddca-46ca-9bca-340e069cfd90 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:49.582206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 948/1910] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:53.483942 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7948718-e598-4856-872f-a520b3c45f91 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:53.492083 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7948718-e598-4856-872f-a520b3c45f91 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:53.496668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a8d11-f22b-47cd-acf5-4ea5477175bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:53.497308 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a8d11-f22b-47cd-acf5-4ea5477175bb service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:53.497583 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a8d11-f22b-47cd-acf5-4ea5477175bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:53.497851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a8d11-f22b-47cd-acf5-4ea5477175bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:53.556388 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a8d11-f22b-47cd-acf5-4ea5477175bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:53.558554 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a8d11-f22b-47cd-acf5-4ea5477175bb service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:53.567413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 963/1911] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:54.787273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7c68f-ddca-46ca-9bca-340e069cfd90 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:54.796839 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7c68f-ddca-46ca-9bca-340e069cfd90 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:54.800386 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ffd84-7319-4094-957e-53c39188c014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:54.801059 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ffd84-7319-4094-957e-53c39188c014 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:54.801348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ffd84-7319-4094-957e-53c39188c014 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:54.801625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ffd84-7319-4094-957e-53c39188c014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:54.863248 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ffd84-7319-4094-957e-53c39188c014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:54.864789 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ffd84-7319-4094-957e-53c39188c014 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:54.875441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 949/1912] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:50:56.562320 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a8d11-f22b-47cd-acf5-4ea5477175bb service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:50:56.570627 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a8d11-f22b-47cd-acf5-4ea5477175bb service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:50:56.574735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f878766-0fe8-4b52-9b7f-7621c01a0e71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:50:56.575363 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f878766-0fe8-4b52-9b7f-7621c01a0e71 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:50:56.575641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f878766-0fe8-4b52-9b7f-7621c01a0e71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:50:56.575911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f878766-0fe8-4b52-9b7f-7621c01a0e71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:50:56.584854 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f878766-0fe8-4b52-9b7f-7621c01a0e71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:50:56.586270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f878766-0fe8-4b52-9b7f-7621c01a0e71 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:50:56.596309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 964/1913] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:50:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:51:04.165513 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ffd84-7319-4094-957e-53c39188c014 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:04.228474 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ffd84-7319-4094-957e-53c39188c014 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:04.233414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a64b19-070e-4587-ab44-eb098a25245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:04.234284 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a64b19-070e-4587-ab44-eb098a25245d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:04.234592 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a64b19-070e-4587-ab44-eb098a25245d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:04.234880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a64b19-070e-4587-ab44-eb098a25245d admin admin] PATH_INFO: `/v3/users/d324665a9fbb48fa8e2e43d63d9f4b34` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:04.236079 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a64b19-070e-4587-ab44-eb098a25245d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d324665a9fbb48fa8e2e43d63d9f4b34)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:04.238058 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a64b19-070e-4587-ab44-eb098a25245d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:04.486578 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-91a64b19-070e-4587-ab44-eb098a25245d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd324665a9fbb48fa8e2e43d63d9f4b34'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:04.498997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-91a64b19-070e-4587-ab44-eb098a25245d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd324665a9fbb48fa8e2e43d63d9f4b34'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:04.617450 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-91a64b19-070e-4587-ab44-eb098a25245d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd324665a9fbb48fa8e2e43d63d9f4b34'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:04.626977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-91a64b19-070e-4587-ab44-eb098a25245d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd324665a9fbb48fa8e2e43d63d9f4b34'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:04.626977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-91a64b19-070e-4587-ab44-eb098a25245d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd324665a9fbb48fa8e2e43d63d9f4b34'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:04.635429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 950/1914] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:04 2022] DELETE /identity/v3/users/d324665a9fbb48fa8e2e43d63d9f4b34 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:51:04.638163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36b360-8fb0-4948-9bac-ed17d63f0f8c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:04.638629 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36b360-8fb0-4948-9bac-ed17d63f0f8c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:04.638712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36b360-8fb0-4948-9bac-ed17d63f0f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:04.656981 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4a36b360-8fb0-4948-9bac-ed17d63f0f8c None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:04.658695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4a36b360-8fb0-4948-9bac-ed17d63f0f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:04.725927 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 965/1915] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:04.740219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a64b19-070e-4587-ab44-eb098a25245d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:04.747346 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-91a64b19-070e-4587-ab44-eb098a25245d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:04.800685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a64b19-070e-4587-ab44-eb098a25245d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:04.807350 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392299f-0c7e-4c5b-aadf-5c79f6550e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:04.808829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392299f-0c7e-4c5b-aadf-5c79f6550e4a service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:04.809222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392299f-0c7e-4c5b-aadf-5c79f6550e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:04.809614 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392299f-0c7e-4c5b-aadf-5c79f6550e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:04.823233 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392299f-0c7e-4c5b-aadf-5c79f6550e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:04.826185 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392299f-0c7e-4c5b-aadf-5c79f6550e4a service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:04.839411 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 951/1916] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:51:05.962333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36b360-8fb0-4948-9bac-ed17d63f0f8c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:05.963929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4a36b360-8fb0-4948-9bac-ed17d63f0f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:05.983126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36b360-8fb0-4948-9bac-ed17d63f0f8c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:05.988553 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd7977-ab73-4515-ad73-3e559cbe2a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:05.989499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd7977-ab73-4515-ad73-3e559cbe2a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:05.989877 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd7977-ab73-4515-ad73-3e559cbe2a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:05.990240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd7977-ab73-4515-ad73-3e559cbe2a1f admin admin] PATH_INFO: `/v3/projects/98b1eb4200e840b3a2bfdfac7133c593` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:05.991520 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd7977-ab73-4515-ad73-3e559cbe2a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b1eb4200e840b3a2bfdfac7133c593)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:05.993621 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd7977-ab73-4515-ad73-3e559cbe2a1f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:06.111098 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-19fd7977-ab73-4515-ad73-3e559cbe2a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b1eb4200e840b3a2bfdfac7133c593', 'request_id': 'req-19fd7977-ab73-4515-ad73-3e559cbe2a1f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:06.118091 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-19fd7977-ab73-4515-ad73-3e559cbe2a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b1eb4200e840b3a2bfdfac7133c593', 'request_id': 'req-19fd7977-ab73-4515-ad73-3e559cbe2a1f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:06.125245 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-19fd7977-ab73-4515-ad73-3e559cbe2a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b1eb4200e840b3a2bfdfac7133c593', 'request_id': 'req-19fd7977-ab73-4515-ad73-3e559cbe2a1f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:06.236608 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-19fd7977-ab73-4515-ad73-3e559cbe2a1f admin admin] The token cache is being invalidate because project 98b1eb4200e840b3a2bfdfac7133c593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:06.236608 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-19fd7977-ab73-4515-ad73-3e559cbe2a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:06.236608 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-19fd7977-ab73-4515-ad73-3e559cbe2a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:06.236608 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 966/1917] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:05 2022] DELETE /identity/v3/projects/98b1eb4200e840b3a2bfdfac7133c593 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:06.240233 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392299f-0c7e-4c5b-aadf-5c79f6550e4a service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:06.251498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392299f-0c7e-4c5b-aadf-5c79f6550e4a service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:06.317792 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36907eac-88fc-4ad1-80c4-c6694bcbeb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:06.318670 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36907eac-88fc-4ad1-80c4-c6694bcbeb63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:06.318980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36907eac-88fc-4ad1-80c4-c6694bcbeb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:06.319257 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36907eac-88fc-4ad1-80c4-c6694bcbeb63 admin admin] PATH_INFO: `/v3/users/d9cda8dd3b1d4cab90006ecebffe35c9` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:06.320646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36907eac-88fc-4ad1-80c4-c6694bcbeb63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9cda8dd3b1d4cab90006ecebffe35c9)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:06.322572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36907eac-88fc-4ad1-80c4-c6694bcbeb63 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:06.550322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-36907eac-88fc-4ad1-80c4-c6694bcbeb63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9cda8dd3b1d4cab90006ecebffe35c9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:06.563812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-36907eac-88fc-4ad1-80c4-c6694bcbeb63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9cda8dd3b1d4cab90006ecebffe35c9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:06.657513 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-36907eac-88fc-4ad1-80c4-c6694bcbeb63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9cda8dd3b1d4cab90006ecebffe35c9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:06.665574 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-36907eac-88fc-4ad1-80c4-c6694bcbeb63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9cda8dd3b1d4cab90006ecebffe35c9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:06.666359 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-36907eac-88fc-4ad1-80c4-c6694bcbeb63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9cda8dd3b1d4cab90006ecebffe35c9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:06.673496 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 952/1918] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:06 2022] DELETE /identity/v3/users/d9cda8dd3b1d4cab90006ecebffe35c9 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:07.208159 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd7977-ab73-4515-ad73-3e559cbe2a1f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:07.213547 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-19fd7977-ab73-4515-ad73-3e559cbe2a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:07.227734 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd7977-ab73-4515-ad73-3e559cbe2a1f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:07.301517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6fc4a-21dd-48a8-8872-b84d2c633899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:07.303229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6fc4a-21dd-48a8-8872-b84d2c633899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:07.303709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6fc4a-21dd-48a8-8872-b84d2c633899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:07.304176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6fc4a-21dd-48a8-8872-b84d2c633899 admin admin] PATH_INFO: `/v3/projects/5d78547599e04f7e9bd0d946e41a42ad` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:07.306251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6fc4a-21dd-48a8-8872-b84d2c633899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d78547599e04f7e9bd0d946e41a42ad)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:07.310186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6fc4a-21dd-48a8-8872-b84d2c633899 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:07.408020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-58f6fc4a-21dd-48a8-8872-b84d2c633899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d78547599e04f7e9bd0d946e41a42ad', 'request_id': 'req-58f6fc4a-21dd-48a8-8872-b84d2c633899'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:07.413437 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-58f6fc4a-21dd-48a8-8872-b84d2c633899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d78547599e04f7e9bd0d946e41a42ad', 'request_id': 'req-58f6fc4a-21dd-48a8-8872-b84d2c633899'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:07.423318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-58f6fc4a-21dd-48a8-8872-b84d2c633899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d78547599e04f7e9bd0d946e41a42ad', 'request_id': 'req-58f6fc4a-21dd-48a8-8872-b84d2c633899'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:07.514741 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-58f6fc4a-21dd-48a8-8872-b84d2c633899 admin admin] The token cache is being invalidate because project 5d78547599e04f7e9bd0d946e41a42ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:07.515040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-58f6fc4a-21dd-48a8-8872-b84d2c633899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:07.515759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-58f6fc4a-21dd-48a8-8872-b84d2c633899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:07.517308 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 967/1919] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:07 2022] DELETE /identity/v3/projects/5d78547599e04f7e9bd0d946e41a42ad => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:07.522243 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae55ef-1fd0-49d1-bf81-e2da2ad330fe None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:07.522698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae55ef-1fd0-49d1-bf81-e2da2ad330fe None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:07.522798 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae55ef-1fd0-49d1-bf81-e2da2ad330fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:07.544477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-17ae55ef-1fd0-49d1-bf81-e2da2ad330fe None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:07.545717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-17ae55ef-1fd0-49d1-bf81-e2da2ad330fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:07.603613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 953/1920] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:51:07.612154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbbe4d-1da2-4024-8ec0-eea69a340d30 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:07.612459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbbe4d-1da2-4024-8ec0-eea69a340d30 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:07.612763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbbe4d-1da2-4024-8ec0-eea69a340d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:07.630867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-70cbbe4d-1da2-4024-8ec0-eea69a340d30 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:07.632085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-70cbbe4d-1da2-4024-8ec0-eea69a340d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:07.640744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 968/1921] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:07.652134 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae55ef-1fd0-49d1-bf81-e2da2ad330fe None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:07.661623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae55ef-1fd0-49d1-bf81-e2da2ad330fe None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:07.666602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39032ae-fbf8-4df1-9a64-23ba9738803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:07.667376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39032ae-fbf8-4df1-9a64-23ba9738803d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:07.667675 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39032ae-fbf8-4df1-9a64-23ba9738803d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:07.667949 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39032ae-fbf8-4df1-9a64-23ba9738803d admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:07.668719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39032ae-fbf8-4df1-9a64-23ba9738803d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:51:07.669028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39032ae-fbf8-4df1-9a64-23ba9738803d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:07.670637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39032ae-fbf8-4df1-9a64-23ba9738803d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:07.682659 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 954/1922] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:51:07.687055 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbbe4d-1da2-4024-8ec0-eea69a340d30 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:07.696293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbbe4d-1da2-4024-8ec0-eea69a340d30 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:07.701604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90e709-7859-4dc3-861b-095be293f171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:07.702203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90e709-7859-4dc3-861b-095be293f171 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:07.702481 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90e709-7859-4dc3-861b-095be293f171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:07.702752 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90e709-7859-4dc3-861b-095be293f171 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:07.703444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90e709-7859-4dc3-861b-095be293f171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:07.705367 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90e709-7859-4dc3-861b-095be293f171 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:07.801972 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 969/1923] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:07 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:51:07.806343 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39032ae-fbf8-4df1-9a64-23ba9738803d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:07.817261 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39032ae-fbf8-4df1-9a64-23ba9738803d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:07.872319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a665b-9e54-4180-88ed-f67dad5e1812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:07.873017 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a665b-9e54-4180-88ed-f67dad5e1812 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:07.873302 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a665b-9e54-4180-88ed-f67dad5e1812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:07.873576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a665b-9e54-4180-88ed-f67dad5e1812 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:07.874273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a665b-9e54-4180-88ed-f67dad5e1812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:07.876213 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a665b-9e54-4180-88ed-f67dad5e1812 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:07.994536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 955/1924] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:07 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:07.998536 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90e709-7859-4dc3-861b-095be293f171 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:08.008695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90e709-7859-4dc3-861b-095be293f171 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:08.013583 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6e0f2-971d-4e83-b352-f9124411abbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:08.014235 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6e0f2-971d-4e83-b352-f9124411abbd admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:08.014508 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6e0f2-971d-4e83-b352-f9124411abbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:08.014776 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6e0f2-971d-4e83-b352-f9124411abbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:08.015485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6e0f2-971d-4e83-b352-f9124411abbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:08.017125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6e0f2-971d-4e83-b352-f9124411abbd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:08.028292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 970/1925] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:08.032277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a665b-9e54-4180-88ed-f67dad5e1812 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:08.044295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a665b-9e54-4180-88ed-f67dad5e1812 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:08.059900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b760734-a8a9-4e92-a109-54b34dada33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:08.059900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b760734-a8a9-4e92-a109-54b34dada33a admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:08.059900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b760734-a8a9-4e92-a109-54b34dada33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:08.059900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b760734-a8a9-4e92-a109-54b34dada33a admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:08.060400 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b760734-a8a9-4e92-a109-54b34dada33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:08.060400 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b760734-a8a9-4e92-a109-54b34dada33a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:08.065182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 956/1926] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:08.069332 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6e0f2-971d-4e83-b352-f9124411abbd admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:08.079308 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6e0f2-971d-4e83-b352-f9124411abbd admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:08.083774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45b822-c256-41c7-ad28-754a2274dab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:08.084745 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45b822-c256-41c7-ad28-754a2274dab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:08.085025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45b822-c256-41c7-ad28-754a2274dab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:08.085294 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45b822-c256-41c7-ad28-754a2274dab4 admin admin] PATH_INFO: `/v3/projects/044af692ede247f68a695eeb4b44b480/users/af8f783e557a4ade86c6db50b9cbc5b1/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:08.100513 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45b822-c256-41c7-ad28-754a2274dab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044af692ede247f68a695eeb4b44b480, user_id=af8f783e557a4ade86c6db50b9cbc5b1, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:08.103110 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45b822-c256-41c7-ad28-754a2274dab4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:08.175275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 971/1927] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:08 2022] PUT /identity/v3/projects/044af692ede247f68a695eeb4b44b480/users/af8f783e557a4ade86c6db50b9cbc5b1/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:08.185628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2977f58-4c6e-4cb6-9922-e88737c2fa56 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:08.185916 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2977f58-4c6e-4cb6-9922-e88737c2fa56 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:08.186222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2977f58-4c6e-4cb6-9922-e88737c2fa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:08.212238 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b2977f58-4c6e-4cb6-9922-e88737c2fa56 None None] MFA Rules not processed for user `af8f783e557a4ade86c6db50b9cbc5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:08.213471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b2977f58-4c6e-4cb6-9922-e88737c2fa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:08.278575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 957/1928] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:08.282993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45b822-c256-41c7-ad28-754a2274dab4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:08.348232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45b822-c256-41c7-ad28-754a2274dab4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:08.352879 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa96afb-cc66-43bd-9e36-c1a61bcf1204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:08.353538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa96afb-cc66-43bd-9e36-c1a61bcf1204 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:08.353819 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa96afb-cc66-43bd-9e36-c1a61bcf1204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:08.354093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa96afb-cc66-43bd-9e36-c1a61bcf1204 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:08.355566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa96afb-cc66-43bd-9e36-c1a61bcf1204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:08.357504 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa96afb-cc66-43bd-9e36-c1a61bcf1204 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:08.439740 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 972/1929] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:08 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:08.443475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2977f58-4c6e-4cb6-9922-e88737c2fa56 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:08.455335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2977f58-4c6e-4cb6-9922-e88737c2fa56 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:08.511073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b890502-a206-4cbe-941c-243df2800768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:08.512236 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890502-a206-4cbe-941c-243df2800768 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:08.512544 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890502-a206-4cbe-941c-243df2800768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:08.512823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890502-a206-4cbe-941c-243df2800768 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:08.513516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b890502-a206-4cbe-941c-243df2800768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:08.515399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b890502-a206-4cbe-941c-243df2800768 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:08.600574 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 958/1930] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:08 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:08.604580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa96afb-cc66-43bd-9e36-c1a61bcf1204 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:08.614938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa96afb-cc66-43bd-9e36-c1a61bcf1204 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:08.619965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb618d9-83ef-4dc9-9c23-d49ebd7a6188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:08.620819 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb618d9-83ef-4dc9-9c23-d49ebd7a6188 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:08.623875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb618d9-83ef-4dc9-9c23-d49ebd7a6188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:08.623875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb618d9-83ef-4dc9-9c23-d49ebd7a6188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:08.623875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb618d9-83ef-4dc9-9c23-d49ebd7a6188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:08.623875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb618d9-83ef-4dc9-9c23-d49ebd7a6188 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:08.634459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 973/1931] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:08.639184 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b890502-a206-4cbe-941c-243df2800768 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:08.648981 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b890502-a206-4cbe-941c-243df2800768 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:08.654444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792799d-97f0-419a-8e30-16bfd6381bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:08.655324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792799d-97f0-419a-8e30-16bfd6381bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:08.655613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792799d-97f0-419a-8e30-16bfd6381bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:08.655887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792799d-97f0-419a-8e30-16bfd6381bcd admin admin] PATH_INFO: `/v3/projects/6bf8c8598984424c999ee97f42e8d56f/users/8e31574abd104748a799491e2cb5a87b/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:08.670466 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792799d-97f0-419a-8e30-16bfd6381bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf8c8598984424c999ee97f42e8d56f, user_id=8e31574abd104748a799491e2cb5a87b, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:08.673148 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792799d-97f0-419a-8e30-16bfd6381bcd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:08.778346 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 959/1932] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:08 2022] PUT /identity/v3/projects/6bf8c8598984424c999ee97f42e8d56f/users/8e31574abd104748a799491e2cb5a87b/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:08.782304 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb618d9-83ef-4dc9-9c23-d49ebd7a6188 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:08.793262 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb618d9-83ef-4dc9-9c23-d49ebd7a6188 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:08.852283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff9bd9-10b9-45eb-b0d6-07bb71e94839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:08.853014 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff9bd9-10b9-45eb-b0d6-07bb71e94839 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:08.853293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff9bd9-10b9-45eb-b0d6-07bb71e94839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:08.853648 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff9bd9-10b9-45eb-b0d6-07bb71e94839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:08.854656 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff9bd9-10b9-45eb-b0d6-07bb71e94839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:08.856631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff9bd9-10b9-45eb-b0d6-07bb71e94839 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:08.868659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 974/1933] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:08.873818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792799d-97f0-419a-8e30-16bfd6381bcd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:08.884923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792799d-97f0-419a-8e30-16bfd6381bcd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:08.890944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cbf95-4b02-43dd-8b6c-84e4f9c84ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:08.891845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cbf95-4b02-43dd-8b6c-84e4f9c84ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:08.892131 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cbf95-4b02-43dd-8b6c-84e4f9c84ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:08.892576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cbf95-4b02-43dd-8b6c-84e4f9c84ed8 admin admin] PATH_INFO: `/v3/projects/6bf8c8598984424c999ee97f42e8d56f/users/8e31574abd104748a799491e2cb5a87b/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:08.894598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cbf95-4b02-43dd-8b6c-84e4f9c84ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf8c8598984424c999ee97f42e8d56f, user_id=8e31574abd104748a799491e2cb5a87b, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:08.897524 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cbf95-4b02-43dd-8b6c-84e4f9c84ed8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:08.909179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 960/1934] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:08 2022] PUT /identity/v3/projects/6bf8c8598984424c999ee97f42e8d56f/users/8e31574abd104748a799491e2cb5a87b/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:08.924459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eb723-8831-4563-b80a-d8c9337cd5c4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:08.924760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eb723-8831-4563-b80a-d8c9337cd5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:08.925040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eb723-8831-4563-b80a-d8c9337cd5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:08.952848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-989eb723-8831-4563-b80a-d8c9337cd5c4 None None] MFA Rules not processed for user `8e31574abd104748a799491e2cb5a87b`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:08.954050 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-989eb723-8831-4563-b80a-d8c9337cd5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:09.019544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 975/1935] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:09.030433 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cbf95-4b02-43dd-8b6c-84e4f9c84ed8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:09.032141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b23cbf95-4b02-43dd-8b6c-84e4f9c84ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:09.090355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cbf95-4b02-43dd-8b6c-84e4f9c84ed8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:09.093934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2105a-ed99-4c57-b39c-41bc0c5f42d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:09.094577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2105a-ed99-4c57-b39c-41bc0c5f42d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:09.094855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2105a-ed99-4c57-b39c-41bc0c5f42d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:09.095129 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2105a-ed99-4c57-b39c-41bc0c5f42d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:09.104256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2105a-ed99-4c57-b39c-41bc0c5f42d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:09.106469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2105a-ed99-4c57-b39c-41bc0c5f42d1 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:09.115641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 961/1936] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:51:09.216316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989eb723-8831-4563-b80a-d8c9337cd5c4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:09.225799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989eb723-8831-4563-b80a-d8c9337cd5c4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:09.229952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cc5bf-fd9d-4e2f-9efc-cd843226f281 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:09.230650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cc5bf-fd9d-4e2f-9efc-cd843226f281 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:09.230931 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cc5bf-fd9d-4e2f-9efc-cd843226f281 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:09.231207 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cc5bf-fd9d-4e2f-9efc-cd843226f281 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:09.286118 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cc5bf-fd9d-4e2f-9efc-cd843226f281 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:09.287551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cc5bf-fd9d-4e2f-9efc-cd843226f281 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:09.297526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 976/1937] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:51:10.199047 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2105a-ed99-4c57-b39c-41bc0c5f42d1 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:10.206595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f4e2105a-ed99-4c57-b39c-41bc0c5f42d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:10.275262 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2105a-ed99-4c57-b39c-41bc0c5f42d1 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:10.280915 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6af520-f4ba-4225-819e-e457fec13e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:10.281830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6af520-f4ba-4225-819e-e457fec13e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:10.282109 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6af520-f4ba-4225-819e-e457fec13e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:10.282383 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6af520-f4ba-4225-819e-e457fec13e7a admin admin] PATH_INFO: `/v3/users/78718b28202446f784f9c50b58d63a60` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:10.283647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6af520-f4ba-4225-819e-e457fec13e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=78718b28202446f784f9c50b58d63a60)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:10.285928 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6af520-f4ba-4225-819e-e457fec13e7a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:10.482281 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-be6af520-f4ba-4225-819e-e457fec13e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78718b28202446f784f9c50b58d63a60'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:10.497633 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-be6af520-f4ba-4225-819e-e457fec13e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78718b28202446f784f9c50b58d63a60'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:10.575440 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-be6af520-f4ba-4225-819e-e457fec13e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78718b28202446f784f9c50b58d63a60'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:10.583326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-be6af520-f4ba-4225-819e-e457fec13e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78718b28202446f784f9c50b58d63a60'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:10.584190 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-be6af520-f4ba-4225-819e-e457fec13e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78718b28202446f784f9c50b58d63a60'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:10.591321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 962/1938] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:10 2022] DELETE /identity/v3/users/78718b28202446f784f9c50b58d63a60 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:10.600170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f89b0-5294-483a-a7c6-0ebf83f076ce None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:10.600710 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f89b0-5294-483a-a7c6-0ebf83f076ce None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:10.601208 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f89b0-5294-483a-a7c6-0ebf83f076ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:10.619982 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-cd9f89b0-5294-483a-a7c6-0ebf83f076ce None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:10.621642 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cd9f89b0-5294-483a-a7c6-0ebf83f076ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:10.700577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 977/1939] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:10.716085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6af520-f4ba-4225-819e-e457fec13e7a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:10.717686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-be6af520-f4ba-4225-819e-e457fec13e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:10.789709 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6af520-f4ba-4225-819e-e457fec13e7a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:10.795817 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d5d4d-e914-48e2-8317-7e5e75d054dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:10.796621 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d5d4d-e914-48e2-8317-7e5e75d054dc service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:10.796784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d5d4d-e914-48e2-8317-7e5e75d054dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:10.797077 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d5d4d-e914-48e2-8317-7e5e75d054dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:10.813547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d5d4d-e914-48e2-8317-7e5e75d054dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:10.815255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d5d4d-e914-48e2-8317-7e5e75d054dc service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:10.828416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 963/1940] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:51:11.249764 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f89b0-5294-483a-a7c6-0ebf83f076ce None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:11.251490 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cd9f89b0-5294-483a-a7c6-0ebf83f076ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:11.270788 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f89b0-5294-483a-a7c6-0ebf83f076ce None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:11.285242 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58516119-c4a2-4644-b473-8d890b29a76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:11.286132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58516119-c4a2-4644-b473-8d890b29a76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:11.286413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58516119-c4a2-4644-b473-8d890b29a76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:11.286686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58516119-c4a2-4644-b473-8d890b29a76e admin admin] PATH_INFO: `/v3/projects/48767fd65ba24f7895a9d996cfea5fcd` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:11.290818 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58516119-c4a2-4644-b473-8d890b29a76e admin admin] RBAC: Authorizing `identity:delete_project(project_id=48767fd65ba24f7895a9d996cfea5fcd)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:11.294694 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58516119-c4a2-4644-b473-8d890b29a76e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:11.438673 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-58516119-c4a2-4644-b473-8d890b29a76e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48767fd65ba24f7895a9d996cfea5fcd', 'request_id': 'req-58516119-c4a2-4644-b473-8d890b29a76e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:11.444125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-58516119-c4a2-4644-b473-8d890b29a76e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48767fd65ba24f7895a9d996cfea5fcd', 'request_id': 'req-58516119-c4a2-4644-b473-8d890b29a76e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:11.451077 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-58516119-c4a2-4644-b473-8d890b29a76e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48767fd65ba24f7895a9d996cfea5fcd', 'request_id': 'req-58516119-c4a2-4644-b473-8d890b29a76e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:11.518704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-58516119-c4a2-4644-b473-8d890b29a76e admin admin] The token cache is being invalidate because project 48767fd65ba24f7895a9d996cfea5fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:11.518994 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-58516119-c4a2-4644-b473-8d890b29a76e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:11.519646 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-58516119-c4a2-4644-b473-8d890b29a76e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:11.522861 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 978/1941] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:11 2022] DELETE /identity/v3/projects/48767fd65ba24f7895a9d996cfea5fcd => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:11.526051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d5d4d-e914-48e2-8317-7e5e75d054dc service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:11.545587 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d5d4d-e914-48e2-8317-7e5e75d054dc service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:11.609365 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef00d6-7548-458c-84b0-34377b92650c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:11.610371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef00d6-7548-458c-84b0-34377b92650c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:11.611056 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef00d6-7548-458c-84b0-34377b92650c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:11.611337 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef00d6-7548-458c-84b0-34377b92650c admin admin] PATH_INFO: `/v3/users/6df56e88fedf461f9dc7d3747f5ad1dc` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:11.612755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef00d6-7548-458c-84b0-34377b92650c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df56e88fedf461f9dc7d3747f5ad1dc)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:11.614674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef00d6-7548-458c-84b0-34377b92650c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:11.800574 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a7ef00d6-7548-458c-84b0-34377b92650c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df56e88fedf461f9dc7d3747f5ad1dc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:11.827007 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a7ef00d6-7548-458c-84b0-34377b92650c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df56e88fedf461f9dc7d3747f5ad1dc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:11.920314 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a7ef00d6-7548-458c-84b0-34377b92650c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df56e88fedf461f9dc7d3747f5ad1dc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:11.927666 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a7ef00d6-7548-458c-84b0-34377b92650c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df56e88fedf461f9dc7d3747f5ad1dc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:11.928368 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a7ef00d6-7548-458c-84b0-34377b92650c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df56e88fedf461f9dc7d3747f5ad1dc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:11.935639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 964/1942] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:11 2022] DELETE /identity/v3/users/6df56e88fedf461f9dc7d3747f5ad1dc => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:12.372495 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58516119-c4a2-4644-b473-8d890b29a76e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:12.373645 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-58516119-c4a2-4644-b473-8d890b29a76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:12.387467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58516119-c4a2-4644-b473-8d890b29a76e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:12.453863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c86a6-4714-4793-b5b4-b75816b8aba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:12.453863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c86a6-4714-4793-b5b4-b75816b8aba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:12.453863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c86a6-4714-4793-b5b4-b75816b8aba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:12.453863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c86a6-4714-4793-b5b4-b75816b8aba7 admin admin] PATH_INFO: `/v3/projects/3af21f31131641829e774a36c12fd69b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:12.454220 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c86a6-4714-4793-b5b4-b75816b8aba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af21f31131641829e774a36c12fd69b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:12.456650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c86a6-4714-4793-b5b4-b75816b8aba7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:12.575981 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ee0c86a6-4714-4793-b5b4-b75816b8aba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af21f31131641829e774a36c12fd69b', 'request_id': 'req-ee0c86a6-4714-4793-b5b4-b75816b8aba7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:12.581295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ee0c86a6-4714-4793-b5b4-b75816b8aba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af21f31131641829e774a36c12fd69b', 'request_id': 'req-ee0c86a6-4714-4793-b5b4-b75816b8aba7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:12.587536 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ee0c86a6-4714-4793-b5b4-b75816b8aba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af21f31131641829e774a36c12fd69b', 'request_id': 'req-ee0c86a6-4714-4793-b5b4-b75816b8aba7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:12.669639 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ee0c86a6-4714-4793-b5b4-b75816b8aba7 admin admin] The token cache is being invalidate because project 3af21f31131641829e774a36c12fd69b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:12.669996 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ee0c86a6-4714-4793-b5b4-b75816b8aba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:12.671164 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ee0c86a6-4714-4793-b5b4-b75816b8aba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:12.675638 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 979/1943] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:12 2022] DELETE /identity/v3/projects/3af21f31131641829e774a36c12fd69b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:12.677213 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef00d6-7548-458c-84b0-34377b92650c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:12.679173 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a7ef00d6-7548-458c-84b0-34377b92650c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:12.693627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef00d6-7548-458c-84b0-34377b92650c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:12.756448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2473d9-8d3b-4b10-8fff-ad4b971c315c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:12.757340 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2473d9-8d3b-4b10-8fff-ad4b971c315c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:12.757626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2473d9-8d3b-4b10-8fff-ad4b971c315c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:12.757903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2473d9-8d3b-4b10-8fff-ad4b971c315c admin admin] PATH_INFO: `/v3/users/d23aff95abd1462c8bd8037b40c857d7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:12.759086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2473d9-8d3b-4b10-8fff-ad4b971c315c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23aff95abd1462c8bd8037b40c857d7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:12.761099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2473d9-8d3b-4b10-8fff-ad4b971c315c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:13.028805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6d2473d9-8d3b-4b10-8fff-ad4b971c315c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23aff95abd1462c8bd8037b40c857d7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:13.039935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6d2473d9-8d3b-4b10-8fff-ad4b971c315c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23aff95abd1462c8bd8037b40c857d7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:13.102983 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6d2473d9-8d3b-4b10-8fff-ad4b971c315c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23aff95abd1462c8bd8037b40c857d7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:13.110158 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6d2473d9-8d3b-4b10-8fff-ad4b971c315c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23aff95abd1462c8bd8037b40c857d7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:13.110782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6d2473d9-8d3b-4b10-8fff-ad4b971c315c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23aff95abd1462c8bd8037b40c857d7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:13.116548 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 965/1944] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:12 2022] DELETE /identity/v3/users/d23aff95abd1462c8bd8037b40c857d7 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:13.549564 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c86a6-4714-4793-b5b4-b75816b8aba7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:13.551100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ee0c86a6-4714-4793-b5b4-b75816b8aba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:13.565085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c86a6-4714-4793-b5b4-b75816b8aba7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:13.622485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03a61f-5af3-4bc9-a41e-551a6874a885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:13.623655 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03a61f-5af3-4bc9-a41e-551a6874a885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:13.623940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03a61f-5af3-4bc9-a41e-551a6874a885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:13.624210 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03a61f-5af3-4bc9-a41e-551a6874a885 admin admin] PATH_INFO: `/v3/projects/15916e695efb4237971ff5d0ac14b78e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:13.625431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03a61f-5af3-4bc9-a41e-551a6874a885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15916e695efb4237971ff5d0ac14b78e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:13.627325 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03a61f-5af3-4bc9-a41e-551a6874a885 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:13.767920 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ba03a61f-5af3-4bc9-a41e-551a6874a885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15916e695efb4237971ff5d0ac14b78e', 'request_id': 'req-ba03a61f-5af3-4bc9-a41e-551a6874a885'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:13.776737 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ba03a61f-5af3-4bc9-a41e-551a6874a885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15916e695efb4237971ff5d0ac14b78e', 'request_id': 'req-ba03a61f-5af3-4bc9-a41e-551a6874a885'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:13.785435 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ba03a61f-5af3-4bc9-a41e-551a6874a885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15916e695efb4237971ff5d0ac14b78e', 'request_id': 'req-ba03a61f-5af3-4bc9-a41e-551a6874a885'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:13.871346 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ba03a61f-5af3-4bc9-a41e-551a6874a885 admin admin] The token cache is being invalidate because project 15916e695efb4237971ff5d0ac14b78e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:13.871634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ba03a61f-5af3-4bc9-a41e-551a6874a885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:13.872283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ba03a61f-5af3-4bc9-a41e-551a6874a885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:13.873909 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 980/1945] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:13 2022] DELETE /identity/v3/projects/15916e695efb4237971ff5d0ac14b78e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:13.878884 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea24ce-26c3-44dc-8f01-7aeec475da46 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:13.879338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea24ce-26c3-44dc-8f01-7aeec475da46 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:13.879520 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea24ce-26c3-44dc-8f01-7aeec475da46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:13.898461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c1ea24ce-26c3-44dc-8f01-7aeec475da46 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:13.899643 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c1ea24ce-26c3-44dc-8f01-7aeec475da46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:13.957770 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 966/1946] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:13.966404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bcd16-7b37-4264-9fdf-b6aa5802486e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:13.966695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bcd16-7b37-4264-9fdf-b6aa5802486e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:13.966969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bcd16-7b37-4264-9fdf-b6aa5802486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:13.985716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-859bcd16-7b37-4264-9fdf-b6aa5802486e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:13.986849 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-859bcd16-7b37-4264-9fdf-b6aa5802486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:13.995239 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 981/1947] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:51:13.999550 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea24ce-26c3-44dc-8f01-7aeec475da46 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:14.009484 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea24ce-26c3-44dc-8f01-7aeec475da46 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:14.014149 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a81802-e995-44a9-aa8a-5516c0c13b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:14.014953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a81802-e995-44a9-aa8a-5516c0c13b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:14.015658 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a81802-e995-44a9-aa8a-5516c0c13b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:14.016018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a81802-e995-44a9-aa8a-5516c0c13b86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:14.016803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a81802-e995-44a9-aa8a-5516c0c13b86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:51:14.017114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a81802-e995-44a9-aa8a-5516c0c13b86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:14.019264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a81802-e995-44a9-aa8a-5516c0c13b86 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:14.032793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 967/1948] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:51:14.036929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859bcd16-7b37-4264-9fdf-b6aa5802486e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:14.047349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859bcd16-7b37-4264-9fdf-b6aa5802486e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:14.052073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e15edd-0cb3-4eb4-9772-18a6b3f05664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:14.052795 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e15edd-0cb3-4eb4-9772-18a6b3f05664 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:14.053074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e15edd-0cb3-4eb4-9772-18a6b3f05664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:14.053346 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e15edd-0cb3-4eb4-9772-18a6b3f05664 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:14.054063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e15edd-0cb3-4eb4-9772-18a6b3f05664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:14.056077 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e15edd-0cb3-4eb4-9772-18a6b3f05664 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:14.152098 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 982/1949] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:14 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:14.162127 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a81802-e995-44a9-aa8a-5516c0c13b86 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:14.167545 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a81802-e995-44a9-aa8a-5516c0c13b86 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:14.237056 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bd424-cd55-491a-a470-a228888d65b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:14.237244 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bd424-cd55-491a-a470-a228888d65b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:14.237530 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bd424-cd55-491a-a470-a228888d65b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:14.237809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bd424-cd55-491a-a470-a228888d65b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:14.238635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bd424-cd55-491a-a470-a228888d65b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:14.240687 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bd424-cd55-491a-a470-a228888d65b5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:14.320812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 968/1950] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:14 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:14.325780 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e15edd-0cb3-4eb4-9772-18a6b3f05664 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:14.336302 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e15edd-0cb3-4eb4-9772-18a6b3f05664 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:14.341059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e17c6-505a-43ed-bb22-73dc6b48fae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:14.341768 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e17c6-505a-43ed-bb22-73dc6b48fae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:14.342024 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e17c6-505a-43ed-bb22-73dc6b48fae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:14.342302 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e17c6-505a-43ed-bb22-73dc6b48fae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:14.343070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e17c6-505a-43ed-bb22-73dc6b48fae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:14.344683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e17c6-505a-43ed-bb22-73dc6b48fae8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:14.358557 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 983/1951] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:14.360158 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bd424-cd55-491a-a470-a228888d65b5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:14.370015 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bd424-cd55-491a-a470-a228888d65b5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:14.375464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e487dd8-ea72-42fb-bc48-4ba57d1d09b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:14.376275 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e487dd8-ea72-42fb-bc48-4ba57d1d09b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:14.376594 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e487dd8-ea72-42fb-bc48-4ba57d1d09b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:14.376875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e487dd8-ea72-42fb-bc48-4ba57d1d09b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:14.377610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e487dd8-ea72-42fb-bc48-4ba57d1d09b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:14.379229 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e487dd8-ea72-42fb-bc48-4ba57d1d09b1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:14.389758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 969/1952] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:51:14.393903 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e17c6-505a-43ed-bb22-73dc6b48fae8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:14.404571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e17c6-505a-43ed-bb22-73dc6b48fae8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:14.409265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdefeb7-fa70-40c6-bfe1-4f8763d2df58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:14.410134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdefeb7-fa70-40c6-bfe1-4f8763d2df58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:14.410414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdefeb7-fa70-40c6-bfe1-4f8763d2df58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:14.410690 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdefeb7-fa70-40c6-bfe1-4f8763d2df58 admin admin] PATH_INFO: `/v3/projects/85b3637ef71a4b5fb8daa143b76f221d/users/614d02bec88b4e079a4d7dce9c29c227/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:14.425431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdefeb7-fa70-40c6-bfe1-4f8763d2df58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b3637ef71a4b5fb8daa143b76f221d, user_id=614d02bec88b4e079a4d7dce9c29c227, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:14.428046 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdefeb7-fa70-40c6-bfe1-4f8763d2df58 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:14.526273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 984/1953] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:14 2022] PUT /identity/v3/projects/85b3637ef71a4b5fb8daa143b76f221d/users/614d02bec88b4e079a4d7dce9c29c227/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:14.537642 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae1adb-6739-40ab-a590-7bb8573c16bf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:14.537930 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae1adb-6739-40ab-a590-7bb8573c16bf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:14.538206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae1adb-6739-40ab-a590-7bb8573c16bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:14.573231 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-22ae1adb-6739-40ab-a590-7bb8573c16bf None None] MFA Rules not processed for user `614d02bec88b4e079a4d7dce9c29c227`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:14.575129 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-22ae1adb-6739-40ab-a590-7bb8573c16bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:14.653676 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 970/1954] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:14.665161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdefeb7-fa70-40c6-bfe1-4f8763d2df58 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:14.667284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3cdefeb7-fa70-40c6-bfe1-4f8763d2df58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:14.741491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdefeb7-fa70-40c6-bfe1-4f8763d2df58 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:14.745154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7284e-8dab-4a2c-bcf6-56ff0f57d04a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8e2eb70a5d4dd1b3a9bec2bd0a78a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:14.746495 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7284e-8dab-4a2c-bcf6-56ff0f57d04a service glance] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:14.746773 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7284e-8dab-4a2c-bcf6-56ff0f57d04a service glance] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:14.747045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7284e-8dab-4a2c-bcf6-56ff0f57d04a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:14.755532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7284e-8dab-4a2c-bcf6-56ff0f57d04a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:14.757006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7284e-8dab-4a2c-bcf6-56ff0f57d04a service glance] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:14.766892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 985/1955] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:51:16.889344 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae1adb-6739-40ab-a590-7bb8573c16bf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:16.890798 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-22ae1adb-6739-40ab-a590-7bb8573c16bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:16.962686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae1adb-6739-40ab-a590-7bb8573c16bf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:16.968482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949feb32-1ad0-447d-bde9-ad50595b6f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:16.969403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949feb32-1ad0-447d-bde9-ad50595b6f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:16.969703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949feb32-1ad0-447d-bde9-ad50595b6f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:16.969967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949feb32-1ad0-447d-bde9-ad50595b6f05 admin admin] PATH_INFO: `/v3/users/af8f783e557a4ade86c6db50b9cbc5b1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:16.971388 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949feb32-1ad0-447d-bde9-ad50595b6f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8f783e557a4ade86c6db50b9cbc5b1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:16.973536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949feb32-1ad0-447d-bde9-ad50595b6f05 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:17.267633 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-949feb32-1ad0-447d-bde9-ad50595b6f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8f783e557a4ade86c6db50b9cbc5b1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:17.278899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-949feb32-1ad0-447d-bde9-ad50595b6f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8f783e557a4ade86c6db50b9cbc5b1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:17.383823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-949feb32-1ad0-447d-bde9-ad50595b6f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8f783e557a4ade86c6db50b9cbc5b1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:17.395403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-949feb32-1ad0-447d-bde9-ad50595b6f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8f783e557a4ade86c6db50b9cbc5b1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:17.397366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-949feb32-1ad0-447d-bde9-ad50595b6f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8f783e557a4ade86c6db50b9cbc5b1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:17.414175 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 971/1956] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:16 2022] DELETE /identity/v3/users/af8f783e557a4ade86c6db50b9cbc5b1 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:17.420163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892ee68-83e7-4e8c-b108-d89c5ee10d7e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:17.420163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892ee68-83e7-4e8c-b108-d89c5ee10d7e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:17.421058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892ee68-83e7-4e8c-b108-d89c5ee10d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:17.453268 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8892ee68-83e7-4e8c-b108-d89c5ee10d7e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:17.454598 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8892ee68-83e7-4e8c-b108-d89c5ee10d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:17.515591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 986/1957] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:17.524853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949feb32-1ad0-447d-bde9-ad50595b6f05 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:17.530835 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-949feb32-1ad0-447d-bde9-ad50595b6f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:17.623101 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949feb32-1ad0-447d-bde9-ad50595b6f05 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:17.628929 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfef06-ffa4-45ff-be84-f6b0d12d9403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:17.629955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfef06-ffa4-45ff-be84-f6b0d12d9403 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:17.630221 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfef06-ffa4-45ff-be84-f6b0d12d9403 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:17.630490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfef06-ffa4-45ff-be84-f6b0d12d9403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:17.641224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfef06-ffa4-45ff-be84-f6b0d12d9403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:17.643108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfef06-ffa4-45ff-be84-f6b0d12d9403 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:17.654406 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 972/1958] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:51:18.115362 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892ee68-83e7-4e8c-b108-d89c5ee10d7e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:18.116796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8892ee68-83e7-4e8c-b108-d89c5ee10d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:18.130709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892ee68-83e7-4e8c-b108-d89c5ee10d7e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:18.135477 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acbba7-70ac-4ae6-9770-3624ad95460d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:18.136336 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acbba7-70ac-4ae6-9770-3624ad95460d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:18.136648 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acbba7-70ac-4ae6-9770-3624ad95460d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:18.136923 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acbba7-70ac-4ae6-9770-3624ad95460d admin admin] PATH_INFO: `/v3/projects/044af692ede247f68a695eeb4b44b480` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:18.138792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acbba7-70ac-4ae6-9770-3624ad95460d admin admin] RBAC: Authorizing `identity:delete_project(project_id=044af692ede247f68a695eeb4b44b480)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:18.146224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acbba7-70ac-4ae6-9770-3624ad95460d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:18.244752 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-16acbba7-70ac-4ae6-9770-3624ad95460d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044af692ede247f68a695eeb4b44b480', 'request_id': 'req-16acbba7-70ac-4ae6-9770-3624ad95460d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:18.250724 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-16acbba7-70ac-4ae6-9770-3624ad95460d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044af692ede247f68a695eeb4b44b480', 'request_id': 'req-16acbba7-70ac-4ae6-9770-3624ad95460d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:18.256711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-16acbba7-70ac-4ae6-9770-3624ad95460d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044af692ede247f68a695eeb4b44b480', 'request_id': 'req-16acbba7-70ac-4ae6-9770-3624ad95460d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:18.366016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-16acbba7-70ac-4ae6-9770-3624ad95460d admin admin] The token cache is being invalidate because project 044af692ede247f68a695eeb4b44b480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:18.366238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-16acbba7-70ac-4ae6-9770-3624ad95460d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:18.366877 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-16acbba7-70ac-4ae6-9770-3624ad95460d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:18.368487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 987/1959] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:18 2022] DELETE /identity/v3/projects/044af692ede247f68a695eeb4b44b480 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:18.372689 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfef06-ffa4-45ff-be84-f6b0d12d9403 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:18.382336 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfef06-ffa4-45ff-be84-f6b0d12d9403 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:18.437478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d4a04-c828-4449-af84-535de22e3a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:18.438356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4a04-c828-4449-af84-535de22e3a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:18.438684 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4a04-c828-4449-af84-535de22e3a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:18.438963 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4a04-c828-4449-af84-535de22e3a8a admin admin] PATH_INFO: `/v3/users/8e31574abd104748a799491e2cb5a87b` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:18.440156 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d4a04-c828-4449-af84-535de22e3a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e31574abd104748a799491e2cb5a87b)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:18.442355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d4a04-c828-4449-af84-535de22e3a8a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:18.626933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e84d4a04-c828-4449-af84-535de22e3a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e31574abd104748a799491e2cb5a87b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:18.639285 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e84d4a04-c828-4449-af84-535de22e3a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e31574abd104748a799491e2cb5a87b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:18.701851 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e84d4a04-c828-4449-af84-535de22e3a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e31574abd104748a799491e2cb5a87b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:18.709661 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e84d4a04-c828-4449-af84-535de22e3a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e31574abd104748a799491e2cb5a87b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:18.710422 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e84d4a04-c828-4449-af84-535de22e3a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e31574abd104748a799491e2cb5a87b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:18.717389 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 973/1960] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:18 2022] DELETE /identity/v3/users/8e31574abd104748a799491e2cb5a87b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:51:19.116927 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acbba7-70ac-4ae6-9770-3624ad95460d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:19.118559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-16acbba7-70ac-4ae6-9770-3624ad95460d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:19.134102 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acbba7-70ac-4ae6-9770-3624ad95460d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:19.194741 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542fa17-8af5-41cf-8332-4583c5f81999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:19.195609 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542fa17-8af5-41cf-8332-4583c5f81999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:19.195891 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542fa17-8af5-41cf-8332-4583c5f81999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:19.196164 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542fa17-8af5-41cf-8332-4583c5f81999 admin admin] PATH_INFO: `/v3/projects/6bf8c8598984424c999ee97f42e8d56f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:19.197374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542fa17-8af5-41cf-8332-4583c5f81999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf8c8598984424c999ee97f42e8d56f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:19.199333 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542fa17-8af5-41cf-8332-4583c5f81999 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:19.313199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8542fa17-8af5-41cf-8332-4583c5f81999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf8c8598984424c999ee97f42e8d56f', 'request_id': 'req-8542fa17-8af5-41cf-8332-4583c5f81999'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:19.318829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8542fa17-8af5-41cf-8332-4583c5f81999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf8c8598984424c999ee97f42e8d56f', 'request_id': 'req-8542fa17-8af5-41cf-8332-4583c5f81999'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:19.325100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8542fa17-8af5-41cf-8332-4583c5f81999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf8c8598984424c999ee97f42e8d56f', 'request_id': 'req-8542fa17-8af5-41cf-8332-4583c5f81999'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:19.417815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8542fa17-8af5-41cf-8332-4583c5f81999 admin admin] The token cache is being invalidate because project 6bf8c8598984424c999ee97f42e8d56f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:19.418007 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8542fa17-8af5-41cf-8332-4583c5f81999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:19.420462 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8542fa17-8af5-41cf-8332-4583c5f81999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:19.422878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 988/1961] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:19 2022] DELETE /identity/v3/projects/6bf8c8598984424c999ee97f42e8d56f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:19.429755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a96ce-da77-4b2b-891c-ccaa16ae66f1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:19.430283 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a96ce-da77-4b2b-891c-ccaa16ae66f1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:19.430784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a96ce-da77-4b2b-891c-ccaa16ae66f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:19.463909 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0e5a96ce-da77-4b2b-891c-ccaa16ae66f1 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:19.465645 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0e5a96ce-da77-4b2b-891c-ccaa16ae66f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:19.546379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 974/1962] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:19.555103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2b6ed-bb55-490d-a4c6-3b25035dae4d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:19.555396 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2b6ed-bb55-490d-a4c6-3b25035dae4d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:19.555674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2b6ed-bb55-490d-a4c6-3b25035dae4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:19.584687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9bd2b6ed-bb55-490d-a4c6-3b25035dae4d None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:19.585905 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9bd2b6ed-bb55-490d-a4c6-3b25035dae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:19.596489 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 989/1963] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:19.606813 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a96ce-da77-4b2b-891c-ccaa16ae66f1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:19.616660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a96ce-da77-4b2b-891c-ccaa16ae66f1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:19.621428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61f10b-6a6f-4881-9ba2-711860628c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:19.622551 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61f10b-6a6f-4881-9ba2-711860628c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:19.622993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61f10b-6a6f-4881-9ba2-711860628c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:19.623284 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61f10b-6a6f-4881-9ba2-711860628c20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:19.624030 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61f10b-6a6f-4881-9ba2-711860628c20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:51:19.624336 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61f10b-6a6f-4881-9ba2-711860628c20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:19.625978 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61f10b-6a6f-4881-9ba2-711860628c20 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:19.643593 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 975/1964] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:51:19.644856 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2b6ed-bb55-490d-a4c6-3b25035dae4d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:19.655434 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2b6ed-bb55-490d-a4c6-3b25035dae4d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:19.660087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714b807-9b90-4d7e-871b-dae9b8223abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:19.660760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714b807-9b90-4d7e-871b-dae9b8223abd admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:19.661040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714b807-9b90-4d7e-871b-dae9b8223abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:19.661311 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714b807-9b90-4d7e-871b-dae9b8223abd admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:19.662004 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714b807-9b90-4d7e-871b-dae9b8223abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:19.663896 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714b807-9b90-4d7e-871b-dae9b8223abd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:19.769137 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 990/1965] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:19 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:19.773308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61f10b-6a6f-4881-9ba2-711860628c20 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:19.783917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61f10b-6a6f-4881-9ba2-711860628c20 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:19.839645 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7311d12-ad5f-4ee2-bb1b-7fc84e47f4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:19.841334 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7311d12-ad5f-4ee2-bb1b-7fc84e47f4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:19.841453 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7311d12-ad5f-4ee2-bb1b-7fc84e47f4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:19.841856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7311d12-ad5f-4ee2-bb1b-7fc84e47f4a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:19.842574 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7311d12-ad5f-4ee2-bb1b-7fc84e47f4a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:19.844587 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7311d12-ad5f-4ee2-bb1b-7fc84e47f4a5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:19.936819 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 976/1966] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:19 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:19.937863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714b807-9b90-4d7e-871b-dae9b8223abd admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:19.950710 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714b807-9b90-4d7e-871b-dae9b8223abd admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:19.955475 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ded530-0bba-4d3d-bcff-b25c169b019c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:19.956119 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ded530-0bba-4d3d-bcff-b25c169b019c admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:19.956398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ded530-0bba-4d3d-bcff-b25c169b019c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:19.956713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ded530-0bba-4d3d-bcff-b25c169b019c admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:19.957442 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ded530-0bba-4d3d-bcff-b25c169b019c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:19.959028 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ded530-0bba-4d3d-bcff-b25c169b019c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:19.970278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 991/1967] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:19.974437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7311d12-ad5f-4ee2-bb1b-7fc84e47f4a5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:19.985408 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7311d12-ad5f-4ee2-bb1b-7fc84e47f4a5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:19.990321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23ee5f-d2a0-4da7-b0f1-8170742a4e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:19.991008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23ee5f-d2a0-4da7-b0f1-8170742a4e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:19.991292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23ee5f-d2a0-4da7-b0f1-8170742a4e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:19.991566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23ee5f-d2a0-4da7-b0f1-8170742a4e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:19.992290 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23ee5f-d2a0-4da7-b0f1-8170742a4e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:19.993907 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23ee5f-d2a0-4da7-b0f1-8170742a4e81 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:20.003430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 977/1968] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:51:20.007437 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ded530-0bba-4d3d-bcff-b25c169b019c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:20.017142 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ded530-0bba-4d3d-bcff-b25c169b019c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:20.022391 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a302f29-7d2b-4203-83c5-5407521d8c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:20.023674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a302f29-7d2b-4203-83c5-5407521d8c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:20.024000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a302f29-7d2b-4203-83c5-5407521d8c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:20.024241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a302f29-7d2b-4203-83c5-5407521d8c0b admin admin] PATH_INFO: `/v3/projects/5e89d4c345c649ca8c10016ed908e483/users/279b0a188f344f62be2cc7d4ac278194/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:20.041267 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a302f29-7d2b-4203-83c5-5407521d8c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e89d4c345c649ca8c10016ed908e483, user_id=279b0a188f344f62be2cc7d4ac278194, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:20.044761 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a302f29-7d2b-4203-83c5-5407521d8c0b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:20.132365 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 992/1969] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:20 2022] PUT /identity/v3/projects/5e89d4c345c649ca8c10016ed908e483/users/279b0a188f344f62be2cc7d4ac278194/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:20.142623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d87b3-94fe-42d9-8cdd-8fcb1bc76a9c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:20.142918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d87b3-94fe-42d9-8cdd-8fcb1bc76a9c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:20.143205 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d87b3-94fe-42d9-8cdd-8fcb1bc76a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:20.170599 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b65d87b3-94fe-42d9-8cdd-8fcb1bc76a9c None None] MFA Rules not processed for user `279b0a188f344f62be2cc7d4ac278194`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:20.171805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b65d87b3-94fe-42d9-8cdd-8fcb1bc76a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:20.234871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 978/1970] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:20.245209 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a302f29-7d2b-4203-83c5-5407521d8c0b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:20.247525 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2a302f29-7d2b-4203-83c5-5407521d8c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:20.303052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a302f29-7d2b-4203-83c5-5407521d8c0b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:20.307034 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c771c-1a94-4f98-80a1-fba5f6b9de57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:20.307699 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c771c-1a94-4f98-80a1-fba5f6b9de57 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:20.307980 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c771c-1a94-4f98-80a1-fba5f6b9de57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:20.308256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c771c-1a94-4f98-80a1-fba5f6b9de57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:20.318076 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c771c-1a94-4f98-80a1-fba5f6b9de57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:20.319500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c771c-1a94-4f98-80a1-fba5f6b9de57 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:20.329409 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 993/1971] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:51:25.237856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e5903-430c-4751-b733-466a3aa42324 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:25.238872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e5903-430c-4751-b733-466a3aa42324 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:25.238872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e5903-430c-4751-b733-466a3aa42324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:25.259111 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5f4e5903-430c-4751-b733-466a3aa42324 None None] MFA Rules not processed for user `279b0a188f344f62be2cc7d4ac278194`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:25.260394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5f4e5903-430c-4751-b733-466a3aa42324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:25.268303 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 979/1972] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:27.167728 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c771c-1a94-4f98-80a1-fba5f6b9de57 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:27.167728 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dc7c771c-1a94-4f98-80a1-fba5f6b9de57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:27.238558 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c771c-1a94-4f98-80a1-fba5f6b9de57 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:27.244383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a1561-ce0f-4436-a68d-98f5fe0f04d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:27.245285 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a1561-ce0f-4436-a68d-98f5fe0f04d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:27.245608 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a1561-ce0f-4436-a68d-98f5fe0f04d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:27.246120 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a1561-ce0f-4436-a68d-98f5fe0f04d7 admin admin] PATH_INFO: `/v3/users/f0f8cb60eb22499db31259081123d47b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:27.247703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a1561-ce0f-4436-a68d-98f5fe0f04d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0f8cb60eb22499db31259081123d47b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:27.250092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a1561-ce0f-4436-a68d-98f5fe0f04d7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:27.451426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bb1a1561-ce0f-4436-a68d-98f5fe0f04d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0f8cb60eb22499db31259081123d47b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:27.536496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bb1a1561-ce0f-4436-a68d-98f5fe0f04d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0f8cb60eb22499db31259081123d47b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:27.537169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bb1a1561-ce0f-4436-a68d-98f5fe0f04d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0f8cb60eb22499db31259081123d47b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:27.547262 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bb1a1561-ce0f-4436-a68d-98f5fe0f04d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0f8cb60eb22499db31259081123d47b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:27.559417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bb1a1561-ce0f-4436-a68d-98f5fe0f04d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0f8cb60eb22499db31259081123d47b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:27.566334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 994/1973] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:27 2022] DELETE /identity/v3/users/f0f8cb60eb22499db31259081123d47b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:27.892843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e5903-430c-4751-b733-466a3aa42324 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:27.907715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e5903-430c-4751-b733-466a3aa42324 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:27.978146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f71a17-da59-4c6e-b4cb-63f57a8e85a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:27.979149 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f71a17-da59-4c6e-b4cb-63f57a8e85a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:27.979612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f71a17-da59-4c6e-b4cb-63f57a8e85a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:27.979982 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f71a17-da59-4c6e-b4cb-63f57a8e85a5 admin admin] PATH_INFO: `/v3/projects/315bc11153674d80b7583a9e12aa7403` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:27.981416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f71a17-da59-4c6e-b4cb-63f57a8e85a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=315bc11153674d80b7583a9e12aa7403)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:27.983586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f71a17-da59-4c6e-b4cb-63f57a8e85a5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:28.153870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-05f71a17-da59-4c6e-b4cb-63f57a8e85a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315bc11153674d80b7583a9e12aa7403', 'request_id': 'req-05f71a17-da59-4c6e-b4cb-63f57a8e85a5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:28.160019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-05f71a17-da59-4c6e-b4cb-63f57a8e85a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315bc11153674d80b7583a9e12aa7403', 'request_id': 'req-05f71a17-da59-4c6e-b4cb-63f57a8e85a5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:28.241522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-05f71a17-da59-4c6e-b4cb-63f57a8e85a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315bc11153674d80b7583a9e12aa7403', 'request_id': 'req-05f71a17-da59-4c6e-b4cb-63f57a8e85a5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:28.258560 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-05f71a17-da59-4c6e-b4cb-63f57a8e85a5 admin admin] The token cache is being invalidate because project 315bc11153674d80b7583a9e12aa7403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:28.259111 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-05f71a17-da59-4c6e-b4cb-63f57a8e85a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:28.259791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-05f71a17-da59-4c6e-b4cb-63f57a8e85a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:28.261937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 980/1974] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:27 2022] DELETE /identity/v3/projects/315bc11153674d80b7583a9e12aa7403 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:28.266928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdd743-ccab-486e-bb88-026d6aeeb626 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:28.267387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdd743-ccab-486e-bb88-026d6aeeb626 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:28.267707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdd743-ccab-486e-bb88-026d6aeeb626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:28.308928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-68cdd743-ccab-486e-bb88-026d6aeeb626 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:28.311417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-68cdd743-ccab-486e-bb88-026d6aeeb626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:28.385107 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 995/1975] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:28.393458 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268b9cc-547d-4f9e-864c-e318676d3da0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:28.393735 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268b9cc-547d-4f9e-864c-e318676d3da0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:28.394033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268b9cc-547d-4f9e-864c-e318676d3da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:28.414408 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2268b9cc-547d-4f9e-864c-e318676d3da0 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:28.415667 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2268b9cc-547d-4f9e-864c-e318676d3da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:28.425641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 981/1976] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:28.430164 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdd743-ccab-486e-bb88-026d6aeeb626 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:28.443114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdd743-ccab-486e-bb88-026d6aeeb626 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:28.449158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2d17d-459b-43ed-964b-fe47fd82cf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:28.449997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d17d-459b-43ed-964b-fe47fd82cf11 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:28.450508 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d17d-459b-43ed-964b-fe47fd82cf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:28.451068 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d17d-459b-43ed-964b-fe47fd82cf11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:28.454706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2d17d-459b-43ed-964b-fe47fd82cf11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:51:28.454706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2d17d-459b-43ed-964b-fe47fd82cf11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:28.454706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2d17d-459b-43ed-964b-fe47fd82cf11 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:28.457348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268b9cc-547d-4f9e-864c-e318676d3da0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:28.460565 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2268b9cc-547d-4f9e-864c-e318676d3da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:28.473418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 996/1977] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:51:28.474651 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2d17d-459b-43ed-964b-fe47fd82cf11 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:28.478262 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268b9cc-547d-4f9e-864c-e318676d3da0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:28.491085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2d17d-459b-43ed-964b-fe47fd82cf11 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:28.491450 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914e20a-dc53-480b-b268-7ceba71e9aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:28.492348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914e20a-dc53-480b-b268-7ceba71e9aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:28.492668 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914e20a-dc53-480b-b268-7ceba71e9aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:28.492949 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914e20a-dc53-480b-b268-7ceba71e9aad admin admin] PATH_INFO: `/v3/users/0141b021a89f4337833fe0ef2bf2c206` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:28.494215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914e20a-dc53-480b-b268-7ceba71e9aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0141b021a89f4337833fe0ef2bf2c206)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:28.496163 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914e20a-dc53-480b-b268-7ceba71e9aad admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:28.498512 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb74460-1845-4ea9-8969-7d56bfb4f10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:28.500743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb74460-1845-4ea9-8969-7d56bfb4f10d admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:28.500743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb74460-1845-4ea9-8969-7d56bfb4f10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:28.500743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb74460-1845-4ea9-8969-7d56bfb4f10d admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:28.500743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb74460-1845-4ea9-8969-7d56bfb4f10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:28.503094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb74460-1845-4ea9-8969-7d56bfb4f10d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:28.626450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 997/1978] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:28 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:51:28.630620 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb74460-1845-4ea9-8969-7d56bfb4f10d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:28.695946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb74460-1845-4ea9-8969-7d56bfb4f10d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:28.701520 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec7f98-3b3b-49e3-8bc3-9d38cc5d1022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:28.702192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7f98-3b3b-49e3-8bc3-9d38cc5d1022 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:28.702472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7f98-3b3b-49e3-8bc3-9d38cc5d1022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:28.702749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7f98-3b3b-49e3-8bc3-9d38cc5d1022 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:28.703443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec7f98-3b3b-49e3-8bc3-9d38cc5d1022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:28.705492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec7f98-3b3b-49e3-8bc3-9d38cc5d1022 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:28.764117 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c914e20a-dc53-480b-b268-7ceba71e9aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0141b021a89f4337833fe0ef2bf2c206'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:28.775515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c914e20a-dc53-480b-b268-7ceba71e9aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0141b021a89f4337833fe0ef2bf2c206'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:28.862232 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c914e20a-dc53-480b-b268-7ceba71e9aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0141b021a89f4337833fe0ef2bf2c206'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:28.872270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 998/1979] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:28 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:28.873647 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c914e20a-dc53-480b-b268-7ceba71e9aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0141b021a89f4337833fe0ef2bf2c206'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:28.873790 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec7f98-3b3b-49e3-8bc3-9d38cc5d1022 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:28.874644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c914e20a-dc53-480b-b268-7ceba71e9aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0141b021a89f4337833fe0ef2bf2c206'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:28.881843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 982/1980] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:28 2022] DELETE /identity/v3/users/0141b021a89f4337833fe0ef2bf2c206 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:28.884060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec7f98-3b3b-49e3-8bc3-9d38cc5d1022 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:28.886022 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ad4e9-9a51-4380-8987-ff4789481aa3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:28.886522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ad4e9-9a51-4380-8987-ff4789481aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:28.886875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ad4e9-9a51-4380-8987-ff4789481aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:28.914655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-680ad4e9-9a51-4380-8987-ff4789481aa3 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:28.915858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-680ad4e9-9a51-4380-8987-ff4789481aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:28.949096 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103449f0-da44-4340-b39e-ed07ea8d9274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:28.949924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103449f0-da44-4340-b39e-ed07ea8d9274 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:28.951088 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103449f0-da44-4340-b39e-ed07ea8d9274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:28.951377 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103449f0-da44-4340-b39e-ed07ea8d9274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:28.952117 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103449f0-da44-4340-b39e-ed07ea8d9274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:28.953757 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103449f0-da44-4340-b39e-ed07ea8d9274 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:28.964317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 999/1981] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:28.969788 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103449f0-da44-4340-b39e-ed07ea8d9274 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:28.971589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-103449f0-da44-4340-b39e-ed07ea8d9274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:28.985152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103449f0-da44-4340-b39e-ed07ea8d9274 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:28.986607 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 983/1982] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:28.990266 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acadb07-7cbf-4f70-87ba-84713ceea097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:28.990948 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acadb07-7cbf-4f70-87ba-84713ceea097 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:28.991241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acadb07-7cbf-4f70-87ba-84713ceea097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:28.991510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acadb07-7cbf-4f70-87ba-84713ceea097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:28.992234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acadb07-7cbf-4f70-87ba-84713ceea097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:28.993875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acadb07-7cbf-4f70-87ba-84713ceea097 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:28.996423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ad4e9-9a51-4380-8987-ff4789481aa3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:29.000913 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-680ad4e9-9a51-4380-8987-ff4789481aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:29.004377 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1000/1983] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:29.009043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acadb07-7cbf-4f70-87ba-84713ceea097 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:29.020073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acadb07-7cbf-4f70-87ba-84713ceea097 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:29.031531 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e33d74-0e1c-4081-84d2-536e6680d295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:29.031972 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e33d74-0e1c-4081-84d2-536e6680d295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:29.032394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e33d74-0e1c-4081-84d2-536e6680d295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:29.032910 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e33d74-0e1c-4081-84d2-536e6680d295 admin admin] PATH_INFO: `/v3/projects/4fb5955a770341b28fa73947bd6346ed/users/546c3447688f473fb256f4bc3dd99188/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:29.065437 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e33d74-0e1c-4081-84d2-536e6680d295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb5955a770341b28fa73947bd6346ed, user_id=546c3447688f473fb256f4bc3dd99188, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:29.068470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e33d74-0e1c-4081-84d2-536e6680d295 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:29.088777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ad4e9-9a51-4380-8987-ff4789481aa3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:29.094972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724e83c-d192-4a33-849c-cbefa1d46d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:29.095818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e83c-d192-4a33-849c-cbefa1d46d60 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:29.096211 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e83c-d192-4a33-849c-cbefa1d46d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:29.096789 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e83c-d192-4a33-849c-cbefa1d46d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:29.117686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724e83c-d192-4a33-849c-cbefa1d46d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:29.119219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724e83c-d192-4a33-849c-cbefa1d46d60 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:29.133092 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 984/1984] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:51:29.148483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1001/1985] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:29 2022] PUT /identity/v3/projects/4fb5955a770341b28fa73947bd6346ed/users/546c3447688f473fb256f4bc3dd99188/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:51:29.155084 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a9704-d37f-4b35-a5ab-d371c59b0041 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:29.156582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a9704-d37f-4b35-a5ab-d371c59b0041 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:29.157000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a9704-d37f-4b35-a5ab-d371c59b0041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:29.179703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2f8a9704-d37f-4b35-a5ab-d371c59b0041 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:29.181221 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2f8a9704-d37f-4b35-a5ab-d371c59b0041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:29.245147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 985/1986] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:29.255709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e33d74-0e1c-4081-84d2-536e6680d295 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:29.257505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b7e33d74-0e1c-4081-84d2-536e6680d295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:29.354031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e33d74-0e1c-4081-84d2-536e6680d295 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:29.365148 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3a27d-ea19-4904-8f0f-a59339d4e42f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:29.365410 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a27d-ea19-4904-8f0f-a59339d4e42f service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:29.365753 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a27d-ea19-4904-8f0f-a59339d4e42f service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:29.366677 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a27d-ea19-4904-8f0f-a59339d4e42f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:29.377544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3a27d-ea19-4904-8f0f-a59339d4e42f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:29.378995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3a27d-ea19-4904-8f0f-a59339d4e42f service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:29.396334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1002/1987] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:51:29.849690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a9704-d37f-4b35-a5ab-d371c59b0041 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:29.851796 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2f8a9704-d37f-4b35-a5ab-d371c59b0041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:29.867779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a9704-d37f-4b35-a5ab-d371c59b0041 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:29.873755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eea779-f1ae-490f-92da-34689ee73a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:29.874798 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eea779-f1ae-490f-92da-34689ee73a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:29.875278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eea779-f1ae-490f-92da-34689ee73a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:29.880826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eea779-f1ae-490f-92da-34689ee73a87 admin admin] PATH_INFO: `/v3/projects/8ae10404eb4c45889b684d3ec230227f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:29.880826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eea779-f1ae-490f-92da-34689ee73a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae10404eb4c45889b684d3ec230227f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:29.880826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eea779-f1ae-490f-92da-34689ee73a87 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:30.004717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-73eea779-f1ae-490f-92da-34689ee73a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae10404eb4c45889b684d3ec230227f', 'request_id': 'req-73eea779-f1ae-490f-92da-34689ee73a87'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:30.010332 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-73eea779-f1ae-490f-92da-34689ee73a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae10404eb4c45889b684d3ec230227f', 'request_id': 'req-73eea779-f1ae-490f-92da-34689ee73a87'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:30.102080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-73eea779-f1ae-490f-92da-34689ee73a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae10404eb4c45889b684d3ec230227f', 'request_id': 'req-73eea779-f1ae-490f-92da-34689ee73a87'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:30.114514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-73eea779-f1ae-490f-92da-34689ee73a87 admin admin] The token cache is being invalidate because project 8ae10404eb4c45889b684d3ec230227f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:30.115130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-73eea779-f1ae-490f-92da-34689ee73a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:30.115963 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-73eea779-f1ae-490f-92da-34689ee73a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:30.117575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 986/1988] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:29 2022] DELETE /identity/v3/projects/8ae10404eb4c45889b684d3ec230227f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:30.121641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3a27d-ea19-4904-8f0f-a59339d4e42f service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:30.151960 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3a27d-ea19-4904-8f0f-a59339d4e42f service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:30.224327 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d23588-4cb1-468e-8a82-df2b6bb08c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:30.225232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d23588-4cb1-468e-8a82-df2b6bb08c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:30.225515 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d23588-4cb1-468e-8a82-df2b6bb08c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:30.225793 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d23588-4cb1-468e-8a82-df2b6bb08c2e admin admin] PATH_INFO: `/v3/users/cda88f2993e04496842dc48facf21409` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:30.227151 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d23588-4cb1-468e-8a82-df2b6bb08c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda88f2993e04496842dc48facf21409)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:30.229165 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d23588-4cb1-468e-8a82-df2b6bb08c2e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:30.410932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eea779-f1ae-490f-92da-34689ee73a87 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:30.413689 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-73eea779-f1ae-490f-92da-34689ee73a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:30.442642 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eea779-f1ae-490f-92da-34689ee73a87 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:30.460106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ad918-e970-4328-9329-67f257d55fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:30.462690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ad918-e970-4328-9329-67f257d55fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:30.463315 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ad918-e970-4328-9329-67f257d55fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:30.464383 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ad918-e970-4328-9329-67f257d55fd7 admin admin] PATH_INFO: `/v3/users/57b9a208a17641919153ba9b95a49b58` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:30.467165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ad918-e970-4328-9329-67f257d55fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b9a208a17641919153ba9b95a49b58)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:30.470134 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ad918-e970-4328-9329-67f257d55fd7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:30.484678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-76d23588-4cb1-468e-8a82-df2b6bb08c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda88f2993e04496842dc48facf21409'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:30.580027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-76d23588-4cb1-468e-8a82-df2b6bb08c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda88f2993e04496842dc48facf21409'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:30.582159 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-76d23588-4cb1-468e-8a82-df2b6bb08c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda88f2993e04496842dc48facf21409'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:30.592109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-76d23588-4cb1-468e-8a82-df2b6bb08c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda88f2993e04496842dc48facf21409'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:30.623665 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-76d23588-4cb1-468e-8a82-df2b6bb08c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda88f2993e04496842dc48facf21409'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:30.642148 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1003/1989] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:30 2022] DELETE /identity/v3/users/cda88f2993e04496842dc48facf21409 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:30.741162 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a60ad918-e970-4328-9329-67f257d55fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b9a208a17641919153ba9b95a49b58'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:30.756077 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a60ad918-e970-4328-9329-67f257d55fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b9a208a17641919153ba9b95a49b58'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:30.852725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a60ad918-e970-4328-9329-67f257d55fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b9a208a17641919153ba9b95a49b58'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:30.860142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a60ad918-e970-4328-9329-67f257d55fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b9a208a17641919153ba9b95a49b58'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:30.870024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a60ad918-e970-4328-9329-67f257d55fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b9a208a17641919153ba9b95a49b58'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:30.871050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 987/1990] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:30 2022] DELETE /identity/v3/users/57b9a208a17641919153ba9b95a49b58 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:30.875597 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435141f-e7fe-4846-83ea-628955e86b5a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:30.875938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435141f-e7fe-4846-83ea-628955e86b5a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:30.876344 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435141f-e7fe-4846-83ea-628955e86b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:30.910356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1435141f-e7fe-4846-83ea-628955e86b5a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:30.911818 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1435141f-e7fe-4846-83ea-628955e86b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:30.991192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1004/1991] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:31.005085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ad918-e970-4328-9329-67f257d55fd7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:31.007091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a60ad918-e970-4328-9329-67f257d55fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:31.129036 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ad918-e970-4328-9329-67f257d55fd7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:31.136403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36546c8e-1b83-4241-befb-4a3a97d35467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:31.137330 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36546c8e-1b83-4241-befb-4a3a97d35467 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:31.137572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36546c8e-1b83-4241-befb-4a3a97d35467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:31.137864 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36546c8e-1b83-4241-befb-4a3a97d35467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:31.159339 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36546c8e-1b83-4241-befb-4a3a97d35467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:31.161234 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36546c8e-1b83-4241-befb-4a3a97d35467 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:31.173578 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 988/1992] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:51:31.322043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435141f-e7fe-4846-83ea-628955e86b5a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:31.326939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1435141f-e7fe-4846-83ea-628955e86b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:31.349542 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435141f-e7fe-4846-83ea-628955e86b5a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:31.363780 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b96709-76d6-48b5-bd72-bd52f4229260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:31.365332 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b96709-76d6-48b5-bd72-bd52f4229260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:31.366779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b96709-76d6-48b5-bd72-bd52f4229260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:31.367637 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b96709-76d6-48b5-bd72-bd52f4229260 admin admin] PATH_INFO: `/v3/projects/b3ed80062dad48d6b230afcc2f8daea2` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:31.383080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b96709-76d6-48b5-bd72-bd52f4229260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ed80062dad48d6b230afcc2f8daea2)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:31.383080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b96709-76d6-48b5-bd72-bd52f4229260 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:31.546732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-26b96709-76d6-48b5-bd72-bd52f4229260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ed80062dad48d6b230afcc2f8daea2', 'request_id': 'req-26b96709-76d6-48b5-bd72-bd52f4229260'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:31.569965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-26b96709-76d6-48b5-bd72-bd52f4229260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ed80062dad48d6b230afcc2f8daea2', 'request_id': 'req-26b96709-76d6-48b5-bd72-bd52f4229260'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:31.584472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-26b96709-76d6-48b5-bd72-bd52f4229260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ed80062dad48d6b230afcc2f8daea2', 'request_id': 'req-26b96709-76d6-48b5-bd72-bd52f4229260'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:31.665961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-26b96709-76d6-48b5-bd72-bd52f4229260 admin admin] The token cache is being invalidate because project b3ed80062dad48d6b230afcc2f8daea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:31.666921 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-26b96709-76d6-48b5-bd72-bd52f4229260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:31.667778 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-26b96709-76d6-48b5-bd72-bd52f4229260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:31.671258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1005/1993] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:31 2022] DELETE /identity/v3/projects/b3ed80062dad48d6b230afcc2f8daea2 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:31.676278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fcaa5-939a-44dc-b239-a160ef562a2a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:31.676661 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fcaa5-939a-44dc-b239-a160ef562a2a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:31.677007 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fcaa5-939a-44dc-b239-a160ef562a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:31.705499 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-dd2fcaa5-939a-44dc-b239-a160ef562a2a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:31.706796 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dd2fcaa5-939a-44dc-b239-a160ef562a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:31.771418 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 989/1994] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:31.779479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebef2ab-ae0f-424c-ac3c-e1d3420b265b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:31.779733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebef2ab-ae0f-424c-ac3c-e1d3420b265b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:31.779996 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebef2ab-ae0f-424c-ac3c-e1d3420b265b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:31.803400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1ebef2ab-ae0f-424c-ac3c-e1d3420b265b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:31.804744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1ebef2ab-ae0f-424c-ac3c-e1d3420b265b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:31.819027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1006/1995] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:31.820818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fcaa5-939a-44dc-b239-a160ef562a2a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:31.831644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fcaa5-939a-44dc-b239-a160ef562a2a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:31.836708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff23c3-4c21-4512-b022-f4c55822ff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:31.837394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff23c3-4c21-4512-b022-f4c55822ff80 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:31.837679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff23c3-4c21-4512-b022-f4c55822ff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:31.837958 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff23c3-4c21-4512-b022-f4c55822ff80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:31.839939 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff23c3-4c21-4512-b022-f4c55822ff80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:51:31.840261 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff23c3-4c21-4512-b022-f4c55822ff80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:31.841986 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff23c3-4c21-4512-b022-f4c55822ff80 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:31.862603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 990/1996] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:51:31.867145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebef2ab-ae0f-424c-ac3c-e1d3420b265b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:31.886172 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebef2ab-ae0f-424c-ac3c-e1d3420b265b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:31.902061 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb15077-35c7-4dc9-a4fe-3d8853887fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:31.902820 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb15077-35c7-4dc9-a4fe-3d8853887fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:31.911737 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb15077-35c7-4dc9-a4fe-3d8853887fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:31.911737 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb15077-35c7-4dc9-a4fe-3d8853887fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:31.911737 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb15077-35c7-4dc9-a4fe-3d8853887fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:31.911737 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb15077-35c7-4dc9-a4fe-3d8853887fc4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:31.965156 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff23c3-4c21-4512-b022-f4c55822ff80 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:31.968100 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e9ff23c3-4c21-4512-b022-f4c55822ff80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:31.985775 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff23c3-4c21-4512-b022-f4c55822ff80 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:31.992071 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:31.993450 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:31.993981 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:31.994434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806 admin admin] PATH_INFO: `/v3/projects/62767f263b8a47aea19cf419115deeff` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:31.999137 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62767f263b8a47aea19cf419115deeff)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:32.002477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:32.036746 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1007/1997] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:31 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:32.037748 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb15077-35c7-4dc9-a4fe-3d8853887fc4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:32.120045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb15077-35c7-4dc9-a4fe-3d8853887fc4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:32.133582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62767f263b8a47aea19cf419115deeff', 'request_id': 'req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:32.140081 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62767f263b8a47aea19cf419115deeff', 'request_id': 'req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:32.196628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62767f263b8a47aea19cf419115deeff', 'request_id': 'req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:32.225314 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806 admin admin] The token cache is being invalidate because project 62767f263b8a47aea19cf419115deeff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:32.225880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:32.227953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:32.240549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 991/1998] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:31 2022] DELETE /identity/v3/projects/62767f263b8a47aea19cf419115deeff => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:32.245676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0cdca-a760-45af-89c9-6e76a2df94b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:32.246413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0cdca-a760-45af-89c9-6e76a2df94b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:32.246722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0cdca-a760-45af-89c9-6e76a2df94b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:32.249042 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0cdca-a760-45af-89c9-6e76a2df94b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:32.250057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0cdca-a760-45af-89c9-6e76a2df94b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:32.251653 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:32.252031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0cdca-a760-45af-89c9-6e76a2df94b5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:32.253432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:32.270062 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc8d7f-39c9-4ee7-9ef2-eea2eed1f806 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:32.281814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f345487-7af4-427c-9585-b3e11ec947ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:32.283255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f345487-7af4-427c-9585-b3e11ec947ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:32.283928 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f345487-7af4-427c-9585-b3e11ec947ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:32.288096 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f345487-7af4-427c-9585-b3e11ec947ee admin admin] PATH_INFO: `/v3/users/8b55c37421f748b2a537a113b2cd1270` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:32.288096 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f345487-7af4-427c-9585-b3e11ec947ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b55c37421f748b2a537a113b2cd1270)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:32.288096 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f345487-7af4-427c-9585-b3e11ec947ee admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:32.342561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1008/1999] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:32 2022] POST /identity/v3/users => generated 294 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:32.346978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0cdca-a760-45af-89c9-6e76a2df94b5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:32.348699 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-efa0cdca-a760-45af-89c9-6e76a2df94b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:32.361063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0cdca-a760-45af-89c9-6e76a2df94b5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:32.366641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ffc57-6820-47dc-b12a-cf20f423b3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:32.367536 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ffc57-6820-47dc-b12a-cf20f423b3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:32.367894 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ffc57-6820-47dc-b12a-cf20f423b3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:32.368234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ffc57-6820-47dc-b12a-cf20f423b3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:32.369012 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ffc57-6820-47dc-b12a-cf20f423b3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:32.370639 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ffc57-6820-47dc-b12a-cf20f423b3e2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:32.389532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1009/2000] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:51:32.390565 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ffc57-6820-47dc-b12a-cf20f423b3e2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:32.402355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ffc57-6820-47dc-b12a-cf20f423b3e2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:32.428379 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f92865-c880-48dd-aa68-4dc6312331aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:32.430819 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f92865-c880-48dd-aa68-4dc6312331aa admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:32.435594 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f92865-c880-48dd-aa68-4dc6312331aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:32.436307 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f92865-c880-48dd-aa68-4dc6312331aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:32.438544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f92865-c880-48dd-aa68-4dc6312331aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:32.440251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f92865-c880-48dd-aa68-4dc6312331aa admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:32.456614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1010/2001] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:32.458759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f92865-c880-48dd-aa68-4dc6312331aa admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:32.471507 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8f345487-7af4-427c-9585-b3e11ec947ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b55c37421f748b2a537a113b2cd1270'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:32.476602 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f92865-c880-48dd-aa68-4dc6312331aa admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:32.483269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfee9a-0423-4e1c-93b8-d6c1307192de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:32.485367 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfee9a-0423-4e1c-93b8-d6c1307192de admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:32.485957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfee9a-0423-4e1c-93b8-d6c1307192de admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:32.486074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8f345487-7af4-427c-9585-b3e11ec947ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b55c37421f748b2a537a113b2cd1270'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:32.486600 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfee9a-0423-4e1c-93b8-d6c1307192de admin admin] PATH_INFO: `/v3/projects/bcb4fdf60ba14ed7b4a576e5d4900f43/users/324dea8220a74469a96f3ceb2c095375/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:32.511943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfee9a-0423-4e1c-93b8-d6c1307192de admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb4fdf60ba14ed7b4a576e5d4900f43, user_id=324dea8220a74469a96f3ceb2c095375, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:32.514945 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfee9a-0423-4e1c-93b8-d6c1307192de admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:32.560387 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8f345487-7af4-427c-9585-b3e11ec947ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b55c37421f748b2a537a113b2cd1270'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:32.570085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8f345487-7af4-427c-9585-b3e11ec947ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b55c37421f748b2a537a113b2cd1270'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:32.571085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8f345487-7af4-427c-9585-b3e11ec947ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b55c37421f748b2a537a113b2cd1270'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:32.577997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 992/2002] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:32 2022] DELETE /identity/v3/users/8b55c37421f748b2a537a113b2cd1270 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:32.623481 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1011/2003] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:32 2022] PUT /identity/v3/projects/bcb4fdf60ba14ed7b4a576e5d4900f43/users/324dea8220a74469a96f3ceb2c095375/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:32.633983 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26b9e7-df2a-446e-a4ee-26917ba0146f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:32.634276 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26b9e7-df2a-446e-a4ee-26917ba0146f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:32.634558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26b9e7-df2a-446e-a4ee-26917ba0146f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:32.666947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6c26b9e7-df2a-446e-a4ee-26917ba0146f None None] MFA Rules not processed for user `324dea8220a74469a96f3ceb2c095375`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:32.668101 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6c26b9e7-df2a-446e-a4ee-26917ba0146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:32.752905 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 993/2004] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:51:32.754070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfee9a-0423-4e1c-93b8-d6c1307192de admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:32.755806 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-31dfee9a-0423-4e1c-93b8-d6c1307192de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:32.841844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfee9a-0423-4e1c-93b8-d6c1307192de admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:32.846850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd9212-6df3-4fe6-a7cf-177379e0fb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:32.847675 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd9212-6df3-4fe6-a7cf-177379e0fb26 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:32.848054 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd9212-6df3-4fe6-a7cf-177379e0fb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:32.848587 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd9212-6df3-4fe6-a7cf-177379e0fb26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:32.849381 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd9212-6df3-4fe6-a7cf-177379e0fb26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:32.851624 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd9212-6df3-4fe6-a7cf-177379e0fb26 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:32.964095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1012/2005] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:32 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:32.970036 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26b9e7-df2a-446e-a4ee-26917ba0146f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:32.984072 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26b9e7-df2a-446e-a4ee-26917ba0146f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:33.055067 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd9212-6df3-4fe6-a7cf-177379e0fb26 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:33.057755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c66147-05c9-4fa0-a3ab-251813ad9ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:33.057901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cdbd9212-6df3-4fe6-a7cf-177379e0fb26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:33.060852 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c66147-05c9-4fa0-a3ab-251813ad9ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:33.072083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c66147-05c9-4fa0-a3ab-251813ad9ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:33.072523 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c66147-05c9-4fa0-a3ab-251813ad9ee4 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:33.073303 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c66147-05c9-4fa0-a3ab-251813ad9ee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:33.078276 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c66147-05c9-4fa0-a3ab-251813ad9ee4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:33.091640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd9212-6df3-4fe6-a7cf-177379e0fb26 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:33.128057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79f9a4-d78d-49b4-bc8b-de988c43ef36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:33.129050 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79f9a4-d78d-49b4-bc8b-de988c43ef36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:33.129331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79f9a4-d78d-49b4-bc8b-de988c43ef36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:33.129603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79f9a4-d78d-49b4-bc8b-de988c43ef36 admin admin] PATH_INFO: `/v3/projects/c3d2f1e9a26243aeb77bfa6a6dd9cc04` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:33.131058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79f9a4-d78d-49b4-bc8b-de988c43ef36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d2f1e9a26243aeb77bfa6a6dd9cc04)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:33.133641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79f9a4-d78d-49b4-bc8b-de988c43ef36 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:33.174227 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 994/2006] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:32 2022] POST /identity/v3/users => generated 300 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:33.175385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c66147-05c9-4fa0-a3ab-251813ad9ee4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:33.190187 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c66147-05c9-4fa0-a3ab-251813ad9ee4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:33.196298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb3ff5-485a-40b0-9a84-36c2c39f8244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:33.197084 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb3ff5-485a-40b0-9a84-36c2c39f8244 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:33.197368 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb3ff5-485a-40b0-9a84-36c2c39f8244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:33.197645 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb3ff5-485a-40b0-9a84-36c2c39f8244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:33.198382 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb3ff5-485a-40b0-9a84-36c2c39f8244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:33.200266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb3ff5-485a-40b0-9a84-36c2c39f8244 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:33.211471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 995/2007] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:33.215841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb3ff5-485a-40b0-9a84-36c2c39f8244 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:33.226338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb3ff5-485a-40b0-9a84-36c2c39f8244 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:33.234856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127d2b7-cafd-430f-9c77-5fb732619645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:33.235858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127d2b7-cafd-430f-9c77-5fb732619645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:33.236178 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127d2b7-cafd-430f-9c77-5fb732619645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:33.236472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127d2b7-cafd-430f-9c77-5fb732619645 admin admin] PATH_INFO: `/v3/projects/7cf59a519b6a4218aca1ff555011b88e/users/46c00c4697eb4b08acdf781d8b858d52/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:33.258413 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127d2b7-cafd-430f-9c77-5fb732619645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf59a519b6a4218aca1ff555011b88e, user_id=46c00c4697eb4b08acdf781d8b858d52, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:33.261367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127d2b7-cafd-430f-9c77-5fb732619645 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:33.360265 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 996/2008] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:33 2022] PUT /identity/v3/projects/7cf59a519b6a4218aca1ff555011b88e/users/46c00c4697eb4b08acdf781d8b858d52/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:51:33.361352 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127d2b7-cafd-430f-9c77-5fb732619645 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:33.365506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-aa79f9a4-d78d-49b4-bc8b-de988c43ef36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d2f1e9a26243aeb77bfa6a6dd9cc04', 'request_id': 'req-aa79f9a4-d78d-49b4-bc8b-de988c43ef36'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:33.373109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-aa79f9a4-d78d-49b4-bc8b-de988c43ef36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d2f1e9a26243aeb77bfa6a6dd9cc04', 'request_id': 'req-aa79f9a4-d78d-49b4-bc8b-de988c43ef36'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:33.381465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-aa79f9a4-d78d-49b4-bc8b-de988c43ef36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d2f1e9a26243aeb77bfa6a6dd9cc04', 'request_id': 'req-aa79f9a4-d78d-49b4-bc8b-de988c43ef36'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:33.446369 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127d2b7-cafd-430f-9c77-5fb732619645 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:33.467908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-aa79f9a4-d78d-49b4-bc8b-de988c43ef36 admin admin] The token cache is being invalidate because project c3d2f1e9a26243aeb77bfa6a6dd9cc04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:33.468363 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-aa79f9a4-d78d-49b4-bc8b-de988c43ef36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:33.469718 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-aa79f9a4-d78d-49b4-bc8b-de988c43ef36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:33.472060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1013/2009] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:33 2022] DELETE /identity/v3/projects/c3d2f1e9a26243aeb77bfa6a6dd9cc04 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:33.479062 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473f332-523b-49ae-929d-fdd76feb1c83 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:33.479590 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473f332-523b-49ae-929d-fdd76feb1c83 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:33.480010 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473f332-523b-49ae-929d-fdd76feb1c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:33.521632 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d473f332-523b-49ae-929d-fdd76feb1c83 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:33.523411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d473f332-523b-49ae-929d-fdd76feb1c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:33.553224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c5dbb-56de-4d54-a2b5-ac0a0a61d9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:33.555581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c5dbb-56de-4d54-a2b5-ac0a0a61d9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:33.556100 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c5dbb-56de-4d54-a2b5-ac0a0a61d9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:33.556642 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c5dbb-56de-4d54-a2b5-ac0a0a61d9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:33.565522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c5dbb-56de-4d54-a2b5-ac0a0a61d9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:33.583686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c5dbb-56de-4d54-a2b5-ac0a0a61d9f5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:33.611290 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 997/2010] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:33.615309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c5dbb-56de-4d54-a2b5-ac0a0a61d9f5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:33.617279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-406c5dbb-56de-4d54-a2b5-ac0a0a61d9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:33.632195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c5dbb-56de-4d54-a2b5-ac0a0a61d9f5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:33.643106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d776e-0e32-47e0-a946-54d990faa71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:33.644267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d776e-0e32-47e0-a946-54d990faa71e admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:33.644765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d776e-0e32-47e0-a946-54d990faa71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:33.645404 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d776e-0e32-47e0-a946-54d990faa71e admin admin] PATH_INFO: `/v3/projects/7cf59a519b6a4218aca1ff555011b88e/users/46c00c4697eb4b08acdf781d8b858d52/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:33.649788 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1014/2011] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:33.657122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d776e-0e32-47e0-a946-54d990faa71e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf59a519b6a4218aca1ff555011b88e, user_id=46c00c4697eb4b08acdf781d8b858d52, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:33.658598 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20763f65-0a6d-4c7e-9f2e-f4c64966b6b7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:33.659274 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20763f65-0a6d-4c7e-9f2e-f4c64966b6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:33.659932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d776e-0e32-47e0-a946-54d990faa71e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:33.660118 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20763f65-0a6d-4c7e-9f2e-f4c64966b6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:33.700542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 998/2012] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:33 2022] PUT /identity/v3/projects/7cf59a519b6a4218aca1ff555011b88e/users/46c00c4697eb4b08acdf781d8b858d52/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:33.711315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-20763f65-0a6d-4c7e-9f2e-f4c64966b6b7 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:33.714750 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-20763f65-0a6d-4c7e-9f2e-f4c64966b6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:33.715526 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc586fd2-f874-4e73-b4fa-9e9050b6406a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:33.716524 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc586fd2-f874-4e73-b4fa-9e9050b6406a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:33.717032 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc586fd2-f874-4e73-b4fa-9e9050b6406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:33.758772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-cc586fd2-f874-4e73-b4fa-9e9050b6406a None None] MFA Rules not processed for user `46c00c4697eb4b08acdf781d8b858d52`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:33.760260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cc586fd2-f874-4e73-b4fa-9e9050b6406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:33.839349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1015/2013] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:33.844143 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20763f65-0a6d-4c7e-9f2e-f4c64966b6b7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:33.858811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20763f65-0a6d-4c7e-9f2e-f4c64966b6b7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:33.873181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf143c5-03c6-4c90-b298-2315acfb3ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:33.873862 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf143c5-03c6-4c90-b298-2315acfb3ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:33.874198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf143c5-03c6-4c90-b298-2315acfb3ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:33.874474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf143c5-03c6-4c90-b298-2315acfb3ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:33.875259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf143c5-03c6-4c90-b298-2315acfb3ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:51:33.875566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf143c5-03c6-4c90-b298-2315acfb3ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:33.877205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf143c5-03c6-4c90-b298-2315acfb3ee1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:33.890458 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1016/2014] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:51:33.894858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf143c5-03c6-4c90-b298-2315acfb3ee1 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:33.905008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 999/2015] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:33.910233 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf143c5-03c6-4c90-b298-2315acfb3ee1 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:33.916236 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a72b11-8025-4856-9502-df24c0a7b47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:33.917540 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a72b11-8025-4856-9502-df24c0a7b47d admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:33.917831 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a72b11-8025-4856-9502-df24c0a7b47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:33.918174 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a72b11-8025-4856-9502-df24c0a7b47d admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:33.919821 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc586fd2-f874-4e73-b4fa-9e9050b6406a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:33.921249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cc586fd2-f874-4e73-b4fa-9e9050b6406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:33.926845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a72b11-8025-4856-9502-df24c0a7b47d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:33.930159 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a72b11-8025-4856-9502-df24c0a7b47d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:33.997211 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc586fd2-f874-4e73-b4fa-9e9050b6406a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:34.001371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c3e82-42d4-4234-ac40-dcdbb4dd4619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:34.002136 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c3e82-42d4-4234-ac40-dcdbb4dd4619 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:34.002524 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c3e82-42d4-4234-ac40-dcdbb4dd4619 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:34.003245 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c3e82-42d4-4234-ac40-dcdbb4dd4619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:34.014412 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c3e82-42d4-4234-ac40-dcdbb4dd4619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:34.015953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c3e82-42d4-4234-ac40-dcdbb4dd4619 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:34.027664 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1000/2016] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:51:34.062197 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c3e82-42d4-4234-ac40-dcdbb4dd4619 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:34.068184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1017/2017] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:33 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:34.071852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a72b11-8025-4856-9502-df24c0a7b47d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:34.073200 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c3e82-42d4-4234-ac40-dcdbb4dd4619 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:34.147594 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd589117-56d4-4ed3-a185-de2c9c2be8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:34.149283 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd589117-56d4-4ed3-a185-de2c9c2be8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:34.149760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd589117-56d4-4ed3-a185-de2c9c2be8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:34.150310 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd589117-56d4-4ed3-a185-de2c9c2be8ba admin admin] PATH_INFO: `/v3/users/324dea8220a74469a96f3ceb2c095375` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:34.152218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd589117-56d4-4ed3-a185-de2c9c2be8ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=324dea8220a74469a96f3ceb2c095375)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:34.155358 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd589117-56d4-4ed3-a185-de2c9c2be8ba admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:34.195192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a72b11-8025-4856-9502-df24c0a7b47d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:34.203751 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca4bcc-bbd3-4959-bafc-0d1e375e8f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:34.204617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca4bcc-bbd3-4959-bafc-0d1e375e8f66 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:34.205344 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca4bcc-bbd3-4959-bafc-0d1e375e8f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:34.205344 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca4bcc-bbd3-4959-bafc-0d1e375e8f66 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:34.206295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca4bcc-bbd3-4959-bafc-0d1e375e8f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:34.208428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca4bcc-bbd3-4959-bafc-0d1e375e8f66 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:34.358184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1018/2018] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:34 2022] POST /identity/v3/users => generated 292 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:51:34.362009 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca4bcc-bbd3-4959-bafc-0d1e375e8f66 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:34.394860 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca4bcc-bbd3-4959-bafc-0d1e375e8f66 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:34.398766 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-dd589117-56d4-4ed3-a185-de2c9c2be8ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '324dea8220a74469a96f3ceb2c095375'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:34.413123 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e7b30-d145-42d5-a35e-8f818d07245a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:34.413983 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e7b30-d145-42d5-a35e-8f818d07245a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:34.414134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e7b30-d145-42d5-a35e-8f818d07245a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:34.414419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e7b30-d145-42d5-a35e-8f818d07245a admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:34.415271 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e7b30-d145-42d5-a35e-8f818d07245a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:34.417528 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e7b30-d145-42d5-a35e-8f818d07245a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:34.432140 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-dd589117-56d4-4ed3-a185-de2c9c2be8ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '324dea8220a74469a96f3ceb2c095375'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:34.440185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1019/2019] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:34.444829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e7b30-d145-42d5-a35e-8f818d07245a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:34.457422 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e7b30-d145-42d5-a35e-8f818d07245a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:34.462487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926573a6-5d7e-495a-ab3e-510cf98a1baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:34.463235 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926573a6-5d7e-495a-ab3e-510cf98a1baf admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:34.463591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926573a6-5d7e-495a-ab3e-510cf98a1baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:34.463940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926573a6-5d7e-495a-ab3e-510cf98a1baf admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:34.464794 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926573a6-5d7e-495a-ab3e-510cf98a1baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:34.467321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926573a6-5d7e-495a-ab3e-510cf98a1baf admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:34.482409 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1020/2020] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:34.483899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926573a6-5d7e-495a-ab3e-510cf98a1baf admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:34.495513 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926573a6-5d7e-495a-ab3e-510cf98a1baf admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:34.501166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcd06f-cf4a-4fff-a7ac-c0978ff371f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:34.502253 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcd06f-cf4a-4fff-a7ac-c0978ff371f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:34.502769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcd06f-cf4a-4fff-a7ac-c0978ff371f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:34.503139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcd06f-cf4a-4fff-a7ac-c0978ff371f4 admin admin] PATH_INFO: `/v3/projects/8f60f921c25343e0be5bd9a1cd4cc98d/users/b51a5f41f761411cb2911014c51c155e/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:34.510892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-dd589117-56d4-4ed3-a185-de2c9c2be8ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '324dea8220a74469a96f3ceb2c095375'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:34.519629 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcd06f-cf4a-4fff-a7ac-c0978ff371f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f60f921c25343e0be5bd9a1cd4cc98d, user_id=b51a5f41f761411cb2911014c51c155e, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:34.520511 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-dd589117-56d4-4ed3-a185-de2c9c2be8ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '324dea8220a74469a96f3ceb2c095375'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:34.521213 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-dd589117-56d4-4ed3-a185-de2c9c2be8ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '324dea8220a74469a96f3ceb2c095375'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:34.523425 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcd06f-cf4a-4fff-a7ac-c0978ff371f4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:34.534828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1001/2021] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:34 2022] DELETE /identity/v3/users/324dea8220a74469a96f3ceb2c095375 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:34.539391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d3ec5-bbfd-4242-a56f-29a3c43034d5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:34.539698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d3ec5-bbfd-4242-a56f-29a3c43034d5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:34.540081 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d3ec5-bbfd-4242-a56f-29a3c43034d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:34.568735 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-062d3ec5-bbfd-4242-a56f-29a3c43034d5 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:34.570674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-062d3ec5-bbfd-4242-a56f-29a3c43034d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:34.630097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1021/2022] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:34 2022] PUT /identity/v3/projects/8f60f921c25343e0be5bd9a1cd4cc98d/users/b51a5f41f761411cb2911014c51c155e/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:51:34.631941 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa18100-2f38-4667-bb03-ae73fd64a541 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:34.632229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa18100-2f38-4667-bb03-ae73fd64a541 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:34.632545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa18100-2f38-4667-bb03-ae73fd64a541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:34.656977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1002/2023] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:51:34.671373 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d3ec5-bbfd-4242-a56f-29a3c43034d5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:34.673389 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-062d3ec5-bbfd-4242-a56f-29a3c43034d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:34.697819 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-baa18100-2f38-4667-bb03-ae73fd64a541 None None] MFA Rules not processed for user `b51a5f41f761411cb2911014c51c155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:34.701291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-baa18100-2f38-4667-bb03-ae73fd64a541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:34.805248 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d3ec5-bbfd-4242-a56f-29a3c43034d5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:34.831715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1022/2024] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:34.836715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa18100-2f38-4667-bb03-ae73fd64a541 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:34.840124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-baa18100-2f38-4667-bb03-ae73fd64a541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:34.872917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b617954-8c77-4649-ac58-fa8fe2d56a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:34.874368 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b617954-8c77-4649-ac58-fa8fe2d56a69 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:34.875216 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b617954-8c77-4649-ac58-fa8fe2d56a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:34.875706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b617954-8c77-4649-ac58-fa8fe2d56a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:34.926107 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa18100-2f38-4667-bb03-ae73fd64a541 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:34.931861 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d4bdb-3eb5-4e1f-bfc9-a185edc18387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:34.932286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d4bdb-3eb5-4e1f-bfc9-a185edc18387 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:34.932598 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d4bdb-3eb5-4e1f-bfc9-a185edc18387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:34.932872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d4bdb-3eb5-4e1f-bfc9-a185edc18387 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:34.933811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d4bdb-3eb5-4e1f-bfc9-a185edc18387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:34.936472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d4bdb-3eb5-4e1f-bfc9-a185edc18387 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:35.019493 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b617954-8c77-4649-ac58-fa8fe2d56a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:35.021241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b617954-8c77-4649-ac58-fa8fe2d56a69 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:35.034599 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1003/2025] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:51:35.038098 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1023/2026] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:34 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:35.042575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b617954-8c77-4649-ac58-fa8fe2d56a69 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:35.053879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b617954-8c77-4649-ac58-fa8fe2d56a69 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:35.135627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d319a-d778-4ba2-83db-e02ecc763879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:35.136309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d319a-d778-4ba2-83db-e02ecc763879 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:35.136625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d319a-d778-4ba2-83db-e02ecc763879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:35.137288 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d319a-d778-4ba2-83db-e02ecc763879 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:35.138922 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d319a-d778-4ba2-83db-e02ecc763879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:35.141019 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d319a-d778-4ba2-83db-e02ecc763879 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:35.261923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1004/2027] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:35 2022] POST /identity/v3/users => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:51:35.265204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d4bdb-3eb5-4e1f-bfc9-a185edc18387 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:35.310663 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d4bdb-3eb5-4e1f-bfc9-a185edc18387 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:35.345203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69a003-c79b-407d-873a-df9979124649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:35.345907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69a003-c79b-407d-873a-df9979124649 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:35.346194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69a003-c79b-407d-873a-df9979124649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:35.346472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69a003-c79b-407d-873a-df9979124649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:35.347217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69a003-c79b-407d-873a-df9979124649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:35.349946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69a003-c79b-407d-873a-df9979124649 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:35.363559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1024/2028] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:35.368972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d319a-d778-4ba2-83db-e02ecc763879 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:35.395525 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d319a-d778-4ba2-83db-e02ecc763879 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:35.408399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904236f-7609-426f-b3c3-c7829c67dc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:35.409877 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904236f-7609-426f-b3c3-c7829c67dc9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:35.410367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904236f-7609-426f-b3c3-c7829c67dc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:35.410829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904236f-7609-426f-b3c3-c7829c67dc9a admin admin] PATH_INFO: `/v3/projects/5d47c3bb530c4ca9ad5aad890de78095/users/8537a1892d0d453a956871b2e5fea573/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:35.440600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904236f-7609-426f-b3c3-c7829c67dc9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d47c3bb530c4ca9ad5aad890de78095, user_id=8537a1892d0d453a956871b2e5fea573, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:35.443100 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904236f-7609-426f-b3c3-c7829c67dc9a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:35.540247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1005/2029] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:35 2022] PUT /identity/v3/projects/5d47c3bb530c4ca9ad5aad890de78095/users/8537a1892d0d453a956871b2e5fea573/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:51:35.545067 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69a003-c79b-407d-873a-df9979124649 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:35.561165 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69a003-c79b-407d-873a-df9979124649 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:35.611072 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904236f-7609-426f-b3c3-c7829c67dc9a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:35.614804 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e904236f-7609-426f-b3c3-c7829c67dc9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:35.703279 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafd7bd-007c-44cd-b895-630d254ea374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:35.703956 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafd7bd-007c-44cd-b895-630d254ea374 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:35.704239 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafd7bd-007c-44cd-b895-630d254ea374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:35.704564 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafd7bd-007c-44cd-b895-630d254ea374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:35.705689 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafd7bd-007c-44cd-b895-630d254ea374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:35.706948 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafd7bd-007c-44cd-b895-630d254ea374 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:35.730282 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1025/2030] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:35.736747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafd7bd-007c-44cd-b895-630d254ea374 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:35.780992 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafd7bd-007c-44cd-b895-630d254ea374 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:35.808460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a65b47-c2a6-4d10-b164-ac7a9eaa579b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:35.809384 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a65b47-c2a6-4d10-b164-ac7a9eaa579b admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:35.810211 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a65b47-c2a6-4d10-b164-ac7a9eaa579b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:35.810491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a65b47-c2a6-4d10-b164-ac7a9eaa579b admin admin] PATH_INFO: `/v3/projects/5d47c3bb530c4ca9ad5aad890de78095/users/8537a1892d0d453a956871b2e5fea573/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:35.818203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a65b47-c2a6-4d10-b164-ac7a9eaa579b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d47c3bb530c4ca9ad5aad890de78095, user_id=8537a1892d0d453a956871b2e5fea573, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:35.822131 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904236f-7609-426f-b3c3-c7829c67dc9a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:35.824540 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a65b47-c2a6-4d10-b164-ac7a9eaa579b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:35.840358 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d953b90-c147-4509-9a3d-3c740ca595cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:35.841429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d953b90-c147-4509-9a3d-3c740ca595cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:35.841724 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d953b90-c147-4509-9a3d-3c740ca595cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:35.842009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d953b90-c147-4509-9a3d-3c740ca595cb admin admin] PATH_INFO: `/v3/projects/bcb4fdf60ba14ed7b4a576e5d4900f43` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:35.844334 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d953b90-c147-4509-9a3d-3c740ca595cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb4fdf60ba14ed7b4a576e5d4900f43)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:35.850063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d953b90-c147-4509-9a3d-3c740ca595cb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:35.861355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1026/2031] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:35 2022] PUT /identity/v3/projects/5d47c3bb530c4ca9ad5aad890de78095/users/8537a1892d0d453a956871b2e5fea573/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:35.873657 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ff1be-b382-448b-be2b-f8f1f5fa12f6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:35.873657 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ff1be-b382-448b-be2b-f8f1f5fa12f6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:35.873657 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ff1be-b382-448b-be2b-f8f1f5fa12f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:35.929436 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-566ff1be-b382-448b-be2b-f8f1f5fa12f6 None None] MFA Rules not processed for user `8537a1892d0d453a956871b2e5fea573`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:35.930761 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-566ff1be-b382-448b-be2b-f8f1f5fa12f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:36.008234 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4d953b90-c147-4509-9a3d-3c740ca595cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb4fdf60ba14ed7b4a576e5d4900f43', 'request_id': 'req-4d953b90-c147-4509-9a3d-3c740ca595cb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:36.016996 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4d953b90-c147-4509-9a3d-3c740ca595cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb4fdf60ba14ed7b4a576e5d4900f43', 'request_id': 'req-4d953b90-c147-4509-9a3d-3c740ca595cb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:36.075827 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1027/2032] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:51:36.088058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ff1be-b382-448b-be2b-f8f1f5fa12f6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:36.089583 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-566ff1be-b382-448b-be2b-f8f1f5fa12f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:36.127469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4d953b90-c147-4509-9a3d-3c740ca595cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb4fdf60ba14ed7b4a576e5d4900f43', 'request_id': 'req-4d953b90-c147-4509-9a3d-3c740ca595cb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:36.150393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4d953b90-c147-4509-9a3d-3c740ca595cb admin admin] The token cache is being invalidate because project bcb4fdf60ba14ed7b4a576e5d4900f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:36.150937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4d953b90-c147-4509-9a3d-3c740ca595cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:36.152872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4d953b90-c147-4509-9a3d-3c740ca595cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:36.156429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1006/2033] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:35 2022] DELETE /identity/v3/projects/bcb4fdf60ba14ed7b4a576e5d4900f43 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:36.160080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d953b90-c147-4509-9a3d-3c740ca595cb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:36.163870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4d953b90-c147-4509-9a3d-3c740ca595cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:36.164238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ff1be-b382-448b-be2b-f8f1f5fa12f6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:36.239119 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202806c9-70d5-47d3-8c0c-f81d17c2c401 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:36.239790 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202806c9-70d5-47d3-8c0c-f81d17c2c401 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:36.240074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202806c9-70d5-47d3-8c0c-f81d17c2c401 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:36.240518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202806c9-70d5-47d3-8c0c-f81d17c2c401 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:36.245657 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-202806c9-70d5-47d3-8c0c-f81d17c2c401 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:36.276347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d953b90-c147-4509-9a3d-3c740ca595cb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:36.282191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09530cfb-eb57-4b0b-863c-78122dfee864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:36.283076 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09530cfb-eb57-4b0b-863c-78122dfee864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:36.283355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09530cfb-eb57-4b0b-863c-78122dfee864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:36.283787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09530cfb-eb57-4b0b-863c-78122dfee864 admin admin] PATH_INFO: `/v3/users/46c00c4697eb4b08acdf781d8b858d52` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:36.293588 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09530cfb-eb57-4b0b-863c-78122dfee864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46c00c4697eb4b08acdf781d8b858d52)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:36.295875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09530cfb-eb57-4b0b-863c-78122dfee864 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:36.356100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202806c9-70d5-47d3-8c0c-f81d17c2c401 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:36.360947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202806c9-70d5-47d3-8c0c-f81d17c2c401 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:36.370374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1028/2034] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:51:36.535937 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202806c9-70d5-47d3-8c0c-f81d17c2c401 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:36.537751 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-202806c9-70d5-47d3-8c0c-f81d17c2c401 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:36.553404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202806c9-70d5-47d3-8c0c-f81d17c2c401 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:36.559434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-09530cfb-eb57-4b0b-863c-78122dfee864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46c00c4697eb4b08acdf781d8b858d52'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:36.564334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e90439-980d-4358-9aca-184b8358a120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:36.565929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90439-980d-4358-9aca-184b8358a120 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:36.565929 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90439-980d-4358-9aca-184b8358a120 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:36.566471 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90439-980d-4358-9aca-184b8358a120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:36.573068 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-34e90439-980d-4358-9aca-184b8358a120 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:36.619603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-09530cfb-eb57-4b0b-863c-78122dfee864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46c00c4697eb4b08acdf781d8b858d52'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:36.693759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-09530cfb-eb57-4b0b-863c-78122dfee864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46c00c4697eb4b08acdf781d8b858d52'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:36.703326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-09530cfb-eb57-4b0b-863c-78122dfee864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46c00c4697eb4b08acdf781d8b858d52'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:36.704216 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-09530cfb-eb57-4b0b-863c-78122dfee864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46c00c4697eb4b08acdf781d8b858d52'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:36.716426 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1007/2035] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:36 2022] DELETE /identity/v3/users/46c00c4697eb4b08acdf781d8b858d52 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:36.721367 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e90439-980d-4358-9aca-184b8358a120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:36.722904 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e90439-980d-4358-9aca-184b8358a120 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:36.733224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1029/2036] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:51:37.361357 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09530cfb-eb57-4b0b-863c-78122dfee864 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:37.362887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-09530cfb-eb57-4b0b-863c-78122dfee864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:37.454221 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09530cfb-eb57-4b0b-863c-78122dfee864 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:37.459280 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad344f-7617-42a5-bf26-9682d6393d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:37.460224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad344f-7617-42a5-bf26-9682d6393d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:37.460699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad344f-7617-42a5-bf26-9682d6393d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:37.461125 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad344f-7617-42a5-bf26-9682d6393d45 admin admin] PATH_INFO: `/v3/users/b51a5f41f761411cb2911014c51c155e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:37.462702 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad344f-7617-42a5-bf26-9682d6393d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b51a5f41f761411cb2911014c51c155e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:37.466849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad344f-7617-42a5-bf26-9682d6393d45 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:37.679609 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad1e23-0c05-4471-902f-68040cde0c3a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:37.680188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad1e23-0c05-4471-902f-68040cde0c3a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:37.680736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad1e23-0c05-4471-902f-68040cde0c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:37.690606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-40ad344f-7617-42a5-bf26-9682d6393d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b51a5f41f761411cb2911014c51c155e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:37.711313 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b4ad1e23-0c05-4471-902f-68040cde0c3a None None] MFA Rules not processed for user `546c3447688f473fb256f4bc3dd99188`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:37.712722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b4ad1e23-0c05-4471-902f-68040cde0c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:37.723256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-40ad344f-7617-42a5-bf26-9682d6393d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b51a5f41f761411cb2911014c51c155e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:37.780578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1030/2037] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:37.792402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad1e23-0c05-4471-902f-68040cde0c3a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:37.794810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b4ad1e23-0c05-4471-902f-68040cde0c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:37.840173 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-40ad344f-7617-42a5-bf26-9682d6393d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b51a5f41f761411cb2911014c51c155e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:37.851055 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-40ad344f-7617-42a5-bf26-9682d6393d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b51a5f41f761411cb2911014c51c155e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:37.852156 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-40ad344f-7617-42a5-bf26-9682d6393d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b51a5f41f761411cb2911014c51c155e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:37.859749 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1008/2038] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:37 2022] DELETE /identity/v3/users/b51a5f41f761411cb2911014c51c155e => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:37.860665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad344f-7617-42a5-bf26-9682d6393d45 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:37.862016 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-40ad344f-7617-42a5-bf26-9682d6393d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:37.886373 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad1e23-0c05-4471-902f-68040cde0c3a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:37.947214 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad344f-7617-42a5-bf26-9682d6393d45 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:37.956915 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c02a07-6160-4585-846d-4d60eee3b8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:37.957795 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c02a07-6160-4585-846d-4d60eee3b8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:37.958078 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c02a07-6160-4585-846d-4d60eee3b8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:37.958402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c02a07-6160-4585-846d-4d60eee3b8bc admin admin] PATH_INFO: `/v3/projects/7cf59a519b6a4218aca1ff555011b88e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:37.959553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c02a07-6160-4585-846d-4d60eee3b8bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf59a519b6a4218aca1ff555011b88e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:37.961501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c02a07-6160-4585-846d-4d60eee3b8bc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:37.964403 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9be66f-c983-44d6-8ffb-e57c79bc33e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:37.964403 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9be66f-c983-44d6-8ffb-e57c79bc33e0 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:37.964683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9be66f-c983-44d6-8ffb-e57c79bc33e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:37.964911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9be66f-c983-44d6-8ffb-e57c79bc33e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:37.967552 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3c9be66f-c983-44d6-8ffb-e57c79bc33e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:38.032857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9be66f-c983-44d6-8ffb-e57c79bc33e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:38.034472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9be66f-c983-44d6-8ffb-e57c79bc33e0 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:38.045199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1031/2039] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:51:38.046523 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db9b34-9883-44e5-ad31-94103eae7c57 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:38.046753 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db9b34-9883-44e5-ad31-94103eae7c57 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:38.047029 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db9b34-9883-44e5-ad31-94103eae7c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:38.072238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-98db9b34-9883-44e5-ad31-94103eae7c57 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:38.073492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-98db9b34-9883-44e5-ad31-94103eae7c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:38.081465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1032/2040] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:38.092407 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db9b34-9883-44e5-ad31-94103eae7c57 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:38.093890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-98db9b34-9883-44e5-ad31-94103eae7c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:38.127090 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c2c02a07-6160-4585-846d-4d60eee3b8bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf59a519b6a4218aca1ff555011b88e', 'request_id': 'req-c2c02a07-6160-4585-846d-4d60eee3b8bc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:38.132981 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c2c02a07-6160-4585-846d-4d60eee3b8bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf59a519b6a4218aca1ff555011b88e', 'request_id': 'req-c2c02a07-6160-4585-846d-4d60eee3b8bc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:38.159199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db9b34-9883-44e5-ad31-94103eae7c57 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:38.188203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c2c02a07-6160-4585-846d-4d60eee3b8bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf59a519b6a4218aca1ff555011b88e', 'request_id': 'req-c2c02a07-6160-4585-846d-4d60eee3b8bc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:38.205599 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c2c02a07-6160-4585-846d-4d60eee3b8bc admin admin] The token cache is being invalidate because project 7cf59a519b6a4218aca1ff555011b88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:38.206205 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c2c02a07-6160-4585-846d-4d60eee3b8bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:38.207490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c2c02a07-6160-4585-846d-4d60eee3b8bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:38.213352 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1009/2041] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:37 2022] DELETE /identity/v3/projects/7cf59a519b6a4218aca1ff555011b88e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:38.214887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b75d9-3809-4fe5-b9b2-68601b324b4a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:38.215177 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b75d9-3809-4fe5-b9b2-68601b324b4a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:38.215521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b75d9-3809-4fe5-b9b2-68601b324b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:38.219668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2a61c-4303-4b23-bb67-f0446f4d60a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:38.220350 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2a61c-4303-4b23-bb67-f0446f4d60a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:38.220659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2a61c-4303-4b23-bb67-f0446f4d60a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:38.221154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2a61c-4303-4b23-bb67-f0446f4d60a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:38.222848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-09d2a61c-4303-4b23-bb67-f0446f4d60a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:38.249432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4a4b75d9-3809-4fe5-b9b2-68601b324b4a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:38.250604 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4a4b75d9-3809-4fe5-b9b2-68601b324b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:38.297265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2a61c-4303-4b23-bb67-f0446f4d60a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:38.298710 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2a61c-4303-4b23-bb67-f0446f4d60a5 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:38.310389 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1033/2042] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:51:38.313477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1010/2043] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:38.321737 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebc326-9990-4b4e-89de-dcd74d300757 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:38.323712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebc326-9990-4b4e-89de-dcd74d300757 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:38.323712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebc326-9990-4b4e-89de-dcd74d300757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:38.351055 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5aebc326-9990-4b4e-89de-dcd74d300757 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:38.352303 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5aebc326-9990-4b4e-89de-dcd74d300757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:38.364672 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1034/2044] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:38.366609 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b75d9-3809-4fe5-b9b2-68601b324b4a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:38.377690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b75d9-3809-4fe5-b9b2-68601b324b4a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:38.383762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fd389-acb1-4894-99af-f8bf1f4cf0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:38.384454 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fd389-acb1-4894-99af-f8bf1f4cf0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:38.384761 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fd389-acb1-4894-99af-f8bf1f4cf0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:38.385080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fd389-acb1-4894-99af-f8bf1f4cf0c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:38.385982 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fd389-acb1-4894-99af-f8bf1f4cf0c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:51:38.386296 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fd389-acb1-4894-99af-f8bf1f4cf0c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:38.388116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fd389-acb1-4894-99af-f8bf1f4cf0c1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:38.402049 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1011/2045] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:51:38.406362 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebc326-9990-4b4e-89de-dcd74d300757 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:38.416663 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebc326-9990-4b4e-89de-dcd74d300757 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:38.423251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5cff1-0da9-448d-90b4-fd709f4ebc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:38.423920 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5cff1-0da9-448d-90b4-fd709f4ebc85 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:38.424200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5cff1-0da9-448d-90b4-fd709f4ebc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:38.424626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5cff1-0da9-448d-90b4-fd709f4ebc85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:38.425345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5cff1-0da9-448d-90b4-fd709f4ebc85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:38.427598 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5cff1-0da9-448d-90b4-fd709f4ebc85 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:38.617010 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1035/2046] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:38 2022] POST /identity/v3/projects => generated 387 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:51:38.621131 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fd389-acb1-4894-99af-f8bf1f4cf0c1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:38.631576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fd389-acb1-4894-99af-f8bf1f4cf0c1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:38.707397 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67386d4-00ab-4e5f-8678-49b09bb7e2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:38.707397 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67386d4-00ab-4e5f-8678-49b09bb7e2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:38.707397 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67386d4-00ab-4e5f-8678-49b09bb7e2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:38.707397 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67386d4-00ab-4e5f-8678-49b09bb7e2b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:38.708504 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67386d4-00ab-4e5f-8678-49b09bb7e2b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:38.710033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67386d4-00ab-4e5f-8678-49b09bb7e2b5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:38.833624 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1012/2047] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:38 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:38.837552 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5cff1-0da9-448d-90b4-fd709f4ebc85 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:38.855300 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5cff1-0da9-448d-90b4-fd709f4ebc85 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:38.861505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c93361-9137-4a41-95c6-dc61189bd98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:38.862477 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c93361-9137-4a41-95c6-dc61189bd98f admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:38.862744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c93361-9137-4a41-95c6-dc61189bd98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:38.865315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c93361-9137-4a41-95c6-dc61189bd98f admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:38.865315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c93361-9137-4a41-95c6-dc61189bd98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:38.865756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c93361-9137-4a41-95c6-dc61189bd98f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:38.876842 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1036/2048] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:38.880964 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67386d4-00ab-4e5f-8678-49b09bb7e2b5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:38.891880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67386d4-00ab-4e5f-8678-49b09bb7e2b5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:38.896563 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8cba5-e7cc-414e-b255-1c5ced3f401a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:38.897223 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8cba5-e7cc-414e-b255-1c5ced3f401a admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:38.897506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8cba5-e7cc-414e-b255-1c5ced3f401a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:38.899726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8cba5-e7cc-414e-b255-1c5ced3f401a admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:38.899726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8cba5-e7cc-414e-b255-1c5ced3f401a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:38.900223 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8cba5-e7cc-414e-b255-1c5ced3f401a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:38.912714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1013/2049] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:38.917617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c93361-9137-4a41-95c6-dc61189bd98f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:38.928487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c93361-9137-4a41-95c6-dc61189bd98f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:38.933096 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcf5f8-f066-4902-89dd-2a604180ed77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:38.934209 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcf5f8-f066-4902-89dd-2a604180ed77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:38.934329 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcf5f8-f066-4902-89dd-2a604180ed77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:38.934500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcf5f8-f066-4902-89dd-2a604180ed77 admin admin] PATH_INFO: `/v3/projects/1b6c17e91e3842d783b5cced1529eff2/users/09ef5f02b2c94168ab8f0d2cf4e47ac7/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:38.950962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcf5f8-f066-4902-89dd-2a604180ed77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6c17e91e3842d783b5cced1529eff2, user_id=09ef5f02b2c94168ab8f0d2cf4e47ac7, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:38.954079 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcf5f8-f066-4902-89dd-2a604180ed77 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:38.975499 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8cba5-e7cc-414e-b255-1c5ced3f401a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:38.980633 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-12e8cba5-e7cc-414e-b255-1c5ced3f401a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:38.995656 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8cba5-e7cc-414e-b255-1c5ced3f401a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:39.003102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca53d7-3551-487c-9b66-93ef6d7c1609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:39.003102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca53d7-3551-487c-9b66-93ef6d7c1609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:39.003473 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca53d7-3551-487c-9b66-93ef6d7c1609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:39.003936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca53d7-3551-487c-9b66-93ef6d7c1609 admin admin] PATH_INFO: `/v3/projects/8f60f921c25343e0be5bd9a1cd4cc98d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:39.005233 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca53d7-3551-487c-9b66-93ef6d7c1609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f60f921c25343e0be5bd9a1cd4cc98d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:39.007201 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca53d7-3551-487c-9b66-93ef6d7c1609 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:39.034709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1037/2050] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:38 2022] PUT /identity/v3/projects/1b6c17e91e3842d783b5cced1529eff2/users/09ef5f02b2c94168ab8f0d2cf4e47ac7/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:39.045478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ff16-9fab-403b-9c13-0c941870acf7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:39.045847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ff16-9fab-403b-9c13-0c941870acf7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:39.046211 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ff16-9fab-403b-9c13-0c941870acf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:39.073770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1c74ff16-9fab-403b-9c13-0c941870acf7 None None] MFA Rules not processed for user `09ef5f02b2c94168ab8f0d2cf4e47ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:39.075041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1c74ff16-9fab-403b-9c13-0c941870acf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:39.147607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1038/2051] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:39.149069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ceca53d7-3551-487c-9b66-93ef6d7c1609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f60f921c25343e0be5bd9a1cd4cc98d', 'request_id': 'req-ceca53d7-3551-487c-9b66-93ef6d7c1609'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:39.151903 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74ff16-9fab-403b-9c13-0c941870acf7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:39.157403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ceca53d7-3551-487c-9b66-93ef6d7c1609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f60f921c25343e0be5bd9a1cd4cc98d', 'request_id': 'req-ceca53d7-3551-487c-9b66-93ef6d7c1609'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:39.221349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74ff16-9fab-403b-9c13-0c941870acf7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:39.287622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ceca53d7-3551-487c-9b66-93ef6d7c1609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f60f921c25343e0be5bd9a1cd4cc98d', 'request_id': 'req-ceca53d7-3551-487c-9b66-93ef6d7c1609'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:39.300041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f056ae-6d5e-4bdd-8899-a8547ea204b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:39.300790 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f056ae-6d5e-4bdd-8899-a8547ea204b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:39.301152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f056ae-6d5e-4bdd-8899-a8547ea204b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:39.301432 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f056ae-6d5e-4bdd-8899-a8547ea204b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:39.302153 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f056ae-6d5e-4bdd-8899-a8547ea204b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:39.304345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f056ae-6d5e-4bdd-8899-a8547ea204b5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:39.306486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ceca53d7-3551-487c-9b66-93ef6d7c1609 admin admin] The token cache is being invalidate because project 8f60f921c25343e0be5bd9a1cd4cc98d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:39.306902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ceca53d7-3551-487c-9b66-93ef6d7c1609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:39.308350 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ceca53d7-3551-487c-9b66-93ef6d7c1609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:39.310808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1014/2052] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:38 2022] DELETE /identity/v3/projects/8f60f921c25343e0be5bd9a1cd4cc98d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:51:39.315729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca53d7-3551-487c-9b66-93ef6d7c1609 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:39.317360 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ceca53d7-3551-487c-9b66-93ef6d7c1609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:39.332896 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca53d7-3551-487c-9b66-93ef6d7c1609 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:39.339451 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e8460-3f50-4bfc-b88d-00a2546cc3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:39.340463 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e8460-3f50-4bfc-b88d-00a2546cc3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:39.340843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e8460-3f50-4bfc-b88d-00a2546cc3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:39.341769 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e8460-3f50-4bfc-b88d-00a2546cc3cb admin admin] PATH_INFO: `/v3/users/8537a1892d0d453a956871b2e5fea573` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:39.343204 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e8460-3f50-4bfc-b88d-00a2546cc3cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8537a1892d0d453a956871b2e5fea573)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:39.345511 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e8460-3f50-4bfc-b88d-00a2546cc3cb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:39.415259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1039/2053] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:39 2022] POST /identity/v3/projects => generated 387 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:51:39.419600 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f056ae-6d5e-4bdd-8899-a8547ea204b5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:39.424623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-22f056ae-6d5e-4bdd-8899-a8547ea204b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:39.490852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f056ae-6d5e-4bdd-8899-a8547ea204b5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:39.495649 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7331b-a359-4e85-9032-321df652d6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:39.496255 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7331b-a359-4e85-9032-321df652d6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:39.496976 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7331b-a359-4e85-9032-321df652d6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:39.496976 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7331b-a359-4e85-9032-321df652d6b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:39.498228 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7331b-a359-4e85-9032-321df652d6b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:39.500229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7331b-a359-4e85-9032-321df652d6b0 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:39.617179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-915e8460-3f50-4bfc-b88d-00a2546cc3cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8537a1892d0d453a956871b2e5fea573'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:39.631255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-915e8460-3f50-4bfc-b88d-00a2546cc3cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8537a1892d0d453a956871b2e5fea573'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:39.655098 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1040/2054] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:39 2022] POST /identity/v3/users => generated 300 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:51:39.665461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7331b-a359-4e85-9032-321df652d6b0 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:39.682404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7331b-a359-4e85-9032-321df652d6b0 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:39.688145 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-915e8460-3f50-4bfc-b88d-00a2546cc3cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8537a1892d0d453a956871b2e5fea573'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:39.689290 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654faa9-6a2c-4b5b-b9b5-495b79bf628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:39.690132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654faa9-6a2c-4b5b-b9b5-495b79bf628e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:39.690417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654faa9-6a2c-4b5b-b9b5-495b79bf628e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:39.690690 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654faa9-6a2c-4b5b-b9b5-495b79bf628e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:39.691865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654faa9-6a2c-4b5b-b9b5-495b79bf628e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:39.693095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654faa9-6a2c-4b5b-b9b5-495b79bf628e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:39.704525 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-915e8460-3f50-4bfc-b88d-00a2546cc3cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8537a1892d0d453a956871b2e5fea573'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:39.705641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-915e8460-3f50-4bfc-b88d-00a2546cc3cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8537a1892d0d453a956871b2e5fea573'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:39.711650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1041/2055] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:39.714611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654faa9-6a2c-4b5b-b9b5-495b79bf628e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:39.717376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1015/2056] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:39 2022] DELETE /identity/v3/users/8537a1892d0d453a956871b2e5fea573 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:39.721060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3654faa9-6a2c-4b5b-b9b5-495b79bf628e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:39.734922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654faa9-6a2c-4b5b-b9b5-495b79bf628e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:39.809527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4413b6-f527-49b4-98e5-a410a933c099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:39.811308 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4413b6-f527-49b4-98e5-a410a933c099 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:39.811640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4413b6-f527-49b4-98e5-a410a933c099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:39.812991 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4413b6-f527-49b4-98e5-a410a933c099 admin admin] PATH_INFO: `/v3/projects/4e99e9d6f75a4bab8d37f834ea825a3b/users/94fde9aeb057470ab9879c380412b56c/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:39.830262 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4413b6-f527-49b4-98e5-a410a933c099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e99e9d6f75a4bab8d37f834ea825a3b, user_id=94fde9aeb057470ab9879c380412b56c, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:39.833518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4413b6-f527-49b4-98e5-a410a933c099 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:39.916184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1042/2057] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:39 2022] PUT /identity/v3/projects/4e99e9d6f75a4bab8d37f834ea825a3b/users/94fde9aeb057470ab9879c380412b56c/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:39.917921 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e8460-3f50-4bfc-b88d-00a2546cc3cb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:39.938012 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e8460-3f50-4bfc-b88d-00a2546cc3cb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:40.075873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d70f8-be8a-4bf1-918b-1773a4da65a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:40.103597 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d70f8-be8a-4bf1-918b-1773a4da65a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:40.104394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d70f8-be8a-4bf1-918b-1773a4da65a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:40.104696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d70f8-be8a-4bf1-918b-1773a4da65a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:40.111978 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d70f8-be8a-4bf1-918b-1773a4da65a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:40.116669 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d70f8-be8a-4bf1-918b-1773a4da65a1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:40.172064 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4413b6-f527-49b4-98e5-a410a933c099 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:40.173231 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1016/2058] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:40.200346 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4413b6-f527-49b4-98e5-a410a933c099 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:40.214913 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac2139-eb18-4504-90fb-66776e83a159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:40.216655 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac2139-eb18-4504-90fb-66776e83a159 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:40.217016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac2139-eb18-4504-90fb-66776e83a159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:40.217293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac2139-eb18-4504-90fb-66776e83a159 admin admin] PATH_INFO: `/v3/projects/4e99e9d6f75a4bab8d37f834ea825a3b/users/94fde9aeb057470ab9879c380412b56c/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:40.226037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac2139-eb18-4504-90fb-66776e83a159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e99e9d6f75a4bab8d37f834ea825a3b, user_id=94fde9aeb057470ab9879c380412b56c, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:40.229068 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac2139-eb18-4504-90fb-66776e83a159 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:40.257273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1043/2059] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:40 2022] PUT /identity/v3/projects/4e99e9d6f75a4bab8d37f834ea825a3b/users/94fde9aeb057470ab9879c380412b56c/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:51:40.270738 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3874d-b131-4339-8a21-fd7c1844e341 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:40.271572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3874d-b131-4339-8a21-fd7c1844e341 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:40.271855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3874d-b131-4339-8a21-fd7c1844e341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:40.317869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-84a3874d-b131-4339-8a21-fd7c1844e341 None None] MFA Rules not processed for user `94fde9aeb057470ab9879c380412b56c`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:40.319194 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-84a3874d-b131-4339-8a21-fd7c1844e341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:40.463698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1017/2060] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:40.475192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac2139-eb18-4504-90fb-66776e83a159 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:40.477302 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a5ac2139-eb18-4504-90fb-66776e83a159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:40.487814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3874d-b131-4339-8a21-fd7c1844e341 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:40.490867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-84a3874d-b131-4339-8a21-fd7c1844e341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:40.598081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac2139-eb18-4504-90fb-66776e83a159 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:40.602468 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdde940-8049-4e79-bdd7-0534495e63d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:40.603220 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde940-8049-4e79-bdd7-0534495e63d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:40.603509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde940-8049-4e79-bdd7-0534495e63d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:40.603836 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde940-8049-4e79-bdd7-0534495e63d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:40.614425 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdde940-8049-4e79-bdd7-0534495e63d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:40.614610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3874d-b131-4339-8a21-fd7c1844e341 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:40.616337 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdde940-8049-4e79-bdd7-0534495e63d0 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:40.625021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1095b6-cb6c-4bcc-9b86-abe1fc7ff8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:40.625021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1095b6-cb6c-4bcc-9b86-abe1fc7ff8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:40.625021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1095b6-cb6c-4bcc-9b86-abe1fc7ff8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:40.625021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1095b6-cb6c-4bcc-9b86-abe1fc7ff8ca admin admin] PATH_INFO: `/v3/projects/5d47c3bb530c4ca9ad5aad890de78095` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:40.625370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1095b6-cb6c-4bcc-9b86-abe1fc7ff8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d47c3bb530c4ca9ad5aad890de78095)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:40.625370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1095b6-cb6c-4bcc-9b86-abe1fc7ff8ca admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:40.627575 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1044/2061] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:51:40.816168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ab1095b6-cb6c-4bcc-9b86-abe1fc7ff8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d47c3bb530c4ca9ad5aad890de78095', 'request_id': 'req-ab1095b6-cb6c-4bcc-9b86-abe1fc7ff8ca'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:40.823296 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ab1095b6-cb6c-4bcc-9b86-abe1fc7ff8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d47c3bb530c4ca9ad5aad890de78095', 'request_id': 'req-ab1095b6-cb6c-4bcc-9b86-abe1fc7ff8ca'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:40.916309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ab1095b6-cb6c-4bcc-9b86-abe1fc7ff8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d47c3bb530c4ca9ad5aad890de78095', 'request_id': 'req-ab1095b6-cb6c-4bcc-9b86-abe1fc7ff8ca'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:40.932304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ab1095b6-cb6c-4bcc-9b86-abe1fc7ff8ca admin admin] The token cache is being invalidate because project 5d47c3bb530c4ca9ad5aad890de78095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:40.932637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ab1095b6-cb6c-4bcc-9b86-abe1fc7ff8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:40.933321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ab1095b6-cb6c-4bcc-9b86-abe1fc7ff8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:40.935698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1018/2062] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:40 2022] DELETE /identity/v3/projects/5d47c3bb530c4ca9ad5aad890de78095 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:40.940665 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc93f-3dea-44b6-8094-74502926d2cc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:40.941205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc93f-3dea-44b6-8094-74502926d2cc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:40.941205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc93f-3dea-44b6-8094-74502926d2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:40.961004 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4e0fc93f-3dea-44b6-8094-74502926d2cc None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:40.962267 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4e0fc93f-3dea-44b6-8094-74502926d2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:41.061267 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1045/2063] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:41.070855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b4a42-5ed6-4334-a32a-9b14f772f69e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:41.071152 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b4a42-5ed6-4334-a32a-9b14f772f69e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:41.071707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b4a42-5ed6-4334-a32a-9b14f772f69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:41.093269 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1b8b4a42-5ed6-4334-a32a-9b14f772f69e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:41.094490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1b8b4a42-5ed6-4334-a32a-9b14f772f69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:41.102684 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1019/2064] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:41.107553 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fc93f-3dea-44b6-8094-74502926d2cc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:41.117664 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fc93f-3dea-44b6-8094-74502926d2cc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:41.122482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bc321-a891-446a-bf96-f329f19ff6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:41.123154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bc321-a891-446a-bf96-f329f19ff6fb admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:41.123431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bc321-a891-446a-bf96-f329f19ff6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:41.123704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bc321-a891-446a-bf96-f329f19ff6fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:41.124465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bc321-a891-446a-bf96-f329f19ff6fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:51:41.124769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bc321-a891-446a-bf96-f329f19ff6fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:41.126404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bc321-a891-446a-bf96-f329f19ff6fb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:41.140124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1046/2065] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:51:41.144396 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b4a42-5ed6-4334-a32a-9b14f772f69e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:41.155764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b4a42-5ed6-4334-a32a-9b14f772f69e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:41.161042 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04348836-4217-4698-be7e-0e0884c3d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:41.161815 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04348836-4217-4698-be7e-0e0884c3d2ad admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:41.162084 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04348836-4217-4698-be7e-0e0884c3d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:41.162363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04348836-4217-4698-be7e-0e0884c3d2ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:41.163224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04348836-4217-4698-be7e-0e0884c3d2ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:41.165264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04348836-4217-4698-be7e-0e0884c3d2ad admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:41.283892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1020/2066] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:41 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:41.289545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bc321-a891-446a-bf96-f329f19ff6fb admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:41.304646 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bc321-a891-446a-bf96-f329f19ff6fb admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:41.410945 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53919f-6a4c-4141-82b0-034ecd9d0b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:41.411641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53919f-6a4c-4141-82b0-034ecd9d0b9d admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:41.412096 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53919f-6a4c-4141-82b0-034ecd9d0b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:41.412371 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53919f-6a4c-4141-82b0-034ecd9d0b9d admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:41.413115 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53919f-6a4c-4141-82b0-034ecd9d0b9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:41.415005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53919f-6a4c-4141-82b0-034ecd9d0b9d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:41.544404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1047/2067] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:41 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:41.546191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04348836-4217-4698-be7e-0e0884c3d2ad admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:41.570548 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04348836-4217-4698-be7e-0e0884c3d2ad admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:41.584966 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b8230-020c-4fed-a868-d52eb7f07422 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:41.585324 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b8230-020c-4fed-a868-d52eb7f07422 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:41.585674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b8230-020c-4fed-a868-d52eb7f07422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:41.588774 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200115ba-d107-4e8c-b25a-a9c180e36820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:41.589736 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200115ba-d107-4e8c-b25a-a9c180e36820 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:41.590151 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200115ba-d107-4e8c-b25a-a9c180e36820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:41.590554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200115ba-d107-4e8c-b25a-a9c180e36820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:41.592110 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200115ba-d107-4e8c-b25a-a9c180e36820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:41.594810 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200115ba-d107-4e8c-b25a-a9c180e36820 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:41.610549 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-118b8230-020c-4fed-a868-d52eb7f07422 None None] MFA Rules not processed for user `546c3447688f473fb256f4bc3dd99188`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:41.612310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-118b8230-020c-4fed-a868-d52eb7f07422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:41.612756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1021/2068] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:41.616721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200115ba-d107-4e8c-b25a-a9c180e36820 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:41.628921 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200115ba-d107-4e8c-b25a-a9c180e36820 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:41.652283 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd27ee-088b-4d53-9507-3c021b75152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:41.657888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd27ee-088b-4d53-9507-3c021b75152d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:41.671771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd27ee-088b-4d53-9507-3c021b75152d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:41.672692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd27ee-088b-4d53-9507-3c021b75152d admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:41.682418 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd27ee-088b-4d53-9507-3c021b75152d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:41.688602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd27ee-088b-4d53-9507-3c021b75152d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:41.722237 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1022/2069] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:41.722433 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1048/2070] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:51:41.722541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd27ee-088b-4d53-9507-3c021b75152d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:41.773434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd27ee-088b-4d53-9507-3c021b75152d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:41.779081 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9248da3-6a46-4d52-810f-329f9cef5dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:41.780250 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9248da3-6a46-4d52-810f-329f9cef5dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:41.780761 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9248da3-6a46-4d52-810f-329f9cef5dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:41.781188 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9248da3-6a46-4d52-810f-329f9cef5dc4 admin admin] PATH_INFO: `/v3/projects/3d12b99d6e3346e59a208a9e8f3a6757/users/b9072f0e5c2241dcb3036d3c53f7df6a/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:41.812736 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9248da3-6a46-4d52-810f-329f9cef5dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d12b99d6e3346e59a208a9e8f3a6757, user_id=b9072f0e5c2241dcb3036d3c53f7df6a, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:41.815804 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9248da3-6a46-4d52-810f-329f9cef5dc4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:41.909131 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1023/2071] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:41 2022] PUT /identity/v3/projects/3d12b99d6e3346e59a208a9e8f3a6757/users/b9072f0e5c2241dcb3036d3c53f7df6a/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:41.921322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470d004-3449-4a87-a03c-a8dcd6e7ea02 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:41.921747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470d004-3449-4a87-a03c-a8dcd6e7ea02 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:41.922437 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470d004-3449-4a87-a03c-a8dcd6e7ea02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:41.963201 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a470d004-3449-4a87-a03c-a8dcd6e7ea02 None None] MFA Rules not processed for user `b9072f0e5c2241dcb3036d3c53f7df6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:41.964424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a470d004-3449-4a87-a03c-a8dcd6e7ea02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:42.066270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1049/2072] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:51:42.067412 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9248da3-6a46-4d52-810f-329f9cef5dc4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:42.159294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9248da3-6a46-4d52-810f-329f9cef5dc4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:42.164542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55441a93-0858-4c8b-8478-77b1c08ef266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:42.165672 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55441a93-0858-4c8b-8478-77b1c08ef266 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:42.165672 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55441a93-0858-4c8b-8478-77b1c08ef266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:42.165843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55441a93-0858-4c8b-8478-77b1c08ef266 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:42.166823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55441a93-0858-4c8b-8478-77b1c08ef266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:42.169783 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55441a93-0858-4c8b-8478-77b1c08ef266 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:42.257915 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1024/2073] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:42 2022] POST /identity/v3/projects => generated 375 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:42.262365 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470d004-3449-4a87-a03c-a8dcd6e7ea02 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:42.270512 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55441a93-0858-4c8b-8478-77b1c08ef266 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:42.272424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-55441a93-0858-4c8b-8478-77b1c08ef266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:42.277706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470d004-3449-4a87-a03c-a8dcd6e7ea02 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:42.355285 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55441a93-0858-4c8b-8478-77b1c08ef266 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:42.356153 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d25f6a-be5a-4a9d-ad02-121478628334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:42.357044 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d25f6a-be5a-4a9d-ad02-121478628334 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:42.357301 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d25f6a-be5a-4a9d-ad02-121478628334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:42.357572 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d25f6a-be5a-4a9d-ad02-121478628334 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:42.358512 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d25f6a-be5a-4a9d-ad02-121478628334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:42.360579 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d25f6a-be5a-4a9d-ad02-121478628334 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:42.361091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc0d7e-0c5b-43b2-b566-9b2419884605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:42.362057 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc0d7e-0c5b-43b2-b566-9b2419884605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:42.362415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc0d7e-0c5b-43b2-b566-9b2419884605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:42.362761 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc0d7e-0c5b-43b2-b566-9b2419884605 admin admin] PATH_INFO: `/v3/users/09ef5f02b2c94168ab8f0d2cf4e47ac7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:42.364052 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc0d7e-0c5b-43b2-b566-9b2419884605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09ef5f02b2c94168ab8f0d2cf4e47ac7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:42.366108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc0d7e-0c5b-43b2-b566-9b2419884605 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:42.474939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1050/2074] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:42 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:42.476193 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d25f6a-be5a-4a9d-ad02-121478628334 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:42.486237 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d25f6a-be5a-4a9d-ad02-121478628334 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:42.491121 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045005d5-e893-47aa-acbf-be2863f27b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:42.493884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045005d5-e893-47aa-acbf-be2863f27b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:42.493884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045005d5-e893-47aa-acbf-be2863f27b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:42.493884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045005d5-e893-47aa-acbf-be2863f27b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:42.493884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045005d5-e893-47aa-acbf-be2863f27b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:42.494676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045005d5-e893-47aa-acbf-be2863f27b2b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:42.505155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1051/2075] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:42.509478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045005d5-e893-47aa-acbf-be2863f27b2b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:42.520217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045005d5-e893-47aa-acbf-be2863f27b2b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:42.524822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ae617-e37b-4bb6-baea-2a5a8f56faeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:42.525680 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ae617-e37b-4bb6-baea-2a5a8f56faeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:42.525955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ae617-e37b-4bb6-baea-2a5a8f56faeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:42.526240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ae617-e37b-4bb6-baea-2a5a8f56faeb admin admin] PATH_INFO: `/v3/projects/742aa73ce482437dbb609a1a7e388c8e/users/209c9d47633c439a95a279d93142b457/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:42.548188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ae617-e37b-4bb6-baea-2a5a8f56faeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=742aa73ce482437dbb609a1a7e388c8e, user_id=209c9d47633c439a95a279d93142b457, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:42.551117 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ae617-e37b-4bb6-baea-2a5a8f56faeb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:42.583123 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c6cc0d7e-0c5b-43b2-b566-9b2419884605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09ef5f02b2c94168ab8f0d2cf4e47ac7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:42.595634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c6cc0d7e-0c5b-43b2-b566-9b2419884605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09ef5f02b2c94168ab8f0d2cf4e47ac7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:42.641015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1052/2076] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:42 2022] PUT /identity/v3/projects/742aa73ce482437dbb609a1a7e388c8e/users/209c9d47633c439a95a279d93142b457/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:51:42.645009 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ae617-e37b-4bb6-baea-2a5a8f56faeb admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:42.676867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c6cc0d7e-0c5b-43b2-b566-9b2419884605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09ef5f02b2c94168ab8f0d2cf4e47ac7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:42.684273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c6cc0d7e-0c5b-43b2-b566-9b2419884605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09ef5f02b2c94168ab8f0d2cf4e47ac7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:42.685603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c6cc0d7e-0c5b-43b2-b566-9b2419884605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09ef5f02b2c94168ab8f0d2cf4e47ac7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:42.691703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1025/2077] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:42 2022] DELETE /identity/v3/users/09ef5f02b2c94168ab8f0d2cf4e47ac7 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:51:42.696290 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f7728-5962-4464-8d7c-0742cde2ee10 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:42.696617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f7728-5962-4464-8d7c-0742cde2ee10 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:42.697053 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f7728-5962-4464-8d7c-0742cde2ee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:42.717717 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ae617-e37b-4bb6-baea-2a5a8f56faeb admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:42.725576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-075f7728-5962-4464-8d7c-0742cde2ee10 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:42.726841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-075f7728-5962-4464-8d7c-0742cde2ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:42.777400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297eb534-efc2-4ba4-a502-145c21a3d1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:42.779516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eb534-efc2-4ba4-a502-145c21a3d1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:42.779516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eb534-efc2-4ba4-a502-145c21a3d1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:42.779516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eb534-efc2-4ba4-a502-145c21a3d1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:42.779516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297eb534-efc2-4ba4-a502-145c21a3d1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:42.781124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297eb534-efc2-4ba4-a502-145c21a3d1b4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:42.792707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1053/2078] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:51:42.796625 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297eb534-efc2-4ba4-a502-145c21a3d1b4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:42.798482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-297eb534-efc2-4ba4-a502-145c21a3d1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:42.799750 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1026/2079] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:42.810400 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f7728-5962-4464-8d7c-0742cde2ee10 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:42.814559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297eb534-efc2-4ba4-a502-145c21a3d1b4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:42.816139 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-075f7728-5962-4464-8d7c-0742cde2ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:42.820214 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b71a8-3249-44db-a883-2d57986b56c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:42.821281 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b71a8-3249-44db-a883-2d57986b56c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:42.821633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b71a8-3249-44db-a883-2d57986b56c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:42.821978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b71a8-3249-44db-a883-2d57986b56c1 admin admin] PATH_INFO: `/v3/projects/742aa73ce482437dbb609a1a7e388c8e/users/209c9d47633c439a95a279d93142b457/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:42.824053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b71a8-3249-44db-a883-2d57986b56c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=742aa73ce482437dbb609a1a7e388c8e, user_id=209c9d47633c439a95a279d93142b457, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:42.827455 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b71a8-3249-44db-a883-2d57986b56c1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:42.838426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1054/2080] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:42 2022] PUT /identity/v3/projects/742aa73ce482437dbb609a1a7e388c8e/users/209c9d47633c439a95a279d93142b457/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:51:42.849072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebe5e0-0e6e-4895-b86e-8d32aad81b43 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:42.849363 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebe5e0-0e6e-4895-b86e-8d32aad81b43 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:42.849642 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebe5e0-0e6e-4895-b86e-8d32aad81b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:42.885416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-92ebe5e0-0e6e-4895-b86e-8d32aad81b43 None None] MFA Rules not processed for user `209c9d47633c439a95a279d93142b457`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:42.886750 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-92ebe5e0-0e6e-4895-b86e-8d32aad81b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:42.901662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f7728-5962-4464-8d7c-0742cde2ee10 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:42.967147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a26f1-ade1-4a6f-95c7-c428b7f1dd6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:42.967915 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a26f1-ade1-4a6f-95c7-c428b7f1dd6c service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:42.968210 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a26f1-ade1-4a6f-95c7-c428b7f1dd6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:42.968510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a26f1-ade1-4a6f-95c7-c428b7f1dd6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:42.972289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1055/2081] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:42.987788 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebe5e0-0e6e-4895-b86e-8d32aad81b43 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:42.988889 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-92ebe5e0-0e6e-4895-b86e-8d32aad81b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:43.059623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a26f1-ade1-4a6f-95c7-c428b7f1dd6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:43.061422 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a26f1-ade1-4a6f-95c7-c428b7f1dd6c service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:43.062612 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebe5e0-0e6e-4895-b86e-8d32aad81b43 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:43.066479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d7d8a-0e9c-4cc7-b75a-cc6d911f7e7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:43.067129 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d7d8a-0e9c-4cc7-b75a-cc6d911f7e7c service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:43.067418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d7d8a-0e9c-4cc7-b75a-cc6d911f7e7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:43.067697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d7d8a-0e9c-4cc7-b75a-cc6d911f7e7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:43.069865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d34d7d8a-0e9c-4cc7-b75a-cc6d911f7e7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:43.072522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1027/2082] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:51:43.160656 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d7d8a-0e9c-4cc7-b75a-cc6d911f7e7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:43.162233 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d7d8a-0e9c-4cc7-b75a-cc6d911f7e7c service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:43.173550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1056/2083] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:51:43.691142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a26f1-ade1-4a6f-95c7-c428b7f1dd6c service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:43.694609 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-673a26f1-ade1-4a6f-95c7-c428b7f1dd6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:43.717075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a26f1-ade1-4a6f-95c7-c428b7f1dd6c service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:43.724394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987d906-c38e-4a92-9647-398a2a18448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:43.725891 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987d906-c38e-4a92-9647-398a2a18448c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:43.726374 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987d906-c38e-4a92-9647-398a2a18448c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:43.726858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987d906-c38e-4a92-9647-398a2a18448c admin admin] PATH_INFO: `/v3/projects/1b6c17e91e3842d783b5cced1529eff2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:43.728570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987d906-c38e-4a92-9647-398a2a18448c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6c17e91e3842d783b5cced1529eff2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:43.732232 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987d906-c38e-4a92-9647-398a2a18448c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:43.939406 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7987d906-c38e-4a92-9647-398a2a18448c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6c17e91e3842d783b5cced1529eff2', 'request_id': 'req-7987d906-c38e-4a92-9647-398a2a18448c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:43.961758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7987d906-c38e-4a92-9647-398a2a18448c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6c17e91e3842d783b5cced1529eff2', 'request_id': 'req-7987d906-c38e-4a92-9647-398a2a18448c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:44.082105 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7987d906-c38e-4a92-9647-398a2a18448c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6c17e91e3842d783b5cced1529eff2', 'request_id': 'req-7987d906-c38e-4a92-9647-398a2a18448c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:44.096076 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7987d906-c38e-4a92-9647-398a2a18448c admin admin] The token cache is being invalidate because project 1b6c17e91e3842d783b5cced1529eff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:44.096373 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7987d906-c38e-4a92-9647-398a2a18448c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:44.097073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7987d906-c38e-4a92-9647-398a2a18448c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:44.101948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1028/2084] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:43 2022] DELETE /identity/v3/projects/1b6c17e91e3842d783b5cced1529eff2 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:44.103211 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d7d8a-0e9c-4cc7-b75a-cc6d911f7e7c service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:44.128309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d7d8a-0e9c-4cc7-b75a-cc6d911f7e7c service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:44.189820 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a8fd0-c45c-453c-9396-cd582ef00af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:44.190684 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a8fd0-c45c-453c-9396-cd582ef00af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:44.190959 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a8fd0-c45c-453c-9396-cd582ef00af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:44.191301 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a8fd0-c45c-453c-9396-cd582ef00af3 admin admin] PATH_INFO: `/v3/users/94fde9aeb057470ab9879c380412b56c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:44.192521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a8fd0-c45c-453c-9396-cd582ef00af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94fde9aeb057470ab9879c380412b56c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:44.194602 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a8fd0-c45c-453c-9396-cd582ef00af3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:44.475033 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e63a8fd0-c45c-453c-9396-cd582ef00af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94fde9aeb057470ab9879c380412b56c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:44.562424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e63a8fd0-c45c-453c-9396-cd582ef00af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94fde9aeb057470ab9879c380412b56c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:44.563125 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e63a8fd0-c45c-453c-9396-cd582ef00af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94fde9aeb057470ab9879c380412b56c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:44.573409 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e63a8fd0-c45c-453c-9396-cd582ef00af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94fde9aeb057470ab9879c380412b56c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:44.589912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e63a8fd0-c45c-453c-9396-cd582ef00af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94fde9aeb057470ab9879c380412b56c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:44.597515 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1057/2085] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:44 2022] DELETE /identity/v3/users/94fde9aeb057470ab9879c380412b56c => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:51:45.083353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987d906-c38e-4a92-9647-398a2a18448c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:45.085581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7987d906-c38e-4a92-9647-398a2a18448c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:45.114492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987d906-c38e-4a92-9647-398a2a18448c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:45.207646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e678e-6107-428f-a112-2f6cb1a9677f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:45.208542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e678e-6107-428f-a112-2f6cb1a9677f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:45.208827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e678e-6107-428f-a112-2f6cb1a9677f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:45.209101 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e678e-6107-428f-a112-2f6cb1a9677f admin admin] PATH_INFO: `/v3/projects/4e99e9d6f75a4bab8d37f834ea825a3b` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:45.210298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e678e-6107-428f-a112-2f6cb1a9677f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e99e9d6f75a4bab8d37f834ea825a3b)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:45.212191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e678e-6107-428f-a112-2f6cb1a9677f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:45.350376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ce4e678e-6107-428f-a112-2f6cb1a9677f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e99e9d6f75a4bab8d37f834ea825a3b', 'request_id': 'req-ce4e678e-6107-428f-a112-2f6cb1a9677f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:45.359317 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ce4e678e-6107-428f-a112-2f6cb1a9677f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e99e9d6f75a4bab8d37f834ea825a3b', 'request_id': 'req-ce4e678e-6107-428f-a112-2f6cb1a9677f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:45.431095 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ce4e678e-6107-428f-a112-2f6cb1a9677f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e99e9d6f75a4bab8d37f834ea825a3b', 'request_id': 'req-ce4e678e-6107-428f-a112-2f6cb1a9677f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:45.444279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ce4e678e-6107-428f-a112-2f6cb1a9677f admin admin] The token cache is being invalidate because project 4e99e9d6f75a4bab8d37f834ea825a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:45.444598 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ce4e678e-6107-428f-a112-2f6cb1a9677f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:45.445242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ce4e678e-6107-428f-a112-2f6cb1a9677f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:45.446820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1029/2086] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:45 2022] DELETE /identity/v3/projects/4e99e9d6f75a4bab8d37f834ea825a3b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:45.453053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4c1d4-12c7-44fb-beb1-40ce1af037a7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:45.453578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4c1d4-12c7-44fb-beb1-40ce1af037a7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:45.453806 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4c1d4-12c7-44fb-beb1-40ce1af037a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:45.473363 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-03c4c1d4-12c7-44fb-beb1-40ce1af037a7 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:45.474871 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-03c4c1d4-12c7-44fb-beb1-40ce1af037a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:45.542660 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1058/2087] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:45.550885 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78cd1a-cbc8-4dae-a55a-d14b95594c59 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:45.551772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78cd1a-cbc8-4dae-a55a-d14b95594c59 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:45.552073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78cd1a-cbc8-4dae-a55a-d14b95594c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:45.579171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2d78cd1a-cbc8-4dae-a55a-d14b95594c59 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:45.580623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2d78cd1a-cbc8-4dae-a55a-d14b95594c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:45.590765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1030/2088] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:45.596283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4c1d4-12c7-44fb-beb1-40ce1af037a7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:45.608215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4c1d4-12c7-44fb-beb1-40ce1af037a7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:45.613441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320797c2-8986-4407-bf6a-387a6dc13172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:45.614106 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320797c2-8986-4407-bf6a-387a6dc13172 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:45.614386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320797c2-8986-4407-bf6a-387a6dc13172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:45.614661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320797c2-8986-4407-bf6a-387a6dc13172 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:45.615401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320797c2-8986-4407-bf6a-387a6dc13172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:51:45.615830 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320797c2-8986-4407-bf6a-387a6dc13172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:45.617464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320797c2-8986-4407-bf6a-387a6dc13172 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:45.632483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1059/2089] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:51:45.636128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78cd1a-cbc8-4dae-a55a-d14b95594c59 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:45.649734 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78cd1a-cbc8-4dae-a55a-d14b95594c59 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:45.656959 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef436f1-fbaf-40ec-9d10-71da7ebb3ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:45.658037 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef436f1-fbaf-40ec-9d10-71da7ebb3ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:45.658176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef436f1-fbaf-40ec-9d10-71da7ebb3ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:45.658446 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef436f1-fbaf-40ec-9d10-71da7ebb3ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:45.659178 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef436f1-fbaf-40ec-9d10-71da7ebb3ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:45.661931 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef436f1-fbaf-40ec-9d10-71da7ebb3ec1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:45.761996 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1031/2090] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:45 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:45.766720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320797c2-8986-4407-bf6a-387a6dc13172 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:45.778938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320797c2-8986-4407-bf6a-387a6dc13172 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:45.844426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9afc04-c785-442e-8004-3d57b0930646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:45.845242 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9afc04-c785-442e-8004-3d57b0930646 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:45.845427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9afc04-c785-442e-8004-3d57b0930646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:45.845698 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9afc04-c785-442e-8004-3d57b0930646 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:45.846787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9afc04-c785-442e-8004-3d57b0930646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:45.848353 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9afc04-c785-442e-8004-3d57b0930646 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:45.945495 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1060/2091] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:45 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:45.949592 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef436f1-fbaf-40ec-9d10-71da7ebb3ec1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:45.960543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef436f1-fbaf-40ec-9d10-71da7ebb3ec1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:45.965265 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bce75-f7b1-4a05-903c-33ab4498c99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:45.966015 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bce75-f7b1-4a05-903c-33ab4498c99a admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:45.966892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bce75-f7b1-4a05-903c-33ab4498c99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:45.967198 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bce75-f7b1-4a05-903c-33ab4498c99a admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:45.967904 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bce75-f7b1-4a05-903c-33ab4498c99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:45.969508 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bce75-f7b1-4a05-903c-33ab4498c99a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:45.983836 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1032/2092] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:45.985360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9afc04-c785-442e-8004-3d57b0930646 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:46.000559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9afc04-c785-442e-8004-3d57b0930646 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:46.006242 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab3c63-4e5e-4292-960f-7663b685425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:46.006987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab3c63-4e5e-4292-960f-7663b685425f admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:46.007373 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab3c63-4e5e-4292-960f-7663b685425f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:46.007756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab3c63-4e5e-4292-960f-7663b685425f admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:46.008588 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab3c63-4e5e-4292-960f-7663b685425f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:46.010288 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab3c63-4e5e-4292-960f-7663b685425f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:46.013472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bde04-12ff-491d-a1be-b3cae2101fbc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:46.013933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bde04-12ff-491d-a1be-b3cae2101fbc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:46.014293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bde04-12ff-491d-a1be-b3cae2101fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:46.022099 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1061/2093] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:46.029399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab3c63-4e5e-4292-960f-7663b685425f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:46.041543 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab3c63-4e5e-4292-960f-7663b685425f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:46.046693 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0d62a-66d3-4992-9609-e84beac9f7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:46.047612 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0d62a-66d3-4992-9609-e84beac9f7b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:46.047887 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0d62a-66d3-4992-9609-e84beac9f7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:46.048161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0d62a-66d3-4992-9609-e84beac9f7b6 admin admin] PATH_INFO: `/v3/projects/c06c0c46c9c943d8872174cb55d64c3f/users/783f04dee0244310bfb675637fc292e2/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:46.053282 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b96bde04-12ff-491d-a1be-b3cae2101fbc None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:46.054659 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b96bde04-12ff-491d-a1be-b3cae2101fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:46.063614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0d62a-66d3-4992-9609-e84beac9f7b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06c0c46c9c943d8872174cb55d64c3f, user_id=783f04dee0244310bfb675637fc292e2, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:46.066405 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0d62a-66d3-4992-9609-e84beac9f7b6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:46.114814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1033/2094] 10.222.0.81 () {58 vars in 1009 bytes} [Wed May 4 17:51:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:51:46.157107 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bde04-12ff-491d-a1be-b3cae2101fbc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:46.157626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1062/2095] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:46 2022] PUT /identity/v3/projects/c06c0c46c9c943d8872174cb55d64c3f/users/783f04dee0244310bfb675637fc292e2/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:46.158581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b96bde04-12ff-491d-a1be-b3cae2101fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:46.162482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832aac2c-e5e8-4b59-a890-5afebea080f8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:46.162715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832aac2c-e5e8-4b59-a890-5afebea080f8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:46.162989 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832aac2c-e5e8-4b59-a890-5afebea080f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:46.180047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-832aac2c-e5e8-4b59-a890-5afebea080f8 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:46.181258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-832aac2c-e5e8-4b59-a890-5afebea080f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:46.227866 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bde04-12ff-491d-a1be-b3cae2101fbc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:46.241024 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1063/2096] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:46.252220 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832aac2c-e5e8-4b59-a890-5afebea080f8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:46.253661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-832aac2c-e5e8-4b59-a890-5afebea080f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:46.298978 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae98a0a-1bf1-4364-95c3-c4810c566bc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:46.299941 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae98a0a-1bf1-4364-95c3-c4810c566bc8 service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:46.300376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae98a0a-1bf1-4364-95c3-c4810c566bc8 service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:46.300834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae98a0a-1bf1-4364-95c3-c4810c566bc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:46.324789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832aac2c-e5e8-4b59-a890-5afebea080f8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:46.329643 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190f492-a623-41d4-9553-7ece67858cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:46.330495 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190f492-a623-41d4-9553-7ece67858cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:46.330926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190f492-a623-41d4-9553-7ece67858cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:46.331198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190f492-a623-41d4-9553-7ece67858cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:46.341391 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190f492-a623-41d4-9553-7ece67858cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:46.342899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190f492-a623-41d4-9553-7ece67858cd9 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:46.352279 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1064/2097] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:51:46.362051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae98a0a-1bf1-4364-95c3-c4810c566bc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:46.363746 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae98a0a-1bf1-4364-95c3-c4810c566bc8 service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:46.371996 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1034/2098] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 17:51:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 17:51:47.321568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46f893-dd0c-48f0-b10f-659ce0f4d6c0 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:47.322045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46f893-dd0c-48f0-b10f-659ce0f4d6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:47.322126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46f893-dd0c-48f0-b10f-659ce0f4d6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:47.343683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ae46f893-dd0c-48f0-b10f-659ce0f4d6c0 None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:47.345075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ae46f893-dd0c-48f0-b10f-659ce0f4d6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:47.358316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1065/2099] 10.222.0.81 () {58 vars in 967 bytes} [Wed May 4 17:51:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:51:47.376843 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae98a0a-1bf1-4364-95c3-c4810c566bc8 service swift] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:47.396084 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae98a0a-1bf1-4364-95c3-c4810c566bc8 service swift] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:47.409807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16118428-b4f5-4753-b6a2-c2c09082651e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:47.409807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118428-b4f5-4753-b6a2-c2c09082651e service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:47.409807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118428-b4f5-4753-b6a2-c2c09082651e service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:47.409807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118428-b4f5-4753-b6a2-c2c09082651e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:47.419256 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16118428-b4f5-4753-b6a2-c2c09082651e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:47.421027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16118428-b4f5-4753-b6a2-c2c09082651e service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:47.430316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1035/2100] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 17:51:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 17:51:47.738395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd282a8-4832-4785-8baa-880dc12cf283 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:47.738395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd282a8-4832-4785-8baa-880dc12cf283 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:47.738395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd282a8-4832-4785-8baa-880dc12cf283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:47.765761 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9fd282a8-4832-4785-8baa-880dc12cf283 None None] MFA Rules not processed for user `783f04dee0244310bfb675637fc292e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:47.767215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9fd282a8-4832-4785-8baa-880dc12cf283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:47.848914 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1066/2101] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:47.853636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16118428-b4f5-4753-b6a2-c2c09082651e service swift] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:47.867468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16118428-b4f5-4753-b6a2-c2c09082651e service swift] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:47.873567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e7562-4b5e-42fb-8e2b-5de4cb2ceb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:47.874255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e7562-4b5e-42fb-8e2b-5de4cb2ceb13 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:47.874536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e7562-4b5e-42fb-8e2b-5de4cb2ceb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:47.874812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e7562-4b5e-42fb-8e2b-5de4cb2ceb13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:47.875515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e7562-4b5e-42fb-8e2b-5de4cb2ceb13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:47.877555 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e7562-4b5e-42fb-8e2b-5de4cb2ceb13 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:47.963955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1036/2102] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:47 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:51:47.968346 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd282a8-4832-4785-8baa-880dc12cf283 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:47.979110 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd282a8-4832-4785-8baa-880dc12cf283 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:48.057556 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc4fe6-ab50-48ae-87d1-94ce290ba144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:48.058241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc4fe6-ab50-48ae-87d1-94ce290ba144 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:48.058522 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc4fe6-ab50-48ae-87d1-94ce290ba144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:48.058787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc4fe6-ab50-48ae-87d1-94ce290ba144 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:48.059671 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc4fe6-ab50-48ae-87d1-94ce290ba144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:48.062571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc4fe6-ab50-48ae-87d1-94ce290ba144 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:48.165557 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1067/2103] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:47 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:48.173074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc4fe6-ab50-48ae-87d1-94ce290ba144 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:48.173964 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2885a-822f-44e9-8052-e26af74d48cf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:48.174444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2885a-822f-44e9-8052-e26af74d48cf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:48.174988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2885a-822f-44e9-8052-e26af74d48cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:48.184337 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc4fe6-ab50-48ae-87d1-94ce290ba144 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:48.191348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316b397-096a-4e8c-b4db-6837b2f217bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:48.192105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316b397-096a-4e8c-b4db-6837b2f217bf admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:48.192387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316b397-096a-4e8c-b4db-6837b2f217bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:48.196482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316b397-096a-4e8c-b4db-6837b2f217bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:48.196482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316b397-096a-4e8c-b4db-6837b2f217bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:48.196482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316b397-096a-4e8c-b4db-6837b2f217bf admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:48.203739 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-dff2885a-822f-44e9-8052-e26af74d48cf None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:48.205388 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dff2885a-822f-44e9-8052-e26af74d48cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:48.213369 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1068/2104] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:48.215554 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316b397-096a-4e8c-b4db-6837b2f217bf admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:48.239887 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316b397-096a-4e8c-b4db-6837b2f217bf admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:48.246096 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a642310-78c1-4665-a74a-f4df5345969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:48.246844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a642310-78c1-4665-a74a-f4df5345969a admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:48.247122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a642310-78c1-4665-a74a-f4df5345969a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:48.248324 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a642310-78c1-4665-a74a-f4df5345969a admin admin] PATH_INFO: `/v3/projects/b843a394167b460a931705d934743973/users/e3955260ecb0454a8abe7b0df21dc25c/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:48.280208 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a642310-78c1-4665-a74a-f4df5345969a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b843a394167b460a931705d934743973, user_id=e3955260ecb0454a8abe7b0df21dc25c, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:48.283684 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a642310-78c1-4665-a74a-f4df5345969a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:48.319852 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1037/2105] 10.222.0.81 () {58 vars in 1009 bytes} [Wed May 4 17:51:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:48.341623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2885a-822f-44e9-8052-e26af74d48cf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:48.384732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1069/2106] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:48 2022] PUT /identity/v3/projects/b843a394167b460a931705d934743973/users/e3955260ecb0454a8abe7b0df21dc25c/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:48.389941 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a642310-78c1-4665-a74a-f4df5345969a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:48.472815 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2885a-822f-44e9-8052-e26af74d48cf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:48.494835 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a642310-78c1-4665-a74a-f4df5345969a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:48.501522 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f56bd-1fd5-4bbc-b8a0-3b22b9c7a30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:48.502290 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f56bd-1fd5-4bbc-b8a0-3b22b9c7a30e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:48.502570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f56bd-1fd5-4bbc-b8a0-3b22b9c7a30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:48.502838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f56bd-1fd5-4bbc-b8a0-3b22b9c7a30e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:48.503583 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f56bd-1fd5-4bbc-b8a0-3b22b9c7a30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:48.505282 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f56bd-1fd5-4bbc-b8a0-3b22b9c7a30e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:48.520689 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1070/2107] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:51:48.521909 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f56bd-1fd5-4bbc-b8a0-3b22b9c7a30e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:48.532938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f56bd-1fd5-4bbc-b8a0-3b22b9c7a30e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:48.543420 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779c1e4-c12f-4049-a79b-942b5b3800c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:48.543420 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779c1e4-c12f-4049-a79b-942b5b3800c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:48.543764 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779c1e4-c12f-4049-a79b-942b5b3800c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:48.543923 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779c1e4-c12f-4049-a79b-942b5b3800c2 admin admin] PATH_INFO: `/v3/projects/b843a394167b460a931705d934743973/users/e3955260ecb0454a8abe7b0df21dc25c/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:48.545816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c689bd-433c-4d92-bc2f-566dfbfa1a97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:48.546233 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779c1e4-c12f-4049-a79b-942b5b3800c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b843a394167b460a931705d934743973, user_id=e3955260ecb0454a8abe7b0df21dc25c, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:48.546479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c689bd-433c-4d92-bc2f-566dfbfa1a97 service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:48.546760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c689bd-433c-4d92-bc2f-566dfbfa1a97 service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:48.547033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c689bd-433c-4d92-bc2f-566dfbfa1a97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:48.548939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779c1e4-c12f-4049-a79b-942b5b3800c2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:48.561845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1071/2108] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:48 2022] PUT /identity/v3/projects/b843a394167b460a931705d934743973/users/e3955260ecb0454a8abe7b0df21dc25c/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:48.610281 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c689bd-433c-4d92-bc2f-566dfbfa1a97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:48.612047 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c689bd-433c-4d92-bc2f-566dfbfa1a97 service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:48.620421 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1038/2109] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 17:51:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 17:51:49.270260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6b1d4-418a-4633-806a-8ee6033c8c6f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:49.270543 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6b1d4-418a-4633-806a-8ee6033c8c6f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:49.270815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6b1d4-418a-4633-806a-8ee6033c8c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:49.293496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-bfb6b1d4-418a-4633-806a-8ee6033c8c6f None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:49.295368 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bfb6b1d4-418a-4633-806a-8ee6033c8c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:49.361862 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1072/2110] 10.222.0.81 () {58 vars in 967 bytes} [Wed May 4 17:51:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:49.377001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c689bd-433c-4d92-bc2f-566dfbfa1a97 service swift] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:49.393325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c689bd-433c-4d92-bc2f-566dfbfa1a97 service swift] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:49.506592 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210c55e-a749-47b4-955d-f4b5287cc054 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:49.507281 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210c55e-a749-47b4-955d-f4b5287cc054 service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:49.508036 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210c55e-a749-47b4-955d-f4b5287cc054 service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:49.508483 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210c55e-a749-47b4-955d-f4b5287cc054 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:49.519824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210c55e-a749-47b4-955d-f4b5287cc054 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:49.522091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210c55e-a749-47b4-955d-f4b5287cc054 service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:49.535356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1039/2111] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 17:51:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 17:51:49.671413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6b1d4-418a-4633-806a-8ee6033c8c6f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:49.673634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bfb6b1d4-418a-4633-806a-8ee6033c8c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:49.839716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6b1d4-418a-4633-806a-8ee6033c8c6f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:49.853160 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08aabc-b63a-4481-b5c2-ea54fb977295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:49.854368 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08aabc-b63a-4481-b5c2-ea54fb977295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:49.854829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08aabc-b63a-4481-b5c2-ea54fb977295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:49.855280 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08aabc-b63a-4481-b5c2-ea54fb977295 admin admin] PATH_INFO: `/v3/users/b9072f0e5c2241dcb3036d3c53f7df6a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:49.865827 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08aabc-b63a-4481-b5c2-ea54fb977295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9072f0e5c2241dcb3036d3c53f7df6a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:49.873497 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08aabc-b63a-4481-b5c2-ea54fb977295 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:50.121935 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5a08aabc-b63a-4481-b5c2-ea54fb977295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9072f0e5c2241dcb3036d3c53f7df6a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:50.231121 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5a08aabc-b63a-4481-b5c2-ea54fb977295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9072f0e5c2241dcb3036d3c53f7df6a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:50.232567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5a08aabc-b63a-4481-b5c2-ea54fb977295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9072f0e5c2241dcb3036d3c53f7df6a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:50.243954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5a08aabc-b63a-4481-b5c2-ea54fb977295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9072f0e5c2241dcb3036d3c53f7df6a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:50.260107 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5a08aabc-b63a-4481-b5c2-ea54fb977295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9072f0e5c2241dcb3036d3c53f7df6a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:50.271925 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed93bc-c0f9-4c81-a0c0-258fb0d84bce None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:50.272215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed93bc-c0f9-4c81-a0c0-258fb0d84bce None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:50.275164 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed93bc-c0f9-4c81-a0c0-258fb0d84bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:50.275470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1073/2112] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:49 2022] DELETE /identity/v3/users/b9072f0e5c2241dcb3036d3c53f7df6a => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:50.278131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9127742-2ebd-4a6e-a920-207218356adc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:50.278496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9127742-2ebd-4a6e-a920-207218356adc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:50.279470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9127742-2ebd-4a6e-a920-207218356adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:50.320747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c9127742-2ebd-4a6e-a920-207218356adc None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:50.321989 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c9127742-2ebd-4a6e-a920-207218356adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:50.332399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-74ed93bc-c0f9-4c81-a0c0-258fb0d84bce None None] MFA Rules not processed for user `e3955260ecb0454a8abe7b0df21dc25c`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:50.335535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-74ed93bc-c0f9-4c81-a0c0-258fb0d84bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:50.455145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1074/2113] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:50.461960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1040/2114] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:50 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:50.475107 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9127742-2ebd-4a6e-a920-207218356adc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:50.475899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed93bc-c0f9-4c81-a0c0-258fb0d84bce None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:50.477632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-74ed93bc-c0f9-4c81-a0c0-258fb0d84bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:50.477832 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c9127742-2ebd-4a6e-a920-207218356adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:50.562463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9127742-2ebd-4a6e-a920-207218356adc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:50.564769 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed93bc-c0f9-4c81-a0c0-258fb0d84bce None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:50.570501 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8de489-fab6-4b92-b8f3-c20fd1db19bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:50.571615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de489-fab6-4b92-b8f3-c20fd1db19bd service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:50.572204 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de489-fab6-4b92-b8f3-c20fd1db19bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:50.572566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c089b0-3601-4bad-bf87-4a29894e8bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:50.572968 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de489-fab6-4b92-b8f3-c20fd1db19bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:50.573290 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c089b0-3601-4bad-bf87-4a29894e8bff service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:50.574508 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c089b0-3601-4bad-bf87-4a29894e8bff service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:50.574809 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c089b0-3601-4bad-bf87-4a29894e8bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:50.575933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3e8de489-fab6-4b92-b8f3-c20fd1db19bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:50.591277 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c089b0-3601-4bad-bf87-4a29894e8bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:50.599492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c089b0-3601-4bad-bf87-4a29894e8bff service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:50.608724 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1075/2115] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:51:50.662189 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8de489-fab6-4b92-b8f3-c20fd1db19bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:50.664148 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8de489-fab6-4b92-b8f3-c20fd1db19bd service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:50.694900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1041/2116] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:51:51.419143 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c089b0-3601-4bad-bf87-4a29894e8bff service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:51.421871 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-53c089b0-3601-4bad-bf87-4a29894e8bff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:51.438507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c089b0-3601-4bad-bf87-4a29894e8bff service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:51.449585 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b19bd-775b-4239-9a66-1adc78eee92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:51.449585 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b19bd-775b-4239-9a66-1adc78eee92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:51.449585 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b19bd-775b-4239-9a66-1adc78eee92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:51.449585 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b19bd-775b-4239-9a66-1adc78eee92b admin admin] PATH_INFO: `/v3/projects/3d12b99d6e3346e59a208a9e8f3a6757` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:51.450317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b19bd-775b-4239-9a66-1adc78eee92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d12b99d6e3346e59a208a9e8f3a6757)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:51.450317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b19bd-775b-4239-9a66-1adc78eee92b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:51.604555 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ee1b19bd-775b-4239-9a66-1adc78eee92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d12b99d6e3346e59a208a9e8f3a6757', 'request_id': 'req-ee1b19bd-775b-4239-9a66-1adc78eee92b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:51.612044 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ee1b19bd-775b-4239-9a66-1adc78eee92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d12b99d6e3346e59a208a9e8f3a6757', 'request_id': 'req-ee1b19bd-775b-4239-9a66-1adc78eee92b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:51.618426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ee1b19bd-775b-4239-9a66-1adc78eee92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d12b99d6e3346e59a208a9e8f3a6757', 'request_id': 'req-ee1b19bd-775b-4239-9a66-1adc78eee92b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:51.750727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ee1b19bd-775b-4239-9a66-1adc78eee92b admin admin] The token cache is being invalidate because project 3d12b99d6e3346e59a208a9e8f3a6757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:51.751022 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ee1b19bd-775b-4239-9a66-1adc78eee92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:51.757056 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ee1b19bd-775b-4239-9a66-1adc78eee92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:51.757056 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1076/2117] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:51 2022] DELETE /identity/v3/projects/3d12b99d6e3346e59a208a9e8f3a6757 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:51:51.757369 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8de489-fab6-4b92-b8f3-c20fd1db19bd service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:51.767668 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8de489-fab6-4b92-b8f3-c20fd1db19bd service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:51.833239 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acbde8-725e-42a1-8a9c-6339d5fcc0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:51.834431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acbde8-725e-42a1-8a9c-6339d5fcc0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:51.834725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acbde8-725e-42a1-8a9c-6339d5fcc0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:51.834994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acbde8-725e-42a1-8a9c-6339d5fcc0a2 admin admin] PATH_INFO: `/v3/users/209c9d47633c439a95a279d93142b457` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:51.836187 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acbde8-725e-42a1-8a9c-6339d5fcc0a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=209c9d47633c439a95a279d93142b457)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:51.838152 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acbde8-725e-42a1-8a9c-6339d5fcc0a2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:52.112961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f1acbde8-725e-42a1-8a9c-6339d5fcc0a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '209c9d47633c439a95a279d93142b457'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:52.139523 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f1acbde8-725e-42a1-8a9c-6339d5fcc0a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '209c9d47633c439a95a279d93142b457'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:52.202834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f1acbde8-725e-42a1-8a9c-6339d5fcc0a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '209c9d47633c439a95a279d93142b457'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:52.210182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f1acbde8-725e-42a1-8a9c-6339d5fcc0a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '209c9d47633c439a95a279d93142b457'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:52.210900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f1acbde8-725e-42a1-8a9c-6339d5fcc0a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '209c9d47633c439a95a279d93142b457'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:52.217080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1042/2118] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:51 2022] DELETE /identity/v3/users/209c9d47633c439a95a279d93142b457 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:52.693390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b19bd-775b-4239-9a66-1adc78eee92b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:52.695045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ee1b19bd-775b-4239-9a66-1adc78eee92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:52.718716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b19bd-775b-4239-9a66-1adc78eee92b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:52.758971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acbde8-725e-42a1-8a9c-6339d5fcc0a2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:52.762720 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f1acbde8-725e-42a1-8a9c-6339d5fcc0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:52.810754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc3536-a9f8-4de9-b3dd-1e878bd0ae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:52.811684 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc3536-a9f8-4de9-b3dd-1e878bd0ae0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:52.811969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc3536-a9f8-4de9-b3dd-1e878bd0ae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:52.812416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc3536-a9f8-4de9-b3dd-1e878bd0ae0d admin admin] PATH_INFO: `/v3/projects/742aa73ce482437dbb609a1a7e388c8e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:52.813814 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc3536-a9f8-4de9-b3dd-1e878bd0ae0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=742aa73ce482437dbb609a1a7e388c8e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:52.816038 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc3536-a9f8-4de9-b3dd-1e878bd0ae0d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:52.858583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acbde8-725e-42a1-8a9c-6339d5fcc0a2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:52.862306 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8d2ce-8e05-454f-a7a4-d4ce849c2ee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:52.862954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8d2ce-8e05-454f-a7a4-d4ce849c2ee9 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:52.863236 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8d2ce-8e05-454f-a7a4-d4ce849c2ee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:52.863510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8d2ce-8e05-454f-a7a4-d4ce849c2ee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:52.865480 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-74d8d2ce-8e05-454f-a7a4-d4ce849c2ee9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:52.927752 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8d2ce-8e05-454f-a7a4-d4ce849c2ee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:52.929234 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8d2ce-8e05-454f-a7a4-d4ce849c2ee9 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:52.939064 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1043/2119] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:52 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:51:52.939932 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8d2ce-8e05-454f-a7a4-d4ce849c2ee9 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:52.941280 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-74d8d2ce-8e05-454f-a7a4-d4ce849c2ee9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:52.954677 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8d2ce-8e05-454f-a7a4-d4ce849c2ee9 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:52.959678 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fe037-9ecd-48f1-bd6e-ac314b944643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:52.960639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fe037-9ecd-48f1-bd6e-ac314b944643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:52.960945 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fe037-9ecd-48f1-bd6e-ac314b944643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:52.961303 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fe037-9ecd-48f1-bd6e-ac314b944643 admin admin] PATH_INFO: `/v3/users/279b0a188f344f62be2cc7d4ac278194` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:52.962769 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fe037-9ecd-48f1-bd6e-ac314b944643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=279b0a188f344f62be2cc7d4ac278194)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:52.965466 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fe037-9ecd-48f1-bd6e-ac314b944643 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:52.978018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ccbc3536-a9f8-4de9-b3dd-1e878bd0ae0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '742aa73ce482437dbb609a1a7e388c8e', 'request_id': 'req-ccbc3536-a9f8-4de9-b3dd-1e878bd0ae0d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:52.986536 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ccbc3536-a9f8-4de9-b3dd-1e878bd0ae0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '742aa73ce482437dbb609a1a7e388c8e', 'request_id': 'req-ccbc3536-a9f8-4de9-b3dd-1e878bd0ae0d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:52.998825 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ccbc3536-a9f8-4de9-b3dd-1e878bd0ae0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '742aa73ce482437dbb609a1a7e388c8e', 'request_id': 'req-ccbc3536-a9f8-4de9-b3dd-1e878bd0ae0d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:53.104213 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ccbc3536-a9f8-4de9-b3dd-1e878bd0ae0d admin admin] The token cache is being invalidate because project 742aa73ce482437dbb609a1a7e388c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:53.104531 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ccbc3536-a9f8-4de9-b3dd-1e878bd0ae0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:53.106974 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ccbc3536-a9f8-4de9-b3dd-1e878bd0ae0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:53.120372 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1077/2120] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:52 2022] DELETE /identity/v3/projects/742aa73ce482437dbb609a1a7e388c8e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:53.122965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c61ad-e6d8-4998-8a33-b1b175082e5d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:53.123426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c61ad-e6d8-4998-8a33-b1b175082e5d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:53.123635 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c61ad-e6d8-4998-8a33-b1b175082e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:53.148342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2a7fe037-9ecd-48f1-bd6e-ac314b944643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '279b0a188f344f62be2cc7d4ac278194'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:53.162281 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2a7fe037-9ecd-48f1-bd6e-ac314b944643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '279b0a188f344f62be2cc7d4ac278194'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:53.164598 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8e9c61ad-e6d8-4998-8a33-b1b175082e5d None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:53.166845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8e9c61ad-e6d8-4998-8a33-b1b175082e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:53.282789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1078/2121] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:53.291581 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c30e5-4d72-491f-8fc1-d682fd8513d6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:53.291867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c30e5-4d72-491f-8fc1-d682fd8513d6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:53.292144 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c30e5-4d72-491f-8fc1-d682fd8513d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:53.305739 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2a7fe037-9ecd-48f1-bd6e-ac314b944643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '279b0a188f344f62be2cc7d4ac278194'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:53.313227 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ff4c30e5-4d72-491f-8fc1-d682fd8513d6 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:53.314539 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ff4c30e5-4d72-491f-8fc1-d682fd8513d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:53.314686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2a7fe037-9ecd-48f1-bd6e-ac314b944643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '279b0a188f344f62be2cc7d4ac278194'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:53.315415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2a7fe037-9ecd-48f1-bd6e-ac314b944643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '279b0a188f344f62be2cc7d4ac278194'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:53.322139 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1044/2122] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:52 2022] DELETE /identity/v3/users/279b0a188f344f62be2cc7d4ac278194 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:53.329784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f325c8-0877-4e70-a7b3-29d494feb0e8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:53.330194 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f325c8-0877-4e70-a7b3-29d494feb0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:53.330712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1079/2123] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:51:53.330852 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f325c8-0877-4e70-a7b3-29d494feb0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:53.334838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c30e5-4d72-491f-8fc1-d682fd8513d6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:53.345336 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c30e5-4d72-491f-8fc1-d682fd8513d6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:53.354776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-50f325c8-0877-4e70-a7b3-29d494feb0e8 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:53.355983 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-50f325c8-0877-4e70-a7b3-29d494feb0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:53.407710 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59b01a-89f2-492b-8326-79d8207c08b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:53.408380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59b01a-89f2-492b-8326-79d8207c08b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:53.408775 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59b01a-89f2-492b-8326-79d8207c08b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:53.409076 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59b01a-89f2-492b-8326-79d8207c08b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:53.409824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59b01a-89f2-492b-8326-79d8207c08b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:51:53.410108 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59b01a-89f2-492b-8326-79d8207c08b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:53.411740 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59b01a-89f2-492b-8326-79d8207c08b3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:53.415917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1045/2124] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:51:53.429806 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1080/2125] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:51:53.429991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f325c8-0877-4e70-a7b3-29d494feb0e8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:53.429991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-50f325c8-0877-4e70-a7b3-29d494feb0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:53.430815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59b01a-89f2-492b-8326-79d8207c08b3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:53.442316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59b01a-89f2-492b-8326-79d8207c08b3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:53.448356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a6cca-b256-4c8a-abd1-9644e2413857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:53.449051 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a6cca-b256-4c8a-abd1-9644e2413857 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:53.449516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a6cca-b256-4c8a-abd1-9644e2413857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:53.449747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a6cca-b256-4c8a-abd1-9644e2413857 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:53.451029 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a6cca-b256-4c8a-abd1-9644e2413857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:53.453254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a6cca-b256-4c8a-abd1-9644e2413857 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:53.490730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f325c8-0877-4e70-a7b3-29d494feb0e8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:53.495020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15bb06-a8f6-44fd-8581-c8802896a4c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:53.495667 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15bb06-a8f6-44fd-8581-c8802896a4c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:53.495952 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15bb06-a8f6-44fd-8581-c8802896a4c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:53.496231 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15bb06-a8f6-44fd-8581-c8802896a4c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:53.506309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15bb06-a8f6-44fd-8581-c8802896a4c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:53.507744 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15bb06-a8f6-44fd-8581-c8802896a4c1 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:53.517143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1046/2126] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:51:53.616474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1081/2127] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:53 2022] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:53.620134 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15bb06-a8f6-44fd-8581-c8802896a4c1 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:53.632398 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15bb06-a8f6-44fd-8581-c8802896a4c1 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:53.695131 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392df64e-a9fd-4a2b-ab7e-c65323917b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:53.696161 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df64e-a9fd-4a2b-ab7e-c65323917b30 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:53.697169 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df64e-a9fd-4a2b-ab7e-c65323917b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:53.697460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df64e-a9fd-4a2b-ab7e-c65323917b30 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:53.698174 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392df64e-a9fd-4a2b-ab7e-c65323917b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:53.700432 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392df64e-a9fd-4a2b-ab7e-c65323917b30 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:53.799303 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1047/2128] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:53 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:53.801993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a6cca-b256-4c8a-abd1-9644e2413857 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:53.815157 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a6cca-b256-4c8a-abd1-9644e2413857 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:53.823774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09623261-b7e2-41fb-a6ca-2c0b69710b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:53.824963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09623261-b7e2-41fb-a6ca-2c0b69710b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:53.828004 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09623261-b7e2-41fb-a6ca-2c0b69710b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:53.828004 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09623261-b7e2-41fb-a6ca-2c0b69710b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:53.828004 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09623261-b7e2-41fb-a6ca-2c0b69710b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:53.830473 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09623261-b7e2-41fb-a6ca-2c0b69710b71 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:53.843235 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1082/2129] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:51:53.847126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392df64e-a9fd-4a2b-ab7e-c65323917b30 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:53.858671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392df64e-a9fd-4a2b-ab7e-c65323917b30 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:53.863392 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d18e1-0668-4710-9f3c-4f79f34c52dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:53.864076 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d18e1-0668-4710-9f3c-4f79f34c52dc admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:53.864378 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d18e1-0668-4710-9f3c-4f79f34c52dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:53.864691 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d18e1-0668-4710-9f3c-4f79f34c52dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:53.865425 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d18e1-0668-4710-9f3c-4f79f34c52dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:53.867059 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d18e1-0668-4710-9f3c-4f79f34c52dc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:53.877726 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1048/2130] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:53.881969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09623261-b7e2-41fb-a6ca-2c0b69710b71 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:53.892459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09623261-b7e2-41fb-a6ca-2c0b69710b71 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:53.897472 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bb772-c1bc-4909-a6d2-4adecd3db341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:53.898409 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bb772-c1bc-4909-a6d2-4adecd3db341 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:53.898974 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bb772-c1bc-4909-a6d2-4adecd3db341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:53.899263 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bb772-c1bc-4909-a6d2-4adecd3db341 admin admin] PATH_INFO: `/v3/projects/0b3909633d824f6ea4075c5bc241f14c/users/eb3a7d9870084bc0898603c9c241a401/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:53.914849 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bb772-c1bc-4909-a6d2-4adecd3db341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3909633d824f6ea4075c5bc241f14c, user_id=eb3a7d9870084bc0898603c9c241a401, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:53.918399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bb772-c1bc-4909-a6d2-4adecd3db341 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:53.962245 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d18e1-0668-4710-9f3c-4f79f34c52dc admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:53.964114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fb7d18e1-0668-4710-9f3c-4f79f34c52dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:53.983611 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d18e1-0668-4710-9f3c-4f79f34c52dc admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:53.988826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81e1e4-12c8-4878-80a6-ffe9a9a7eb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:53.989693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81e1e4-12c8-4878-80a6-ffe9a9a7eb41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:53.989983 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81e1e4-12c8-4878-80a6-ffe9a9a7eb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:53.990267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81e1e4-12c8-4878-80a6-ffe9a9a7eb41 admin admin] PATH_INFO: `/v3/projects/5e89d4c345c649ca8c10016ed908e483` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:53.991478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81e1e4-12c8-4878-80a6-ffe9a9a7eb41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e89d4c345c649ca8c10016ed908e483)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:53.993440 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81e1e4-12c8-4878-80a6-ffe9a9a7eb41 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:54.034608 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1083/2131] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:53 2022] PUT /identity/v3/projects/0b3909633d824f6ea4075c5bc241f14c/users/eb3a7d9870084bc0898603c9c241a401/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:54.045388 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18539f0d-a0d2-4e34-8d70-47c837f45905 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:54.045811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18539f0d-a0d2-4e34-8d70-47c837f45905 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:54.046094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18539f0d-a0d2-4e34-8d70-47c837f45905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:54.074427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-18539f0d-a0d2-4e34-8d70-47c837f45905 None None] MFA Rules not processed for user `eb3a7d9870084bc0898603c9c241a401`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:54.075976 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-18539f0d-a0d2-4e34-8d70-47c837f45905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:54.139702 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5e81e1e4-12c8-4878-80a6-ffe9a9a7eb41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e89d4c345c649ca8c10016ed908e483', 'request_id': 'req-5e81e1e4-12c8-4878-80a6-ffe9a9a7eb41'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:54.145430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5e81e1e4-12c8-4878-80a6-ffe9a9a7eb41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e89d4c345c649ca8c10016ed908e483', 'request_id': 'req-5e81e1e4-12c8-4878-80a6-ffe9a9a7eb41'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:54.151736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1084/2132] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:54.163585 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18539f0d-a0d2-4e34-8d70-47c837f45905 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:54.164949 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-18539f0d-a0d2-4e34-8d70-47c837f45905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:54.225573 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18539f0d-a0d2-4e34-8d70-47c837f45905 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:54.267327 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5e81e1e4-12c8-4878-80a6-ffe9a9a7eb41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e89d4c345c649ca8c10016ed908e483', 'request_id': 'req-5e81e1e4-12c8-4878-80a6-ffe9a9a7eb41'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:54.279983 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32644344-4942-45b9-9d21-cfad55d219b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8e2eb70a5d4dd1b3a9bec2bd0a78a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:54.281113 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32644344-4942-45b9-9d21-cfad55d219b4 service glance] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:54.286314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32644344-4942-45b9-9d21-cfad55d219b4 service glance] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:54.286314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32644344-4942-45b9-9d21-cfad55d219b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:54.286828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5e81e1e4-12c8-4878-80a6-ffe9a9a7eb41 admin admin] The token cache is being invalidate because project 5e89d4c345c649ca8c10016ed908e483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:54.286828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5e81e1e4-12c8-4878-80a6-ffe9a9a7eb41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:54.286828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5e81e1e4-12c8-4878-80a6-ffe9a9a7eb41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:54.286828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1049/2133] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:53 2022] DELETE /identity/v3/projects/5e89d4c345c649ca8c10016ed908e483 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:54.291541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0398d-685e-4315-bb13-9d0f07ed6458 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:54.291541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0398d-685e-4315-bb13-9d0f07ed6458 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:54.291541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0398d-685e-4315-bb13-9d0f07ed6458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:54.310141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f9f0398d-685e-4315-bb13-9d0f07ed6458 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:54.311441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f9f0398d-685e-4315-bb13-9d0f07ed6458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:54.390382 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1050/2134] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:51:54.391517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32644344-4942-45b9-9d21-cfad55d219b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:54.393072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32644344-4942-45b9-9d21-cfad55d219b4 service glance] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:54.399176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8d23a-30b8-4ebf-88a4-856de0d0f972 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:54.399575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8d23a-30b8-4ebf-88a4-856de0d0f972 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:54.400934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8d23a-30b8-4ebf-88a4-856de0d0f972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:54.412727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1085/2135] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:51:54.422561 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6be8d23a-30b8-4ebf-88a4-856de0d0f972 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:54.423498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6be8d23a-30b8-4ebf-88a4-856de0d0f972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:54.440239 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1051/2136] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:54.441758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32644344-4942-45b9-9d21-cfad55d219b4 service glance] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:54.450051 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-32644344-4942-45b9-9d21-cfad55d219b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:54.467404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32644344-4942-45b9-9d21-cfad55d219b4 service glance] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:54.472620 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cded149-162f-4a8b-85b3-60c8ee93de4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:54.473326 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cded149-162f-4a8b-85b3-60c8ee93de4d admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:54.473610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cded149-162f-4a8b-85b3-60c8ee93de4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:54.473884 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cded149-162f-4a8b-85b3-60c8ee93de4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:54.475092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cded149-162f-4a8b-85b3-60c8ee93de4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:51:54.475493 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cded149-162f-4a8b-85b3-60c8ee93de4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:54.477352 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cded149-162f-4a8b-85b3-60c8ee93de4d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:54.494504 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1086/2137] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:51:54.501053 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8d23a-30b8-4ebf-88a4-856de0d0f972 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:54.514112 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8d23a-30b8-4ebf-88a4-856de0d0f972 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:54.525141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba2505-8a06-42e8-b99d-2a15f4f866ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:54.525141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba2505-8a06-42e8-b99d-2a15f4f866ff admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:54.525141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba2505-8a06-42e8-b99d-2a15f4f866ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:54.525141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba2505-8a06-42e8-b99d-2a15f4f866ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:54.525434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba2505-8a06-42e8-b99d-2a15f4f866ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:54.526687 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba2505-8a06-42e8-b99d-2a15f4f866ff admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:54.646254 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1052/2138] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:54 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:54.650361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cded149-162f-4a8b-85b3-60c8ee93de4d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:54.666330 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cded149-162f-4a8b-85b3-60c8ee93de4d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:54.737608 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697267c5-7610-4049-b8c2-c69c4045f9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:54.738279 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697267c5-7610-4049-b8c2-c69c4045f9ad admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:54.738560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697267c5-7610-4049-b8c2-c69c4045f9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:54.738831 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697267c5-7610-4049-b8c2-c69c4045f9ad admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:54.739518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697267c5-7610-4049-b8c2-c69c4045f9ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:54.741781 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697267c5-7610-4049-b8c2-c69c4045f9ad admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:54.939743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1087/2139] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:54 2022] POST /identity/v3/users => generated 289 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:54.945545 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba2505-8a06-42e8-b99d-2a15f4f866ff admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:54.960232 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba2505-8a06-42e8-b99d-2a15f4f866ff admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:54.965616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15951b5-6631-421a-bd3b-1db34a72c7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:54.967349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15951b5-6631-421a-bd3b-1db34a72c7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:54.967829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15951b5-6631-421a-bd3b-1db34a72c7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:54.968311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15951b5-6631-421a-bd3b-1db34a72c7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:54.969457 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15951b5-6631-421a-bd3b-1db34a72c7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:54.971389 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15951b5-6631-421a-bd3b-1db34a72c7e2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:54.982635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1053/2140] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:51:54.989746 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697267c5-7610-4049-b8c2-c69c4045f9ad admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:54.999886 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697267c5-7610-4049-b8c2-c69c4045f9ad admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:55.004357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c6ff4-cf58-4d54-87d0-f67b8123ad00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:55.005059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c6ff4-cf58-4d54-87d0-f67b8123ad00 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:55.005334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c6ff4-cf58-4d54-87d0-f67b8123ad00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:55.005604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c6ff4-cf58-4d54-87d0-f67b8123ad00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:55.006316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c6ff4-cf58-4d54-87d0-f67b8123ad00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:55.011856 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c6ff4-cf58-4d54-87d0-f67b8123ad00 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:55.020192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1088/2141] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:55.024249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15951b5-6631-421a-bd3b-1db34a72c7e2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:55.034734 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15951b5-6631-421a-bd3b-1db34a72c7e2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:55.039408 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eeabc-1938-4214-931c-8a95056b2672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:55.040292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eeabc-1938-4214-931c-8a95056b2672 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:55.040597 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eeabc-1938-4214-931c-8a95056b2672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:55.040877 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eeabc-1938-4214-931c-8a95056b2672 admin admin] PATH_INFO: `/v3/projects/15a8c4e6884c42919a5828e77d5abd4f/users/d653275573ef4485ad38892d703f2159/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:55.055893 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eeabc-1938-4214-931c-8a95056b2672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a8c4e6884c42919a5828e77d5abd4f, user_id=d653275573ef4485ad38892d703f2159, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:55.058663 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eeabc-1938-4214-931c-8a95056b2672 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:55.254599 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1054/2142] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:55 2022] PUT /identity/v3/projects/15a8c4e6884c42919a5828e77d5abd4f/users/d653275573ef4485ad38892d703f2159/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:55.259999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9c9c2-85ec-45be-83ab-0bc713b14157 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:55.260281 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9c9c2-85ec-45be-83ab-0bc713b14157 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:55.260583 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9c9c2-85ec-45be-83ab-0bc713b14157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:55.277539 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e8a9c9c2-85ec-45be-83ab-0bc713b14157 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:55.279319 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e8a9c9c2-85ec-45be-83ab-0bc713b14157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:55.342793 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1089/2143] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:55.352472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eeabc-1938-4214-931c-8a95056b2672 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:55.354166 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b95eeabc-1938-4214-931c-8a95056b2672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:55.410841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eeabc-1938-4214-931c-8a95056b2672 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:55.414484 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47cbf6-ba6f-48ad-a3bc-cedcdc4ed49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:55.415123 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47cbf6-ba6f-48ad-a3bc-cedcdc4ed49a service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:55.415411 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47cbf6-ba6f-48ad-a3bc-cedcdc4ed49a service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:55.415693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47cbf6-ba6f-48ad-a3bc-cedcdc4ed49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:55.425449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47cbf6-ba6f-48ad-a3bc-cedcdc4ed49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:55.426869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47cbf6-ba6f-48ad-a3bc-cedcdc4ed49a service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:55.436229 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1055/2144] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:51:55.493954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9c9c2-85ec-45be-83ab-0bc713b14157 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:55.495615 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e8a9c9c2-85ec-45be-83ab-0bc713b14157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:55.507595 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9c9c2-85ec-45be-83ab-0bc713b14157 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:55.512912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d4ddf-d472-4c22-86f6-fb56efd042f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:55.514112 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d4ddf-d472-4c22-86f6-fb56efd042f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:55.514465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d4ddf-d472-4c22-86f6-fb56efd042f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:55.514740 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d4ddf-d472-4c22-86f6-fb56efd042f8 admin admin] PATH_INFO: `/v3/users/614d02bec88b4e079a4d7dce9c29c227` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:55.515965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d4ddf-d472-4c22-86f6-fb56efd042f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=614d02bec88b4e079a4d7dce9c29c227)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:55.517898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d4ddf-d472-4c22-86f6-fb56efd042f8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:55.759286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-917d4ddf-d472-4c22-86f6-fb56efd042f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614d02bec88b4e079a4d7dce9c29c227'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:55.828824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-917d4ddf-d472-4c22-86f6-fb56efd042f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614d02bec88b4e079a4d7dce9c29c227'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:55.829478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-917d4ddf-d472-4c22-86f6-fb56efd042f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614d02bec88b4e079a4d7dce9c29c227'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:55.837939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-917d4ddf-d472-4c22-86f6-fb56efd042f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614d02bec88b4e079a4d7dce9c29c227'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:55.854464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-917d4ddf-d472-4c22-86f6-fb56efd042f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614d02bec88b4e079a4d7dce9c29c227'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:55.861976 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1090/2145] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:51:55 2022] DELETE /identity/v3/users/614d02bec88b4e079a4d7dce9c29c227 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:55.866833 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631983f6-7278-4a6f-bc60-4d277ac7d97a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:55.867123 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631983f6-7278-4a6f-bc60-4d277ac7d97a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:55.867589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631983f6-7278-4a6f-bc60-4d277ac7d97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:55.887104 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-631983f6-7278-4a6f-bc60-4d277ac7d97a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:55.888378 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-631983f6-7278-4a6f-bc60-4d277ac7d97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:55.946816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1056/2146] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:55.956576 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d4ddf-d472-4c22-86f6-fb56efd042f8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:55.958058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-917d4ddf-d472-4c22-86f6-fb56efd042f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:56.019425 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d4ddf-d472-4c22-86f6-fb56efd042f8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:56.023954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93824ee6-9777-4ef4-af6f-c4e475b87467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:56.024115 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93824ee6-9777-4ef4-af6f-c4e475b87467 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:56.024397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93824ee6-9777-4ef4-af6f-c4e475b87467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:56.024735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93824ee6-9777-4ef4-af6f-c4e475b87467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:56.035953 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93824ee6-9777-4ef4-af6f-c4e475b87467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:56.037611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93824ee6-9777-4ef4-af6f-c4e475b87467 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:56.051215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1091/2147] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:51:56.684573 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631983f6-7278-4a6f-bc60-4d277ac7d97a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:56.686874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-631983f6-7278-4a6f-bc60-4d277ac7d97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:56.728649 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631983f6-7278-4a6f-bc60-4d277ac7d97a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:56.735772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646bdf8-4237-4fe0-8f34-aae2513d9c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:56.736828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646bdf8-4237-4fe0-8f34-aae2513d9c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:56.737117 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646bdf8-4237-4fe0-8f34-aae2513d9c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:56.737393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646bdf8-4237-4fe0-8f34-aae2513d9c0e admin admin] PATH_INFO: `/v3/projects/85b3637ef71a4b5fb8daa143b76f221d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:56.738658 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646bdf8-4237-4fe0-8f34-aae2513d9c0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b3637ef71a4b5fb8daa143b76f221d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:56.740756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646bdf8-4237-4fe0-8f34-aae2513d9c0e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:56.883560 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e646bdf8-4237-4fe0-8f34-aae2513d9c0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b3637ef71a4b5fb8daa143b76f221d', 'request_id': 'req-e646bdf8-4237-4fe0-8f34-aae2513d9c0e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:56.891311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e646bdf8-4237-4fe0-8f34-aae2513d9c0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b3637ef71a4b5fb8daa143b76f221d', 'request_id': 'req-e646bdf8-4237-4fe0-8f34-aae2513d9c0e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:56.980138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e646bdf8-4237-4fe0-8f34-aae2513d9c0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b3637ef71a4b5fb8daa143b76f221d', 'request_id': 'req-e646bdf8-4237-4fe0-8f34-aae2513d9c0e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:56.992828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e646bdf8-4237-4fe0-8f34-aae2513d9c0e admin admin] The token cache is being invalidate because project 85b3637ef71a4b5fb8daa143b76f221d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:51:56.993122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e646bdf8-4237-4fe0-8f34-aae2513d9c0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:56.993792 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e646bdf8-4237-4fe0-8f34-aae2513d9c0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:51:56.995353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1057/2148] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:51:56 2022] DELETE /identity/v3/projects/85b3637ef71a4b5fb8daa143b76f221d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:57.000978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe25a7-08ee-4896-afff-103c84cd3209 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:57.001481 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe25a7-08ee-4896-afff-103c84cd3209 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:57.001586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe25a7-08ee-4896-afff-103c84cd3209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:57.020325 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8afe25a7-08ee-4896-afff-103c84cd3209 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:57.021601 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8afe25a7-08ee-4896-afff-103c84cd3209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:57.098758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1092/2149] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:51:57.104949 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4f832-a87c-455d-89f1-ed3345893daa None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:57.105126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4f832-a87c-455d-89f1-ed3345893daa None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:57.105643 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4f832-a87c-455d-89f1-ed3345893daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:57.135330 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a5c4f832-a87c-455d-89f1-ed3345893daa None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:57.136567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a5c4f832-a87c-455d-89f1-ed3345893daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:57.145137 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1058/2150] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:57.149473 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe25a7-08ee-4896-afff-103c84cd3209 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:57.159340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe25a7-08ee-4896-afff-103c84cd3209 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:57.164814 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11978a-22c5-40d7-89b9-f9d29564ff2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:57.165662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11978a-22c5-40d7-89b9-f9d29564ff2f admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:57.166086 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11978a-22c5-40d7-89b9-f9d29564ff2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:57.166496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11978a-22c5-40d7-89b9-f9d29564ff2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:57.167476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11978a-22c5-40d7-89b9-f9d29564ff2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:51:57.167776 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11978a-22c5-40d7-89b9-f9d29564ff2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:57.170520 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11978a-22c5-40d7-89b9-f9d29564ff2f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:57.185408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1093/2151] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:51:57.193635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4f832-a87c-455d-89f1-ed3345893daa None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:57.199014 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4f832-a87c-455d-89f1-ed3345893daa None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:57.204533 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be947b3c-419d-4023-88fc-54012765ac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:57.205170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947b3c-419d-4023-88fc-54012765ac77 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:57.205444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947b3c-419d-4023-88fc-54012765ac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:57.205725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947b3c-419d-4023-88fc-54012765ac77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:57.206457 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947b3c-419d-4023-88fc-54012765ac77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:57.208510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947b3c-419d-4023-88fc-54012765ac77 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:57.348237 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1059/2152] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:51:57 2022] POST /identity/v3/projects => generated 365 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:57.351414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11978a-22c5-40d7-89b9-f9d29564ff2f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:57.362988 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11978a-22c5-40d7-89b9-f9d29564ff2f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:57.440720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb72e5-2fdb-4479-a792-0136a6ec1c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:57.441387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb72e5-2fdb-4479-a792-0136a6ec1c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:57.441670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb72e5-2fdb-4479-a792-0136a6ec1c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:57.441927 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb72e5-2fdb-4479-a792-0136a6ec1c12 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:57.442652 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb72e5-2fdb-4479-a792-0136a6ec1c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:57.444653 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb72e5-2fdb-4479-a792-0136a6ec1c12 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:57.544201 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1094/2153] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:51:57 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:51:57.548569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be947b3c-419d-4023-88fc-54012765ac77 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:57.559544 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be947b3c-419d-4023-88fc-54012765ac77 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:57.565846 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d198ed-6a71-4717-adb6-5374efbd9bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:57.566654 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d198ed-6a71-4717-adb6-5374efbd9bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:57.567181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d198ed-6a71-4717-adb6-5374efbd9bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:57.567727 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d198ed-6a71-4717-adb6-5374efbd9bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:57.568694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d198ed-6a71-4717-adb6-5374efbd9bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:57.570533 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d198ed-6a71-4717-adb6-5374efbd9bd5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:57.596878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1060/2154] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:57.598359 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb72e5-2fdb-4479-a792-0136a6ec1c12 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:57.608747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb72e5-2fdb-4479-a792-0136a6ec1c12 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:57.613459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657db1e5-a238-4b9e-b119-b66eb4cba5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:57.614119 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657db1e5-a238-4b9e-b119-b66eb4cba5ac admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:57.614462 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657db1e5-a238-4b9e-b119-b66eb4cba5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:57.614756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657db1e5-a238-4b9e-b119-b66eb4cba5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:57.615466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657db1e5-a238-4b9e-b119-b66eb4cba5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:57.617096 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657db1e5-a238-4b9e-b119-b66eb4cba5ac admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:57.628163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1095/2155] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:51:57.632521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d198ed-6a71-4717-adb6-5374efbd9bd5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:57.644976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d198ed-6a71-4717-adb6-5374efbd9bd5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:57.651931 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde4fa1-8e8f-4772-b1e5-e32439abc9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:57.653566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde4fa1-8e8f-4772-b1e5-e32439abc9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:57.653566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde4fa1-8e8f-4772-b1e5-e32439abc9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:57.653566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde4fa1-8e8f-4772-b1e5-e32439abc9bb admin admin] PATH_INFO: `/v3/projects/1c1d617a774942c0affc97c4b3968e8c/users/38cac24198a34a4aa30d6cd920b2eae9/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:57.669897 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde4fa1-8e8f-4772-b1e5-e32439abc9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1d617a774942c0affc97c4b3968e8c, user_id=38cac24198a34a4aa30d6cd920b2eae9, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:57.672119 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde4fa1-8e8f-4772-b1e5-e32439abc9bb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:57.793062 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1061/2156] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:51:57 2022] PUT /identity/v3/projects/1c1d617a774942c0affc97c4b3968e8c/users/38cac24198a34a4aa30d6cd920b2eae9/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:51:57.805445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478bb7a-d190-48d4-96d3-6abdacc25a1e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:57.805735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478bb7a-d190-48d4-96d3-6abdacc25a1e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:57.806012 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478bb7a-d190-48d4-96d3-6abdacc25a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:57.837707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b478bb7a-d190-48d4-96d3-6abdacc25a1e None None] MFA Rules not processed for user `38cac24198a34a4aa30d6cd920b2eae9`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:51:57.839202 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b478bb7a-d190-48d4-96d3-6abdacc25a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:57.923838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1096/2157] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:51:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:51:57.931342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde4fa1-8e8f-4772-b1e5-e32439abc9bb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:51:57.933176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3bde4fa1-8e8f-4772-b1e5-e32439abc9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:51:58.009081 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde4fa1-8e8f-4772-b1e5-e32439abc9bb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:51:58.012871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634e94d-14a6-4c06-8eb7-732b50138641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:51:58.014192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634e94d-14a6-4c06-8eb7-732b50138641 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:51:58.014470 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634e94d-14a6-4c06-8eb7-732b50138641 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:51:58.014746 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634e94d-14a6-4c06-8eb7-732b50138641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:51:58.023410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634e94d-14a6-4c06-8eb7-732b50138641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:51:58.024914 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634e94d-14a6-4c06-8eb7-732b50138641 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:51:58.034918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1062/2158] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:51:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:52:03.216122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46995b3-2054-409b-830b-cc1b62c54f12 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:03.217411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46995b3-2054-409b-830b-cc1b62c54f12 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:03.217700 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46995b3-2054-409b-830b-cc1b62c54f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:03.247094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c46995b3-2054-409b-830b-cc1b62c54f12 None None] MFA Rules not processed for user `d653275573ef4485ad38892d703f2159`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:03.248910 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c46995b3-2054-409b-830b-cc1b62c54f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:03.339417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1097/2159] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:03.342331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634e94d-14a6-4c06-8eb7-732b50138641 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:03.343605 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8634e94d-14a6-4c06-8eb7-732b50138641 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:03.422606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634e94d-14a6-4c06-8eb7-732b50138641 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:03.427578 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03493e94-d7c8-488a-96bf-c1ca4f322a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:03.428259 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03493e94-d7c8-488a-96bf-c1ca4f322a56 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:03.428578 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03493e94-d7c8-488a-96bf-c1ca4f322a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:03.428858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03493e94-d7c8-488a-96bf-c1ca4f322a56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:03.429565 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03493e94-d7c8-488a-96bf-c1ca4f322a56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:03.431558 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03493e94-d7c8-488a-96bf-c1ca4f322a56 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:03.545561 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1063/2160] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:52:03 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:52:03.548272 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46995b3-2054-409b-830b-cc1b62c54f12 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:03.567141 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46995b3-2054-409b-830b-cc1b62c54f12 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:03.635456 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798a487-c8a1-41a1-8750-7df48a7004c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:03.636166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798a487-c8a1-41a1-8750-7df48a7004c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:03.636474 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798a487-c8a1-41a1-8750-7df48a7004c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:03.636771 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798a487-c8a1-41a1-8750-7df48a7004c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:03.637463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798a487-c8a1-41a1-8750-7df48a7004c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:03.639906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798a487-c8a1-41a1-8750-7df48a7004c3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:03.736056 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1098/2161] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:52:03 2022] POST /identity/v3/users => generated 296 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:52:03.737373 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03493e94-d7c8-488a-96bf-c1ca4f322a56 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:03.748697 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03493e94-d7c8-488a-96bf-c1ca4f322a56 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:03.753446 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d7cec-15d8-4153-9393-edb9b4c1b4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:03.754106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d7cec-15d8-4153-9393-edb9b4c1b4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:03.754392 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d7cec-15d8-4153-9393-edb9b4c1b4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:03.754786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d7cec-15d8-4153-9393-edb9b4c1b4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:03.755523 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d7cec-15d8-4153-9393-edb9b4c1b4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:03.757238 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d7cec-15d8-4153-9393-edb9b4c1b4d9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:03.780571 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1064/2162] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:52:03.786439 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798a487-c8a1-41a1-8750-7df48a7004c3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:03.799812 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798a487-c8a1-41a1-8750-7df48a7004c3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:03.806419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1212b3e-c46c-40ec-bf38-6cee074287a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:03.809771 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1212b3e-c46c-40ec-bf38-6cee074287a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:03.809771 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1212b3e-c46c-40ec-bf38-6cee074287a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:03.809771 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1212b3e-c46c-40ec-bf38-6cee074287a8 admin admin] PATH_INFO: `/v3/projects/eb6b4b0efdc44ba28313d7ab1bf5e36b/users/6b72f8d3a4e9422fb35b0c2d8d8d6fdc/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:03.830189 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1212b3e-c46c-40ec-bf38-6cee074287a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6b4b0efdc44ba28313d7ab1bf5e36b, user_id=6b72f8d3a4e9422fb35b0c2d8d8d6fdc, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:03.834901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1212b3e-c46c-40ec-bf38-6cee074287a8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:03.979634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1099/2163] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:52:03 2022] PUT /identity/v3/projects/eb6b4b0efdc44ba28313d7ab1bf5e36b/users/6b72f8d3a4e9422fb35b0c2d8d8d6fdc/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:03.981385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d7cec-15d8-4153-9393-edb9b4c1b4d9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:03.996049 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d7cec-15d8-4153-9393-edb9b4c1b4d9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:04.068637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040f78e-c50e-414a-8b97-165914a1cb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:04.069416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040f78e-c50e-414a-8b97-165914a1cb4e admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:04.069730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040f78e-c50e-414a-8b97-165914a1cb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:04.070009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040f78e-c50e-414a-8b97-165914a1cb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:04.070745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040f78e-c50e-414a-8b97-165914a1cb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:04.076406 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040f78e-c50e-414a-8b97-165914a1cb4e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:04.082614 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1065/2164] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:52:04.086862 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1212b3e-c46c-40ec-bf38-6cee074287a8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:04.098050 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1212b3e-c46c-40ec-bf38-6cee074287a8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:04.103138 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76431ec-e0ef-4efa-8f4e-7c6397cddafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:04.104106 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76431ec-e0ef-4efa-8f4e-7c6397cddafe admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:04.104386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76431ec-e0ef-4efa-8f4e-7c6397cddafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:04.104716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76431ec-e0ef-4efa-8f4e-7c6397cddafe admin admin] PATH_INFO: `/v3/projects/eb6b4b0efdc44ba28313d7ab1bf5e36b/users/6b72f8d3a4e9422fb35b0c2d8d8d6fdc/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:04.106722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76431ec-e0ef-4efa-8f4e-7c6397cddafe admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6b4b0efdc44ba28313d7ab1bf5e36b, user_id=6b72f8d3a4e9422fb35b0c2d8d8d6fdc, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:04.110254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76431ec-e0ef-4efa-8f4e-7c6397cddafe admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:04.122412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1100/2165] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:52:04 2022] PUT /identity/v3/projects/eb6b4b0efdc44ba28313d7ab1bf5e36b/users/6b72f8d3a4e9422fb35b0c2d8d8d6fdc/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:11.119278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040f78e-c50e-414a-8b97-165914a1cb4e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:11.121004 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9040f78e-c50e-414a-8b97-165914a1cb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:11.144912 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040f78e-c50e-414a-8b97-165914a1cb4e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:11.240292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6074b-9e60-4844-9c83-c62570ebcefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:11.241283 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6074b-9e60-4844-9c83-c62570ebcefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:11.241563 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6074b-9e60-4844-9c83-c62570ebcefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:11.241837 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6074b-9e60-4844-9c83-c62570ebcefc admin admin] PATH_INFO: `/v3/users/783f04dee0244310bfb675637fc292e2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:11.243132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6074b-9e60-4844-9c83-c62570ebcefc admin admin] RBAC: Authorizing `identity:delete_user(user_id=783f04dee0244310bfb675637fc292e2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:11.245614 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6074b-9e60-4844-9c83-c62570ebcefc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:11.381919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab82621-11f9-43f8-839e-2afc596fd98a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:11.382537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab82621-11f9-43f8-839e-2afc596fd98a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:11.383341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab82621-11f9-43f8-839e-2afc596fd98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:11.422794 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8ab82621-11f9-43f8-839e-2afc596fd98a None None] MFA Rules not processed for user `6b72f8d3a4e9422fb35b0c2d8d8d6fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:11.424073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8ab82621-11f9-43f8-839e-2afc596fd98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:11.473097 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-15c6074b-9e60-4844-9c83-c62570ebcefc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783f04dee0244310bfb675637fc292e2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:11.488097 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-15c6074b-9e60-4844-9c83-c62570ebcefc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783f04dee0244310bfb675637fc292e2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:11.512069 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1101/2166] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:11.526292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab82621-11f9-43f8-839e-2afc596fd98a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:11.528568 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8ab82621-11f9-43f8-839e-2afc596fd98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:11.589962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-15c6074b-9e60-4844-9c83-c62570ebcefc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783f04dee0244310bfb675637fc292e2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:11.600208 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-15c6074b-9e60-4844-9c83-c62570ebcefc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783f04dee0244310bfb675637fc292e2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:11.601324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-15c6074b-9e60-4844-9c83-c62570ebcefc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783f04dee0244310bfb675637fc292e2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:11.611235 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1066/2167] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:52:11 2022] DELETE /identity/v3/users/783f04dee0244310bfb675637fc292e2 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:11.713733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab82621-11f9-43f8-839e-2afc596fd98a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:11.834552 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bf4cb-8a47-4a59-8466-c268fa53ce65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:11.835454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bf4cb-8a47-4a59-8466-c268fa53ce65 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:11.835738 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bf4cb-8a47-4a59-8466-c268fa53ce65 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:11.836080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bf4cb-8a47-4a59-8466-c268fa53ce65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:11.842229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d72bf4cb-8a47-4a59-8466-c268fa53ce65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:11.924462 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bf4cb-8a47-4a59-8466-c268fa53ce65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:11.926837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bf4cb-8a47-4a59-8466-c268fa53ce65 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:11.941622 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1102/2168] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:52:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:52:11.946973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6074b-9e60-4844-9c83-c62570ebcefc admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:11.948827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-15c6074b-9e60-4844-9c83-c62570ebcefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:12.072649 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6074b-9e60-4844-9c83-c62570ebcefc admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:12.080054 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:12.080954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:12.081414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:12.081832 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1 admin admin] PATH_INFO: `/v3/projects/c06c0c46c9c943d8872174cb55d64c3f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:12.083213 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c06c0c46c9c943d8872174cb55d64c3f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:12.085905 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:12.249063 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c06c0c46c9c943d8872174cb55d64c3f', 'request_id': 'req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:12.260593 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c06c0c46c9c943d8872174cb55d64c3f', 'request_id': 'req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:12.342817 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c06c0c46c9c943d8872174cb55d64c3f', 'request_id': 'req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:12.358083 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1 admin admin] The token cache is being invalidate because project c06c0c46c9c943d8872174cb55d64c3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:52:12.358608 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:12.359521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:12.361459 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1067/2169] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:52:11 2022] DELETE /identity/v3/projects/c06c0c46c9c943d8872174cb55d64c3f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:12.365385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bf4cb-8a47-4a59-8466-c268fa53ce65 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:12.384938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bf4cb-8a47-4a59-8466-c268fa53ce65 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:12.452084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aacc07-4021-4a56-afb4-9cd0bb7993af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:12.453045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aacc07-4021-4a56-afb4-9cd0bb7993af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:12.453324 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aacc07-4021-4a56-afb4-9cd0bb7993af admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:12.453596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aacc07-4021-4a56-afb4-9cd0bb7993af admin admin] PATH_INFO: `/v3/users/e3955260ecb0454a8abe7b0df21dc25c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:12.454809 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aacc07-4021-4a56-afb4-9cd0bb7993af admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3955260ecb0454a8abe7b0df21dc25c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:12.456821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aacc07-4021-4a56-afb4-9cd0bb7993af admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:12.737871 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f1aacc07-4021-4a56-afb4-9cd0bb7993af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3955260ecb0454a8abe7b0df21dc25c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:12.881070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f1aacc07-4021-4a56-afb4-9cd0bb7993af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3955260ecb0454a8abe7b0df21dc25c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:12.881798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f1aacc07-4021-4a56-afb4-9cd0bb7993af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3955260ecb0454a8abe7b0df21dc25c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:12.890837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f1aacc07-4021-4a56-afb4-9cd0bb7993af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3955260ecb0454a8abe7b0df21dc25c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:12.905505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f1aacc07-4021-4a56-afb4-9cd0bb7993af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3955260ecb0454a8abe7b0df21dc25c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:12.914927 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1103/2170] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:52:12 2022] DELETE /identity/v3/users/e3955260ecb0454a8abe7b0df21dc25c => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:52:13.213605 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:13.215071 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:13.229506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c274b0-f0f4-4b96-972c-a9b2b2b50ee1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:13.309823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4b43b-a6c1-4ba3-8da4-90a9b832ec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:13.311417 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4b43b-a6c1-4ba3-8da4-90a9b832ec2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:13.311694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4b43b-a6c1-4ba3-8da4-90a9b832ec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:13.313732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4b43b-a6c1-4ba3-8da4-90a9b832ec2d admin admin] PATH_INFO: `/v3/projects/b843a394167b460a931705d934743973` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:13.313732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4b43b-a6c1-4ba3-8da4-90a9b832ec2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b843a394167b460a931705d934743973)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:13.315573 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4b43b-a6c1-4ba3-8da4-90a9b832ec2d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:13.446493 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8ca4b43b-a6c1-4ba3-8da4-90a9b832ec2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b843a394167b460a931705d934743973', 'request_id': 'req-8ca4b43b-a6c1-4ba3-8da4-90a9b832ec2d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:13.454444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8ca4b43b-a6c1-4ba3-8da4-90a9b832ec2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b843a394167b460a931705d934743973', 'request_id': 'req-8ca4b43b-a6c1-4ba3-8da4-90a9b832ec2d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:13.532942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8ca4b43b-a6c1-4ba3-8da4-90a9b832ec2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b843a394167b460a931705d934743973', 'request_id': 'req-8ca4b43b-a6c1-4ba3-8da4-90a9b832ec2d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:13.542211 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8ca4b43b-a6c1-4ba3-8da4-90a9b832ec2d admin admin] The token cache is being invalidate because project b843a394167b460a931705d934743973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:52:13.542500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8ca4b43b-a6c1-4ba3-8da4-90a9b832ec2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:13.543141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8ca4b43b-a6c1-4ba3-8da4-90a9b832ec2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:13.545581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1068/2171] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:52:13 2022] DELETE /identity/v3/projects/b843a394167b460a931705d934743973 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:13.551404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ba0c0-c379-49d5-8994-1b31a3ac2d89 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:13.552522 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ba0c0-c379-49d5-8994-1b31a3ac2d89 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:13.552752 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ba0c0-c379-49d5-8994-1b31a3ac2d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:13.575502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-092ba0c0-c379-49d5-8994-1b31a3ac2d89 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:13.577605 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-092ba0c0-c379-49d5-8994-1b31a3ac2d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:13.664828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1104/2172] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:13.672785 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052c80d-2a76-426c-8953-831669dcd90b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:13.673121 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052c80d-2a76-426c-8953-831669dcd90b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:13.673402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052c80d-2a76-426c-8953-831669dcd90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:13.695902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5052c80d-2a76-426c-8953-831669dcd90b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:13.697276 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5052c80d-2a76-426c-8953-831669dcd90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:13.708149 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1069/2173] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:13.712335 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ba0c0-c379-49d5-8994-1b31a3ac2d89 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:13.722881 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ba0c0-c379-49d5-8994-1b31a3ac2d89 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:13.729074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5947c31-fbb8-4066-ad1d-f011ead7689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:13.730230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5947c31-fbb8-4066-ad1d-f011ead7689c admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:13.730508 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5947c31-fbb8-4066-ad1d-f011ead7689c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:13.730786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5947c31-fbb8-4066-ad1d-f011ead7689c admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:13.731529 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5947c31-fbb8-4066-ad1d-f011ead7689c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:52:13.733019 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5947c31-fbb8-4066-ad1d-f011ead7689c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:13.735411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5947c31-fbb8-4066-ad1d-f011ead7689c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:13.758698 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1105/2174] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:52:13.764489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052c80d-2a76-426c-8953-831669dcd90b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:13.777199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052c80d-2a76-426c-8953-831669dcd90b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:13.782882 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf0f32-7f12-4fa9-9675-588c8f3fecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:13.783754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf0f32-7f12-4fa9-9675-588c8f3fecb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:13.784219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf0f32-7f12-4fa9-9675-588c8f3fecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:13.784652 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf0f32-7f12-4fa9-9675-588c8f3fecb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:13.785283 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf0f32-7f12-4fa9-9675-588c8f3fecb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:13.787199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf0f32-7f12-4fa9-9675-588c8f3fecb9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:13.941163 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1070/2175] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:52:13 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:52:13.945429 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5947c31-fbb8-4066-ad1d-f011ead7689c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:13.958132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5947c31-fbb8-4066-ad1d-f011ead7689c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:14.040265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c867113-3433-49e5-b404-749671c9b7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:14.041584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c867113-3433-49e5-b404-749671c9b7ab admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:14.042239 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c867113-3433-49e5-b404-749671c9b7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:14.042716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c867113-3433-49e5-b404-749671c9b7ab admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:14.043665 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c867113-3433-49e5-b404-749671c9b7ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:14.046972 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c867113-3433-49e5-b404-749671c9b7ab admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:14.204307 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1106/2176] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:52:13 2022] POST /identity/v3/users => generated 288 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:52:14.205571 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf0f32-7f12-4fa9-9675-588c8f3fecb9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:14.216285 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf0f32-7f12-4fa9-9675-588c8f3fecb9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:14.221958 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ede351-a687-40d7-a599-c88053056b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:14.222750 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ede351-a687-40d7-a599-c88053056b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:14.222965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ede351-a687-40d7-a599-c88053056b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:14.223203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ede351-a687-40d7-a599-c88053056b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:14.223928 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ede351-a687-40d7-a599-c88053056b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:14.225609 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ede351-a687-40d7-a599-c88053056b5c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:14.237349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1071/2177] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:52:14.241530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c867113-3433-49e5-b404-749671c9b7ab admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:14.252193 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c867113-3433-49e5-b404-749671c9b7ab admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:14.257089 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91563826-cbf4-484e-95db-b4a13140ce7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:14.257828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91563826-cbf4-484e-95db-b4a13140ce7e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:14.261818 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91563826-cbf4-484e-95db-b4a13140ce7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:14.261818 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91563826-cbf4-484e-95db-b4a13140ce7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:14.261818 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91563826-cbf4-484e-95db-b4a13140ce7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:14.261818 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91563826-cbf4-484e-95db-b4a13140ce7e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:14.272758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1107/2178] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:52:14.276034 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ede351-a687-40d7-a599-c88053056b5c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:14.287581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ede351-a687-40d7-a599-c88053056b5c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:14.295772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09594a32-e442-4c62-b971-6784e2441934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:14.297121 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594a32-e442-4c62-b971-6784e2441934 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:14.297421 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594a32-e442-4c62-b971-6784e2441934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:14.297700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594a32-e442-4c62-b971-6784e2441934 admin admin] PATH_INFO: `/v3/projects/20ebce442c2445adaec8c1dcdfc10ce2/users/934da6ed87864f659aa6c603832b1f7c/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:14.319578 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09594a32-e442-4c62-b971-6784e2441934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20ebce442c2445adaec8c1dcdfc10ce2, user_id=934da6ed87864f659aa6c603832b1f7c, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:14.334458 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09594a32-e442-4c62-b971-6784e2441934 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:14.410994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1072/2179] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:52:14 2022] PUT /identity/v3/projects/20ebce442c2445adaec8c1dcdfc10ce2/users/934da6ed87864f659aa6c603832b1f7c/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:52:14.423936 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78858d5-7125-4d88-adb5-553896eea28e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:14.424227 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78858d5-7125-4d88-adb5-553896eea28e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:14.424516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78858d5-7125-4d88-adb5-553896eea28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:14.452181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b78858d5-7125-4d88-adb5-553896eea28e None None] MFA Rules not processed for user `934da6ed87864f659aa6c603832b1f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:14.453467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b78858d5-7125-4d88-adb5-553896eea28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:14.539801 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1108/2180] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:14.544777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09594a32-e442-4c62-b971-6784e2441934 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:14.613531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09594a32-e442-4c62-b971-6784e2441934 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:14.627174 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e5287-1874-4a62-9d4c-d3c4ed6fffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:14.630961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e5287-1874-4a62-9d4c-d3c4ed6fffe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:14.630961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e5287-1874-4a62-9d4c-d3c4ed6fffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:14.630961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e5287-1874-4a62-9d4c-d3c4ed6fffe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:14.630961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e5287-1874-4a62-9d4c-d3c4ed6fffe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:14.635106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e5287-1874-4a62-9d4c-d3c4ed6fffe5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:14.771952 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1073/2181] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:52:14 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:52:14.776335 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78858d5-7125-4d88-adb5-553896eea28e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:14.791421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78858d5-7125-4d88-adb5-553896eea28e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:14.862311 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2ff26-a9e0-4982-8b96-bbb29317461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:14.863122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2ff26-a9e0-4982-8b96-bbb29317461a admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:14.863593 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2ff26-a9e0-4982-8b96-bbb29317461a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:14.868217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2ff26-a9e0-4982-8b96-bbb29317461a admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:14.868217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2ff26-a9e0-4982-8b96-bbb29317461a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:14.868217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2ff26-a9e0-4982-8b96-bbb29317461a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:14.958733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1109/2182] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:52:14 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:52:14.962830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e5287-1874-4a62-9d4c-d3c4ed6fffe5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:14.975711 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e5287-1874-4a62-9d4c-d3c4ed6fffe5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:14.982258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98d030-29ca-4bca-9160-cf1b8bbfceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:14.983508 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98d030-29ca-4bca-9160-cf1b8bbfceb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:14.983799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98d030-29ca-4bca-9160-cf1b8bbfceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:14.984119 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98d030-29ca-4bca-9160-cf1b8bbfceb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:14.985025 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98d030-29ca-4bca-9160-cf1b8bbfceb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:14.986643 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98d030-29ca-4bca-9160-cf1b8bbfceb4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:14.999029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1074/2183] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:52:15.003225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2ff26-a9e0-4982-8b96-bbb29317461a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:15.014097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2ff26-a9e0-4982-8b96-bbb29317461a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:15.019047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea0a9c-224d-4898-b105-8b440583253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:15.019723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea0a9c-224d-4898-b105-8b440583253e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:15.023399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea0a9c-224d-4898-b105-8b440583253e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:15.023399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea0a9c-224d-4898-b105-8b440583253e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:15.023399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea0a9c-224d-4898-b105-8b440583253e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:15.023399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea0a9c-224d-4898-b105-8b440583253e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:15.034312 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1110/2184] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:52:15.038608 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98d030-29ca-4bca-9160-cf1b8bbfceb4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:15.050301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98d030-29ca-4bca-9160-cf1b8bbfceb4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:15.055922 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecd426-a473-4a9c-a50f-a94a671f5286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:15.056097 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecd426-a473-4a9c-a50f-a94a671f5286 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:15.056378 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecd426-a473-4a9c-a50f-a94a671f5286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:15.056688 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecd426-a473-4a9c-a50f-a94a671f5286 admin admin] PATH_INFO: `/v3/projects/016c2ed8078e41bebc19e253bda387e3/users/be242589b5ca4d76a0dcafc04d82480a/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:15.071664 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecd426-a473-4a9c-a50f-a94a671f5286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=016c2ed8078e41bebc19e253bda387e3, user_id=be242589b5ca4d76a0dcafc04d82480a, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:15.074358 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecd426-a473-4a9c-a50f-a94a671f5286 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:15.207047 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1075/2185] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:52:15 2022] PUT /identity/v3/projects/016c2ed8078e41bebc19e253bda387e3/users/be242589b5ca4d76a0dcafc04d82480a/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:15.218117 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a3524-6fcd-4eba-a605-b93ed041989f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:15.218638 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a3524-6fcd-4eba-a605-b93ed041989f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:15.219064 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a3524-6fcd-4eba-a605-b93ed041989f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:15.272638 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7e1a3524-6fcd-4eba-a605-b93ed041989f None None] MFA Rules not processed for user `be242589b5ca4d76a0dcafc04d82480a`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:15.274387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7e1a3524-6fcd-4eba-a605-b93ed041989f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:15.391116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1111/2186] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:15.392877 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecd426-a473-4a9c-a50f-a94a671f5286 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:15.476196 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecd426-a473-4a9c-a50f-a94a671f5286 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:15.485913 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e8651-91a0-4694-b7b8-9e2b98faf844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:15.486593 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e8651-91a0-4694-b7b8-9e2b98faf844 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:15.486878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e8651-91a0-4694-b7b8-9e2b98faf844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:15.488675 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e8651-91a0-4694-b7b8-9e2b98faf844 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:15.488675 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e8651-91a0-4694-b7b8-9e2b98faf844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:15.490142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e8651-91a0-4694-b7b8-9e2b98faf844 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:15.599034 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1076/2187] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:52:15 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:52:15.599165 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a3524-6fcd-4eba-a605-b93ed041989f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:15.612260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a3524-6fcd-4eba-a605-b93ed041989f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:15.722799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68064f28-e750-4802-addc-c1c618ba6e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:15.725839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064f28-e750-4802-addc-c1c618ba6e90 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:15.726127 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064f28-e750-4802-addc-c1c618ba6e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:15.731306 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064f28-e750-4802-addc-c1c618ba6e90 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:15.731306 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68064f28-e750-4802-addc-c1c618ba6e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:15.731306 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68064f28-e750-4802-addc-c1c618ba6e90 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:15.856783 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1112/2188] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:52:15 2022] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:52:15.861878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e8651-91a0-4694-b7b8-9e2b98faf844 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:15.887170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e8651-91a0-4694-b7b8-9e2b98faf844 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:15.894157 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073855a-7d40-4ccc-85b0-4260132098f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:15.894994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073855a-7d40-4ccc-85b0-4260132098f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:15.895372 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073855a-7d40-4ccc-85b0-4260132098f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:15.895729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073855a-7d40-4ccc-85b0-4260132098f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:15.896666 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073855a-7d40-4ccc-85b0-4260132098f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:15.899280 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073855a-7d40-4ccc-85b0-4260132098f9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:15.918291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1077/2189] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:52:15.923271 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68064f28-e750-4802-addc-c1c618ba6e90 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:15.948033 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68064f28-e750-4802-addc-c1c618ba6e90 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:15.965945 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9707d-7130-4b86-a2fd-b0757702c1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:15.966904 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9707d-7130-4b86-a2fd-b0757702c1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:15.967270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9707d-7130-4b86-a2fd-b0757702c1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:15.967699 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9707d-7130-4b86-a2fd-b0757702c1ca admin admin] PATH_INFO: `/v3/projects/49c6da04ffc34d2c8c1c217eddea446b/users/9192ee5e91de4f1d889f52a0fd7aaeec/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:15.995100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9707d-7130-4b86-a2fd-b0757702c1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c6da04ffc34d2c8c1c217eddea446b, user_id=9192ee5e91de4f1d889f52a0fd7aaeec, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:15.998647 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9707d-7130-4b86-a2fd-b0757702c1ca admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:16.092604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1113/2190] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:52:15 2022] PUT /identity/v3/projects/49c6da04ffc34d2c8c1c217eddea446b/users/9192ee5e91de4f1d889f52a0fd7aaeec/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:16.098928 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073855a-7d40-4ccc-85b0-4260132098f9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:16.119179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073855a-7d40-4ccc-85b0-4260132098f9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:16.186832 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1da508-dc59-414f-bafd-c375a2cfef1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:16.187648 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1da508-dc59-414f-bafd-c375a2cfef1f admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:16.188054 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1da508-dc59-414f-bafd-c375a2cfef1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:16.188429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1da508-dc59-414f-bafd-c375a2cfef1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:16.189311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1da508-dc59-414f-bafd-c375a2cfef1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:16.194379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1da508-dc59-414f-bafd-c375a2cfef1f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:16.208080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1078/2191] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:52:16.213411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9707d-7130-4b86-a2fd-b0757702c1ca admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:16.225926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9707d-7130-4b86-a2fd-b0757702c1ca admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:16.230810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46960dcc-13b4-4228-b65d-8ea5ea74bd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:16.231671 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46960dcc-13b4-4228-b65d-8ea5ea74bd58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:16.232161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46960dcc-13b4-4228-b65d-8ea5ea74bd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:16.232658 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46960dcc-13b4-4228-b65d-8ea5ea74bd58 admin admin] PATH_INFO: `/v3/projects/49c6da04ffc34d2c8c1c217eddea446b/users/9192ee5e91de4f1d889f52a0fd7aaeec/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:16.234936 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46960dcc-13b4-4228-b65d-8ea5ea74bd58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c6da04ffc34d2c8c1c217eddea446b, user_id=9192ee5e91de4f1d889f52a0fd7aaeec, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:16.237669 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46960dcc-13b4-4228-b65d-8ea5ea74bd58 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:16.259194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1114/2192] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:52:16 2022] PUT /identity/v3/projects/49c6da04ffc34d2c8c1c217eddea446b/users/9192ee5e91de4f1d889f52a0fd7aaeec/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:16.262775 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05867a-af95-4a20-bb9f-b9d3d1729fdd None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:16.262775 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05867a-af95-4a20-bb9f-b9d3d1729fdd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:16.262775 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05867a-af95-4a20-bb9f-b9d3d1729fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:16.296615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bf05867a-af95-4a20-bb9f-b9d3d1729fdd None None] MFA Rules not processed for user `9192ee5e91de4f1d889f52a0fd7aaeec`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:16.296615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bf05867a-af95-4a20-bb9f-b9d3d1729fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:16.401601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1079/2193] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:16.420422 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46960dcc-13b4-4228-b65d-8ea5ea74bd58 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:16.420422 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-46960dcc-13b4-4228-b65d-8ea5ea74bd58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:16.486383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46960dcc-13b4-4228-b65d-8ea5ea74bd58 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:16.500894 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19f5e5-d861-479d-a395-31a4bf8883b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:16.503468 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19f5e5-d861-479d-a395-31a4bf8883b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:16.503792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19f5e5-d861-479d-a395-31a4bf8883b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:16.504083 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19f5e5-d861-479d-a395-31a4bf8883b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:16.575099 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19f5e5-d861-479d-a395-31a4bf8883b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:16.577254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19f5e5-d861-479d-a395-31a4bf8883b8 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:16.586800 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1115/2194] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:52:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:52:17.487531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9c7a-3a16-415e-81fd-417a4d67a474 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:17.488384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9c7a-3a16-415e-81fd-417a4d67a474 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:17.488849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9c7a-3a16-415e-81fd-417a4d67a474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:17.551209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9bff9c7a-3a16-415e-81fd-417a4d67a474 None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:17.552832 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9bff9c7a-3a16-415e-81fd-417a4d67a474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:17.666032 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1080/2195] 10.222.0.81 () {58 vars in 1009 bytes} [Wed May 4 17:52:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:17.679852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19f5e5-d861-479d-a395-31a4bf8883b8 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:17.681414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8f19f5e5-d861-479d-a395-31a4bf8883b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:17.809956 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19f5e5-d861-479d-a395-31a4bf8883b8 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:17.821239 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1faf6-26e1-4c8f-a3c6-f8e1875b9aa3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:17.822218 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1faf6-26e1-4c8f-a3c6-f8e1875b9aa3 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:17.822704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1faf6-26e1-4c8f-a3c6-f8e1875b9aa3 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:17.823129 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1faf6-26e1-4c8f-a3c6-f8e1875b9aa3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:17.839720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1faf6-26e1-4c8f-a3c6-f8e1875b9aa3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:17.843703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1faf6-26e1-4c8f-a3c6-f8e1875b9aa3 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:17.869890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1116/2196] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 17:52:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 17:52:20.246579 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff9c7a-3a16-415e-81fd-417a4d67a474 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:20.250755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9bff9c7a-3a16-415e-81fd-417a4d67a474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:20.275727 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff9c7a-3a16-415e-81fd-417a4d67a474 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:20.280886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12d4f1-a325-4868-bc89-6eb8cae48f73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:20.285136 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12d4f1-a325-4868-bc89-6eb8cae48f73 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:20.285136 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12d4f1-a325-4868-bc89-6eb8cae48f73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:20.285136 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12d4f1-a325-4868-bc89-6eb8cae48f73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:20.411946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12d4f1-a325-4868-bc89-6eb8cae48f73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:20.413583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12d4f1-a325-4868-bc89-6eb8cae48f73 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:20.440607 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1081/2197] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:52:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:52:22.818653 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1faf6-26e1-4c8f-a3c6-f8e1875b9aa3 service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:22.829142 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1faf6-26e1-4c8f-a3c6-f8e1875b9aa3 service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:22.836138 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f27689-d548-4af3-99db-004c3e25dc10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:22.836930 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f27689-d548-4af3-99db-004c3e25dc10 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:22.837247 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f27689-d548-4af3-99db-004c3e25dc10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:22.837489 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f27689-d548-4af3-99db-004c3e25dc10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:22.848645 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f27689-d548-4af3-99db-004c3e25dc10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:22.850955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f27689-d548-4af3-99db-004c3e25dc10 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:22.872027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1117/2198] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:52:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:52:30.021551 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a65b7-b363-4773-9d39-55446d762b7d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:30.022142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a65b7-b363-4773-9d39-55446d762b7d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:30.022142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a65b7-b363-4773-9d39-55446d762b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:30.040756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2a6a65b7-b363-4773-9d39-55446d762b7d None None] MFA Rules not processed for user `4f49f50b0a7841c4a117cc5e2e1dccb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:30.042038 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2a6a65b7-b363-4773-9d39-55446d762b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:30.100087 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1082/2199] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:30.709490 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f27689-d548-4af3-99db-004c3e25dc10 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:30.805045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f27689-d548-4af3-99db-004c3e25dc10 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:30.812179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c2ea5-e42c-4930-8d0b-5462e568c4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:30.813529 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c2ea5-e42c-4930-8d0b-5462e568c4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:30.814000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c2ea5-e42c-4930-8d0b-5462e568c4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:30.814496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c2ea5-e42c-4930-8d0b-5462e568c4e6 admin admin] PATH_INFO: `/v3/users/934da6ed87864f659aa6c603832b1f7c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:30.816723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c2ea5-e42c-4930-8d0b-5462e568c4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=934da6ed87864f659aa6c603832b1f7c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:30.818881 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c2ea5-e42c-4930-8d0b-5462e568c4e6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:31.049292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f19c2ea5-e42c-4930-8d0b-5462e568c4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '934da6ed87864f659aa6c603832b1f7c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:31.124812 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f19c2ea5-e42c-4930-8d0b-5462e568c4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '934da6ed87864f659aa6c603832b1f7c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:31.125404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f19c2ea5-e42c-4930-8d0b-5462e568c4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '934da6ed87864f659aa6c603832b1f7c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:31.132722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f19c2ea5-e42c-4930-8d0b-5462e568c4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '934da6ed87864f659aa6c603832b1f7c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:31.145206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f19c2ea5-e42c-4930-8d0b-5462e568c4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '934da6ed87864f659aa6c603832b1f7c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:31.151918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1118/2200] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:52:30 2022] DELETE /identity/v3/users/934da6ed87864f659aa6c603832b1f7c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:31.157459 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83957cf6-2195-4860-8b42-e3ff2cdd5b37 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:31.161803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83957cf6-2195-4860-8b42-e3ff2cdd5b37 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:31.161803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83957cf6-2195-4860-8b42-e3ff2cdd5b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:31.177130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-83957cf6-2195-4860-8b42-e3ff2cdd5b37 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:31.178369 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-83957cf6-2195-4860-8b42-e3ff2cdd5b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:31.261485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1083/2201] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:52:31.261685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c2ea5-e42c-4930-8d0b-5462e568c4e6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:31.263128 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f19c2ea5-e42c-4930-8d0b-5462e568c4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:31.336690 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c2ea5-e42c-4930-8d0b-5462e568c4e6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:31.340799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afe1dc-64c8-4a1b-8f9c-0a77e804a852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:31.341453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afe1dc-64c8-4a1b-8f9c-0a77e804a852 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:31.341748 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afe1dc-64c8-4a1b-8f9c-0a77e804a852 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:31.342154 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afe1dc-64c8-4a1b-8f9c-0a77e804a852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:31.353668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afe1dc-64c8-4a1b-8f9c-0a77e804a852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:31.355190 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afe1dc-64c8-4a1b-8f9c-0a77e804a852 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:31.366044 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1119/2202] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:52:31.809360 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83957cf6-2195-4860-8b42-e3ff2cdd5b37 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:31.810733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-83957cf6-2195-4860-8b42-e3ff2cdd5b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:31.823478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83957cf6-2195-4860-8b42-e3ff2cdd5b37 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:31.828415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56845fc-6328-4cae-97d4-4f56e3dcc421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:31.835962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56845fc-6328-4cae-97d4-4f56e3dcc421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:31.835962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56845fc-6328-4cae-97d4-4f56e3dcc421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:31.835962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56845fc-6328-4cae-97d4-4f56e3dcc421 admin admin] PATH_INFO: `/v3/projects/20ebce442c2445adaec8c1dcdfc10ce2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:31.835962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56845fc-6328-4cae-97d4-4f56e3dcc421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20ebce442c2445adaec8c1dcdfc10ce2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:31.835962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56845fc-6328-4cae-97d4-4f56e3dcc421 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:31.971364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d56845fc-6328-4cae-97d4-4f56e3dcc421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20ebce442c2445adaec8c1dcdfc10ce2', 'request_id': 'req-d56845fc-6328-4cae-97d4-4f56e3dcc421'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:31.976999 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d56845fc-6328-4cae-97d4-4f56e3dcc421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20ebce442c2445adaec8c1dcdfc10ce2', 'request_id': 'req-d56845fc-6328-4cae-97d4-4f56e3dcc421'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:32.067389 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d56845fc-6328-4cae-97d4-4f56e3dcc421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20ebce442c2445adaec8c1dcdfc10ce2', 'request_id': 'req-d56845fc-6328-4cae-97d4-4f56e3dcc421'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:32.079393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d56845fc-6328-4cae-97d4-4f56e3dcc421 admin admin] The token cache is being invalidate because project 20ebce442c2445adaec8c1dcdfc10ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:52:32.079706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d56845fc-6328-4cae-97d4-4f56e3dcc421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:32.080375 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d56845fc-6328-4cae-97d4-4f56e3dcc421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:32.081969 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1084/2203] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:52:31 2022] DELETE /identity/v3/projects/20ebce442c2445adaec8c1dcdfc10ce2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:32.085980 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afe1dc-64c8-4a1b-8f9c-0a77e804a852 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:32.096987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afe1dc-64c8-4a1b-8f9c-0a77e804a852 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:32.153337 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2aa9a-d15f-4f57-80c0-98524d8aecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:32.154232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2aa9a-d15f-4f57-80c0-98524d8aecea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:32.155060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2aa9a-d15f-4f57-80c0-98524d8aecea admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:32.155345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2aa9a-d15f-4f57-80c0-98524d8aecea admin admin] PATH_INFO: `/v3/users/be242589b5ca4d76a0dcafc04d82480a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:32.156576 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2aa9a-d15f-4f57-80c0-98524d8aecea admin admin] RBAC: Authorizing `identity:delete_user(user_id=be242589b5ca4d76a0dcafc04d82480a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:32.158521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2aa9a-d15f-4f57-80c0-98524d8aecea admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:32.330292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-99c2aa9a-d15f-4f57-80c0-98524d8aecea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be242589b5ca4d76a0dcafc04d82480a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:32.409617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-99c2aa9a-d15f-4f57-80c0-98524d8aecea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be242589b5ca4d76a0dcafc04d82480a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:32.410235 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-99c2aa9a-d15f-4f57-80c0-98524d8aecea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be242589b5ca4d76a0dcafc04d82480a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:32.417470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-99c2aa9a-d15f-4f57-80c0-98524d8aecea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be242589b5ca4d76a0dcafc04d82480a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:32.429723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-99c2aa9a-d15f-4f57-80c0-98524d8aecea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be242589b5ca4d76a0dcafc04d82480a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:32.436160 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1120/2204] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:52:32 2022] DELETE /identity/v3/users/be242589b5ca4d76a0dcafc04d82480a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:32.857453 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56845fc-6328-4cae-97d4-4f56e3dcc421 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:32.859782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d56845fc-6328-4cae-97d4-4f56e3dcc421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:32.873957 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56845fc-6328-4cae-97d4-4f56e3dcc421 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:32.944275 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff2077-2c17-4c4d-abca-4f6e322ea154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:32.945187 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff2077-2c17-4c4d-abca-4f6e322ea154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:32.946277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff2077-2c17-4c4d-abca-4f6e322ea154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:32.946562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff2077-2c17-4c4d-abca-4f6e322ea154 admin admin] PATH_INFO: `/v3/projects/016c2ed8078e41bebc19e253bda387e3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:32.947828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff2077-2c17-4c4d-abca-4f6e322ea154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=016c2ed8078e41bebc19e253bda387e3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:32.955578 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff2077-2c17-4c4d-abca-4f6e322ea154 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:33.110971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-17ff2077-2c17-4c4d-abca-4f6e322ea154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016c2ed8078e41bebc19e253bda387e3', 'request_id': 'req-17ff2077-2c17-4c4d-abca-4f6e322ea154'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:33.116255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-17ff2077-2c17-4c4d-abca-4f6e322ea154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016c2ed8078e41bebc19e253bda387e3', 'request_id': 'req-17ff2077-2c17-4c4d-abca-4f6e322ea154'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:33.192894 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-17ff2077-2c17-4c4d-abca-4f6e322ea154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016c2ed8078e41bebc19e253bda387e3', 'request_id': 'req-17ff2077-2c17-4c4d-abca-4f6e322ea154'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:33.205236 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-17ff2077-2c17-4c4d-abca-4f6e322ea154 admin admin] The token cache is being invalidate because project 016c2ed8078e41bebc19e253bda387e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:52:33.205531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-17ff2077-2c17-4c4d-abca-4f6e322ea154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:33.206162 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-17ff2077-2c17-4c4d-abca-4f6e322ea154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:33.208604 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1085/2205] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:52:32 2022] DELETE /identity/v3/projects/016c2ed8078e41bebc19e253bda387e3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:33.212526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2aa9a-d15f-4f57-80c0-98524d8aecea admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:33.213947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-99c2aa9a-d15f-4f57-80c0-98524d8aecea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:33.226964 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2aa9a-d15f-4f57-80c0-98524d8aecea admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:33.295375 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cb1e6-dbe8-40f5-8ce2-7b05371340e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:33.297296 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cb1e6-dbe8-40f5-8ce2-7b05371340e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:33.297581 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cb1e6-dbe8-40f5-8ce2-7b05371340e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:33.297859 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cb1e6-dbe8-40f5-8ce2-7b05371340e0 admin admin] PATH_INFO: `/v3/users/9192ee5e91de4f1d889f52a0fd7aaeec` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:33.299081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cb1e6-dbe8-40f5-8ce2-7b05371340e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9192ee5e91de4f1d889f52a0fd7aaeec)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:33.303238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cb1e6-dbe8-40f5-8ce2-7b05371340e0 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:33.508036 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4b8cb1e6-dbe8-40f5-8ce2-7b05371340e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9192ee5e91de4f1d889f52a0fd7aaeec'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:33.605013 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4b8cb1e6-dbe8-40f5-8ce2-7b05371340e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9192ee5e91de4f1d889f52a0fd7aaeec'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:33.605973 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4b8cb1e6-dbe8-40f5-8ce2-7b05371340e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9192ee5e91de4f1d889f52a0fd7aaeec'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:33.615180 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4b8cb1e6-dbe8-40f5-8ce2-7b05371340e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9192ee5e91de4f1d889f52a0fd7aaeec'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:33.634286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4b8cb1e6-dbe8-40f5-8ce2-7b05371340e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9192ee5e91de4f1d889f52a0fd7aaeec'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:33.642881 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1121/2206] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:52:33 2022] DELETE /identity/v3/users/9192ee5e91de4f1d889f52a0fd7aaeec => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:34.183976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff2077-2c17-4c4d-abca-4f6e322ea154 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:34.185493 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-17ff2077-2c17-4c4d-abca-4f6e322ea154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:34.205212 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff2077-2c17-4c4d-abca-4f6e322ea154 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:34.272236 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b2cf7-c611-4043-bf44-1664c63d16af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:34.273131 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b2cf7-c611-4043-bf44-1664c63d16af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:34.273414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b2cf7-c611-4043-bf44-1664c63d16af admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:34.273691 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b2cf7-c611-4043-bf44-1664c63d16af admin admin] PATH_INFO: `/v3/projects/49c6da04ffc34d2c8c1c217eddea446b` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:34.274892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b2cf7-c611-4043-bf44-1664c63d16af admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c6da04ffc34d2c8c1c217eddea446b)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:34.276831 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b2cf7-c611-4043-bf44-1664c63d16af admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:34.402455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-587b2cf7-c611-4043-bf44-1664c63d16af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c6da04ffc34d2c8c1c217eddea446b', 'request_id': 'req-587b2cf7-c611-4043-bf44-1664c63d16af'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:34.412520 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-587b2cf7-c611-4043-bf44-1664c63d16af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c6da04ffc34d2c8c1c217eddea446b', 'request_id': 'req-587b2cf7-c611-4043-bf44-1664c63d16af'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:34.527234 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-587b2cf7-c611-4043-bf44-1664c63d16af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c6da04ffc34d2c8c1c217eddea446b', 'request_id': 'req-587b2cf7-c611-4043-bf44-1664c63d16af'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:34.539809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-587b2cf7-c611-4043-bf44-1664c63d16af admin admin] The token cache is being invalidate because project 49c6da04ffc34d2c8c1c217eddea446b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:52:34.540106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-587b2cf7-c611-4043-bf44-1664c63d16af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:34.540794 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-587b2cf7-c611-4043-bf44-1664c63d16af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:34.542709 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1086/2207] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:52:34 2022] DELETE /identity/v3/projects/49c6da04ffc34d2c8c1c217eddea446b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:34.548332 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665d0e7-49ae-41bb-ae44-c668342ccbc6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:34.548841 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665d0e7-49ae-41bb-ae44-c668342ccbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:34.549017 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665d0e7-49ae-41bb-ae44-c668342ccbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:34.567165 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0665d0e7-49ae-41bb-ae44-c668342ccbc6 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:34.568348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0665d0e7-49ae-41bb-ae44-c668342ccbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:34.627030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1122/2208] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:34.635134 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b4cb-6ff0-4863-8001-221303535821 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:34.635421 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b4cb-6ff0-4863-8001-221303535821 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:34.635694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b4cb-6ff0-4863-8001-221303535821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:34.654257 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a332b4cb-6ff0-4863-8001-221303535821 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:34.656033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a332b4cb-6ff0-4863-8001-221303535821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:34.663889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1087/2209] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:34.668638 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665d0e7-49ae-41bb-ae44-c668342ccbc6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:34.679279 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665d0e7-49ae-41bb-ae44-c668342ccbc6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:34.683932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31c23d-a3fd-4a32-ace7-030b77fde9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:34.684559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31c23d-a3fd-4a32-ace7-030b77fde9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:34.684968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31c23d-a3fd-4a32-ace7-030b77fde9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:34.685121 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31c23d-a3fd-4a32-ace7-030b77fde9c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:34.685993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31c23d-a3fd-4a32-ace7-030b77fde9c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:52:34.686413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31c23d-a3fd-4a32-ace7-030b77fde9c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:34.688116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31c23d-a3fd-4a32-ace7-030b77fde9c5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:34.703923 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1123/2210] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:52:34.705094 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b4cb-6ff0-4863-8001-221303535821 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:34.714404 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b4cb-6ff0-4863-8001-221303535821 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:34.719673 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57e6c0-7b64-4daf-b740-4b22f496caa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:34.720331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57e6c0-7b64-4daf-b740-4b22f496caa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:34.720639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57e6c0-7b64-4daf-b740-4b22f496caa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:34.720918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57e6c0-7b64-4daf-b740-4b22f496caa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:34.721612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57e6c0-7b64-4daf-b740-4b22f496caa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:34.723521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57e6c0-7b64-4daf-b740-4b22f496caa0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:34.849123 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1088/2211] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:52:34 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:52:34.850332 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31c23d-a3fd-4a32-ace7-030b77fde9c5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:34.861386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31c23d-a3fd-4a32-ace7-030b77fde9c5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:34.922423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0296eea-5556-4a03-b768-00ff90e15062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:34.923354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0296eea-5556-4a03-b768-00ff90e15062 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:34.923822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0296eea-5556-4a03-b768-00ff90e15062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:34.924130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0296eea-5556-4a03-b768-00ff90e15062 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:34.925018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0296eea-5556-4a03-b768-00ff90e15062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:34.927382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0296eea-5556-4a03-b768-00ff90e15062 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:35.041594 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1124/2212] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:52:34 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:52:35.046282 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57e6c0-7b64-4daf-b740-4b22f496caa0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:35.058974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57e6c0-7b64-4daf-b740-4b22f496caa0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:35.065246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507a9b8-3fa4-448a-b4a3-d2e8677847be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:35.066073 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a9b8-3fa4-448a-b4a3-d2e8677847be admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:35.066639 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a9b8-3fa4-448a-b4a3-d2e8677847be admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:35.067011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a9b8-3fa4-448a-b4a3-d2e8677847be admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:35.067849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507a9b8-3fa4-448a-b4a3-d2e8677847be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:35.069651 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507a9b8-3fa4-448a-b4a3-d2e8677847be admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:35.082529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1089/2213] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:52:35.086465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0296eea-5556-4a03-b768-00ff90e15062 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:35.100034 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0296eea-5556-4a03-b768-00ff90e15062 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:35.116888 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea77ff-6cd7-4011-b954-2627ab43b819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:35.117655 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea77ff-6cd7-4011-b954-2627ab43b819 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:35.118032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea77ff-6cd7-4011-b954-2627ab43b819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:35.118355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea77ff-6cd7-4011-b954-2627ab43b819 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:35.119138 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea77ff-6cd7-4011-b954-2627ab43b819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:35.120778 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea77ff-6cd7-4011-b954-2627ab43b819 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:35.131854 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1125/2214] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:52:35.136074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507a9b8-3fa4-448a-b4a3-d2e8677847be admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:35.147342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507a9b8-3fa4-448a-b4a3-d2e8677847be admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:35.152631 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438d73-a8e7-418f-8a3a-c7248ad52da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:35.153580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438d73-a8e7-418f-8a3a-c7248ad52da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:35.156550 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438d73-a8e7-418f-8a3a-c7248ad52da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:35.156550 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438d73-a8e7-418f-8a3a-c7248ad52da3 admin admin] PATH_INFO: `/v3/projects/a58f0a02b9604b74a0b7f7f5039ee809/users/f53c54c0847349599b3cccbb4eeb2e93/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:35.171139 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab438d73-a8e7-418f-8a3a-c7248ad52da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58f0a02b9604b74a0b7f7f5039ee809, user_id=f53c54c0847349599b3cccbb4eeb2e93, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:35.174556 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab438d73-a8e7-418f-8a3a-c7248ad52da3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:35.286081 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1090/2215] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:52:35 2022] PUT /identity/v3/projects/a58f0a02b9604b74a0b7f7f5039ee809/users/f53c54c0847349599b3cccbb4eeb2e93/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:52:35.291491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043f9ae-c71b-4971-b16d-5f8ad7468b03 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:35.291780 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043f9ae-c71b-4971-b16d-5f8ad7468b03 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:35.292058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043f9ae-c71b-4971-b16d-5f8ad7468b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:35.312873 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4043f9ae-c71b-4971-b16d-5f8ad7468b03 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:35.314127 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4043f9ae-c71b-4971-b16d-5f8ad7468b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:35.374815 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1126/2216] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:35.384597 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438d73-a8e7-418f-8a3a-c7248ad52da3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:35.386425 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ab438d73-a8e7-418f-8a3a-c7248ad52da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:35.444874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438d73-a8e7-418f-8a3a-c7248ad52da3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:35.448703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e68507-bacb-44dc-b3e7-4d98c1fe8e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:35.449348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e68507-bacb-44dc-b3e7-4d98c1fe8e08 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:35.449641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e68507-bacb-44dc-b3e7-4d98c1fe8e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:35.449922 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e68507-bacb-44dc-b3e7-4d98c1fe8e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:35.460003 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e68507-bacb-44dc-b3e7-4d98c1fe8e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:35.461588 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e68507-bacb-44dc-b3e7-4d98c1fe8e08 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:35.472347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1091/2217] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:52:37.096573 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7de707-b348-4078-846e-b69451226c4f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:37.097352 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7de707-b348-4078-846e-b69451226c4f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:37.097352 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7de707-b348-4078-846e-b69451226c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:37.126165 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7b7de707-b348-4078-846e-b69451226c4f None None] MFA Rules not processed for user `f53c54c0847349599b3cccbb4eeb2e93`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:37.127392 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7b7de707-b348-4078-846e-b69451226c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:37.193727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1127/2218] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:37.206512 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e68507-bacb-44dc-b3e7-4d98c1fe8e08 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:37.207942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-50e68507-bacb-44dc-b3e7-4d98c1fe8e08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:37.274822 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e68507-bacb-44dc-b3e7-4d98c1fe8e08 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:37.278675 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb62533-a0b4-4427-999f-c1a203878ac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:37.279340 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb62533-a0b4-4427-999f-c1a203878ac9 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:37.280248 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb62533-a0b4-4427-999f-c1a203878ac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:37.280571 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb62533-a0b4-4427-999f-c1a203878ac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:37.289549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb62533-a0b4-4427-999f-c1a203878ac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:37.291074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb62533-a0b4-4427-999f-c1a203878ac9 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:37.300964 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1092/2219] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:52:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:52:39.177876 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73ecfc-56f1-47d2-94b3-b774516bad83 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:39.177876 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73ecfc-56f1-47d2-94b3-b774516bad83 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:39.178421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73ecfc-56f1-47d2-94b3-b774516bad83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:39.203188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0b73ecfc-56f1-47d2-94b3-b774516bad83 None None] MFA Rules not processed for user `f53c54c0847349599b3cccbb4eeb2e93`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:39.205550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0b73ecfc-56f1-47d2-94b3-b774516bad83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:39.233925 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1128/2220] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:40.413928 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb62533-a0b4-4427-999f-c1a203878ac9 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:40.413928 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-acb62533-a0b4-4427-999f-c1a203878ac9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:40.429492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb62533-a0b4-4427-999f-c1a203878ac9 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:40.434636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29629d4-e6ce-48a0-b60d-e0b3c7dc2e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:40.435583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29629d4-e6ce-48a0-b60d-e0b3c7dc2e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:40.436167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29629d4-e6ce-48a0-b60d-e0b3c7dc2e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:40.436636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29629d4-e6ce-48a0-b60d-e0b3c7dc2e6c admin admin] PATH_INFO: `/v3/users/eb3a7d9870084bc0898603c9c241a401` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:40.437892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29629d4-e6ce-48a0-b60d-e0b3c7dc2e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3a7d9870084bc0898603c9c241a401)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:40.439860 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29629d4-e6ce-48a0-b60d-e0b3c7dc2e6c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:40.714052 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d29629d4-e6ce-48a0-b60d-e0b3c7dc2e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3a7d9870084bc0898603c9c241a401'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:40.726787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d29629d4-e6ce-48a0-b60d-e0b3c7dc2e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3a7d9870084bc0898603c9c241a401'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:40.845818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d29629d4-e6ce-48a0-b60d-e0b3c7dc2e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3a7d9870084bc0898603c9c241a401'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:40.859236 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d29629d4-e6ce-48a0-b60d-e0b3c7dc2e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3a7d9870084bc0898603c9c241a401'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:40.860000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d29629d4-e6ce-48a0-b60d-e0b3c7dc2e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3a7d9870084bc0898603c9c241a401'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:40.870125 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1093/2221] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:52:40 2022] DELETE /identity/v3/users/eb3a7d9870084bc0898603c9c241a401 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:40.871400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82431d9-89f0-4eaf-85f4-bbd0273e70ea None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:40.872250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82431d9-89f0-4eaf-85f4-bbd0273e70ea None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:40.872561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82431d9-89f0-4eaf-85f4-bbd0273e70ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:40.898591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b82431d9-89f0-4eaf-85f4-bbd0273e70ea None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:40.898591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b82431d9-89f0-4eaf-85f4-bbd0273e70ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:40.957760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1129/2222] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:40.971334 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29629d4-e6ce-48a0-b60d-e0b3c7dc2e6c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:40.972784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d29629d4-e6ce-48a0-b60d-e0b3c7dc2e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:41.030018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29629d4-e6ce-48a0-b60d-e0b3c7dc2e6c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:41.033650 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094babb9-2f68-468c-a7db-d15e44962a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:41.034295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094babb9-2f68-468c-a7db-d15e44962a6a service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:41.034624 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094babb9-2f68-468c-a7db-d15e44962a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:41.034850 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094babb9-2f68-468c-a7db-d15e44962a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:41.044125 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094babb9-2f68-468c-a7db-d15e44962a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:41.046353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094babb9-2f68-468c-a7db-d15e44962a6a service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:41.055679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1094/2223] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:52:41.730874 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82431d9-89f0-4eaf-85f4-bbd0273e70ea None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:41.732343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b82431d9-89f0-4eaf-85f4-bbd0273e70ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:41.748972 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82431d9-89f0-4eaf-85f4-bbd0273e70ea None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:41.754033 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c834da3-c0d7-4fc6-9140-70754c9e50e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:41.754903 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c834da3-c0d7-4fc6-9140-70754c9e50e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:41.755184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c834da3-c0d7-4fc6-9140-70754c9e50e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:41.755464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c834da3-c0d7-4fc6-9140-70754c9e50e1 admin admin] PATH_INFO: `/v3/projects/0b3909633d824f6ea4075c5bc241f14c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:41.760868 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c834da3-c0d7-4fc6-9140-70754c9e50e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3909633d824f6ea4075c5bc241f14c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:41.762862 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c834da3-c0d7-4fc6-9140-70754c9e50e1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:41.934427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1c834da3-c0d7-4fc6-9140-70754c9e50e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3909633d824f6ea4075c5bc241f14c', 'request_id': 'req-1c834da3-c0d7-4fc6-9140-70754c9e50e1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:41.940821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1c834da3-c0d7-4fc6-9140-70754c9e50e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3909633d824f6ea4075c5bc241f14c', 'request_id': 'req-1c834da3-c0d7-4fc6-9140-70754c9e50e1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:41.947330 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1c834da3-c0d7-4fc6-9140-70754c9e50e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3909633d824f6ea4075c5bc241f14c', 'request_id': 'req-1c834da3-c0d7-4fc6-9140-70754c9e50e1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:41.975130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19dac4-8085-4ab5-87cf-b3f8e6382d30 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:41.975130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19dac4-8085-4ab5-87cf-b3f8e6382d30 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:41.975130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19dac4-8085-4ab5-87cf-b3f8e6382d30 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:41.975130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1095/2224] 10.222.0.81 () {54 vars in 921 bytes} [Wed May 4 17:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:52:41.979190 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76737ef9-aef0-411d-8b64-ab8e83a2ec29 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:41.979483 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76737ef9-aef0-411d-8b64-ab8e83a2ec29 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:41.979946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76737ef9-aef0-411d-8b64-ab8e83a2ec29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:42.026366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-76737ef9-aef0-411d-8b64-ab8e83a2ec29 None None] MFA Rules not processed for user `d4a073d8f47a485cbb22db01530f3b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:42.027590 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-76737ef9-aef0-411d-8b64-ab8e83a2ec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:42.048126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1c834da3-c0d7-4fc6-9140-70754c9e50e1 admin admin] The token cache is being invalidate because project 0b3909633d824f6ea4075c5bc241f14c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:52:42.053108 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1c834da3-c0d7-4fc6-9140-70754c9e50e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:42.053108 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1c834da3-c0d7-4fc6-9140-70754c9e50e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:42.053108 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1130/2225] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:52:41 2022] DELETE /identity/v3/projects/0b3909633d824f6ea4075c5bc241f14c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:42.058183 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea57301-b728-4e25-b3b0-ce188c7a03eb None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:42.058702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea57301-b728-4e25-b3b0-ce188c7a03eb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:42.058988 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea57301-b728-4e25-b3b0-ce188c7a03eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:42.090948 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5ea57301-b728-4e25-b3b0-ce188c7a03eb None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:42.093336 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5ea57301-b728-4e25-b3b0-ce188c7a03eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:42.107257 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1096/2226] 10.222.0.81 () {58 vars in 1018 bytes} [Wed May 4 17:52:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:52:42.120811 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76737ef9-aef0-411d-8b64-ab8e83a2ec29 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:42.123524 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-76737ef9-aef0-411d-8b64-ab8e83a2ec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:42.180952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1131/2227] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:52:42.190183 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3720523-e871-4af7-ac4b-601820c7f49f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:42.190478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3720523-e871-4af7-ac4b-601820c7f49f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:42.190759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3720523-e871-4af7-ac4b-601820c7f49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:42.212526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b3720523-e871-4af7-ac4b-601820c7f49f None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:42.213727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b3720523-e871-4af7-ac4b-601820c7f49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:42.232152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1132/2228] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:42.233962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3720523-e871-4af7-ac4b-601820c7f49f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:42.237759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76737ef9-aef0-411d-8b64-ab8e83a2ec29 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:42.243487 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cf269-1537-4daf-a368-76907361cd21 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8e2eb70a5d4dd1b3a9bec2bd0a78a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:42.244206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cf269-1537-4daf-a368-76907361cd21 service glance] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:42.244554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cf269-1537-4daf-a368-76907361cd21 service glance] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:42.244840 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cf269-1537-4daf-a368-76907361cd21 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:42.245541 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3720523-e871-4af7-ac4b-601820c7f49f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:42.251488 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581273a-2a64-4af1-8803-ccd50bfdf185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:42.255357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581273a-2a64-4af1-8803-ccd50bfdf185 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:42.256096 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581273a-2a64-4af1-8803-ccd50bfdf185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:42.256906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581273a-2a64-4af1-8803-ccd50bfdf185 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:42.259998 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581273a-2a64-4af1-8803-ccd50bfdf185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:52:42.260393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581273a-2a64-4af1-8803-ccd50bfdf185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:42.262049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581273a-2a64-4af1-8803-ccd50bfdf185 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:42.279388 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cf269-1537-4daf-a368-76907361cd21 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:42.281499 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cf269-1537-4daf-a368-76907361cd21 service glance] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:42.287978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1133/2229] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:52:42.292322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581273a-2a64-4af1-8803-ccd50bfdf185 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:42.301996 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1097/2230] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:52:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:52:42.305149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581273a-2a64-4af1-8803-ccd50bfdf185 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:42.330449 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acdd90-43cc-4133-8781-0fb379191541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:42.331131 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acdd90-43cc-4133-8781-0fb379191541 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:42.331412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acdd90-43cc-4133-8781-0fb379191541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:42.332181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acdd90-43cc-4133-8781-0fb379191541 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:42.332977 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acdd90-43cc-4133-8781-0fb379191541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:42.336648 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acdd90-43cc-4133-8781-0fb379191541 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:42.346662 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54bca9-18d1-40cd-9e4b-d4b1785ad287 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:42.347050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54bca9-18d1-40cd-9e4b-d4b1785ad287 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:42.347211 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54bca9-18d1-40cd-9e4b-d4b1785ad287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:42.386618 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ce54bca9-18d1-40cd-9e4b-d4b1785ad287 None None] MFA Rules not processed for user `d653275573ef4485ad38892d703f2159`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:42.392795 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ce54bca9-18d1-40cd-9e4b-d4b1785ad287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:42.464767 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1098/2231] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:52:42.480819 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1134/2232] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:52:42 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:52:42.485868 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54bca9-18d1-40cd-9e4b-d4b1785ad287 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:42.498692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54bca9-18d1-40cd-9e4b-d4b1785ad287 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:42.575567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a3b55-3f04-4f7e-98ae-1c7d498e3429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:42.577500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a3b55-3f04-4f7e-98ae-1c7d498e3429 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:42.577801 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a3b55-3f04-4f7e-98ae-1c7d498e3429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:42.578067 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a3b55-3f04-4f7e-98ae-1c7d498e3429 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:42.578783 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a3b55-3f04-4f7e-98ae-1c7d498e3429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:42.579706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e740346-bcb6-43ee-9122-420efade3bc8 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:42.580208 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e740346-bcb6-43ee-9122-420efade3bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:42.580501 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e740346-bcb6-43ee-9122-420efade3bc8 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:42.581996 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a3b55-3f04-4f7e-98ae-1c7d498e3429 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:42.582550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1135/2233] 10.222.0.81 () {54 vars in 921 bytes} [Wed May 4 17:52:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:52:42.588761 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d6875-e248-4d35-8b97-f72d117c4efd None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:42.589487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d6875-e248-4d35-8b97-f72d117c4efd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:42.589728 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d6875-e248-4d35-8b97-f72d117c4efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:42.622211 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6b7d6875-e248-4d35-8b97-f72d117c4efd None None] MFA Rules not processed for user `96f0feac2b384b509bc9f75b92b4df95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:42.623665 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6b7d6875-e248-4d35-8b97-f72d117c4efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:42.688276 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1099/2234] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:52:42 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:52:42.690107 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a3b55-3f04-4f7e-98ae-1c7d498e3429 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:42.701329 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a3b55-3f04-4f7e-98ae-1c7d498e3429 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:42.709048 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f9816-dd67-40cc-ad22-b167c79abfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:42.716304 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1136/2235] 10.222.0.81 () {58 vars in 1018 bytes} [Wed May 4 17:52:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:52:42.716634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9816-dd67-40cc-ad22-b167c79abfcd admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:42.716634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9816-dd67-40cc-ad22-b167c79abfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:42.716634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9816-dd67-40cc-ad22-b167c79abfcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:42.716634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f9816-dd67-40cc-ad22-b167c79abfcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:42.716634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f9816-dd67-40cc-ad22-b167c79abfcd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:42.744532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d6875-e248-4d35-8b97-f72d117c4efd None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:42.744532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6b7d6875-e248-4d35-8b97-f72d117c4efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:42.748971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1100/2236] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:52:42.750005 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f9816-dd67-40cc-ad22-b167c79abfcd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:42.761046 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f9816-dd67-40cc-ad22-b167c79abfcd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:42.765983 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29911e8-1d94-471a-a0af-740213a2ae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:42.773297 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29911e8-1d94-471a-a0af-740213a2ae3f admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:42.773297 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29911e8-1d94-471a-a0af-740213a2ae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:42.773297 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29911e8-1d94-471a-a0af-740213a2ae3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:42.773297 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29911e8-1d94-471a-a0af-740213a2ae3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:42.773297 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29911e8-1d94-471a-a0af-740213a2ae3f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:42.776970 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d6875-e248-4d35-8b97-f72d117c4efd None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:42.781258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1101/2237] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:52:42.782672 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2a795-8b6b-41bc-9191-92ef5d1a99b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:42.783412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2a795-8b6b-41bc-9191-92ef5d1a99b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:42.783700 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2a795-8b6b-41bc-9191-92ef5d1a99b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:42.784538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2a795-8b6b-41bc-9191-92ef5d1a99b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:42.785469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29911e8-1d94-471a-a0af-740213a2ae3f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:42.792372 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d2a795-8b6b-41bc-9191-92ef5d1a99b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:42.793897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d2a795-8b6b-41bc-9191-92ef5d1a99b5 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:42.799149 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29911e8-1d94-471a-a0af-740213a2ae3f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:42.803629 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1137/2238] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:52:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:52:42.804200 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d792b2-99c6-4fb7-b81e-8963ef43e373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:42.805284 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d792b2-99c6-4fb7-b81e-8963ef43e373 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:42.805572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d792b2-99c6-4fb7-b81e-8963ef43e373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:42.806727 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d792b2-99c6-4fb7-b81e-8963ef43e373 admin admin] PATH_INFO: `/v3/projects/b0aa9b01b39c48faa17f13d3dda29ec4/users/90aae7d6a5254ed885e60f13d05376b1/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:42.837155 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d792b2-99c6-4fb7-b81e-8963ef43e373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0aa9b01b39c48faa17f13d3dda29ec4, user_id=90aae7d6a5254ed885e60f13d05376b1, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:42.843070 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d792b2-99c6-4fb7-b81e-8963ef43e373 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:43.025505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1102/2239] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:52:42 2022] PUT /identity/v3/projects/b0aa9b01b39c48faa17f13d3dda29ec4/users/90aae7d6a5254ed885e60f13d05376b1/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:52:43.038799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9b6d7-6c09-4f6d-af06-1753d2275aa8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:43.040064 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9b6d7-6c09-4f6d-af06-1753d2275aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:43.040547 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9b6d7-6c09-4f6d-af06-1753d2275aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:43.089340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-30f9b6d7-6c09-4f6d-af06-1753d2275aa8 None None] MFA Rules not processed for user `90aae7d6a5254ed885e60f13d05376b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:43.091266 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-30f9b6d7-6c09-4f6d-af06-1753d2275aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:43.191274 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1138/2240] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:43.193755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d6beb-45db-4203-bfc7-e80f4b77249f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:43.194253 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d6beb-45db-4203-bfc7-e80f4b77249f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:43.194427 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d6beb-45db-4203-bfc7-e80f4b77249f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:43.195925 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1103/2241] 10.222.0.81 () {54 vars in 921 bytes} [Wed May 4 17:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:52:43.202891 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d6beb-45db-4203-bfc7-e80f4b77249f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:43.204645 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b03d6beb-45db-4203-bfc7-e80f4b77249f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:43.205238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e6bfc-1853-423d-adb5-e047d87e700d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:43.205874 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e6bfc-1853-423d-adb5-e047d87e700d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:43.207035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e6bfc-1853-423d-adb5-e047d87e700d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:43.258856 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d14e6bfc-1853-423d-adb5-e047d87e700d None None] MFA Rules not processed for user `d4a073d8f47a485cbb22db01530f3b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:43.260150 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d14e6bfc-1853-423d-adb5-e047d87e700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:43.289974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d6beb-45db-4203-bfc7-e80f4b77249f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:43.295777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b705ba-0a74-4842-9b55-ec578bf4ed5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:43.297154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b705ba-0a74-4842-9b55-ec578bf4ed5b service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:43.297686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b705ba-0a74-4842-9b55-ec578bf4ed5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:43.298659 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b705ba-0a74-4842-9b55-ec578bf4ed5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:43.312705 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b705ba-0a74-4842-9b55-ec578bf4ed5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:43.314522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b705ba-0a74-4842-9b55-ec578bf4ed5b service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:43.340916 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1104/2242] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:52:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:52:43.361503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1139/2243] 10.222.0.81 () {58 vars in 1018 bytes} [Wed May 4 17:52:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:43.373815 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b705ba-0a74-4842-9b55-ec578bf4ed5b service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:43.375323 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-88b705ba-0a74-4842-9b55-ec578bf4ed5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:43.466402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b705ba-0a74-4842-9b55-ec578bf4ed5b service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:43.472482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5f2e2-4fb5-43cc-8947-2a843a4049aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:43.472482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f2e2-4fb5-43cc-8947-2a843a4049aa service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:43.472482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f2e2-4fb5-43cc-8947-2a843a4049aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:43.472482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f2e2-4fb5-43cc-8947-2a843a4049aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:43.484604 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5f2e2-4fb5-43cc-8947-2a843a4049aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:43.485943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5f2e2-4fb5-43cc-8947-2a843a4049aa service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:43.499605 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1105/2244] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:52:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:52:50.624263 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab143e9-8dd7-49b5-a727-c77984860110 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:50.624885 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab143e9-8dd7-49b5-a727-c77984860110 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:50.624978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab143e9-8dd7-49b5-a727-c77984860110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:50.646894 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-eab143e9-8dd7-49b5-a727-c77984860110 None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:50.647956 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-eab143e9-8dd7-49b5-a727-c77984860110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:50.732394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1140/2245] 10.222.0.81 () {58 vars in 1009 bytes} [Wed May 4 17:52:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:50.752628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5f2e2-4fb5-43cc-8947-2a843a4049aa service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:50.756107 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-81d5f2e2-4fb5-43cc-8947-2a843a4049aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:50.870542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5f2e2-4fb5-43cc-8947-2a843a4049aa service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:50.877485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9462b7-8cc3-4ff6-ad3f-23b306f1ce0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:50.878170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9462b7-8cc3-4ff6-ad3f-23b306f1ce0e service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:50.878458 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9462b7-8cc3-4ff6-ad3f-23b306f1ce0e service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:50.878730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9462b7-8cc3-4ff6-ad3f-23b306f1ce0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:50.887423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9462b7-8cc3-4ff6-ad3f-23b306f1ce0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:50.889043 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9462b7-8cc3-4ff6-ad3f-23b306f1ce0e service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:50.899342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1106/2246] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 17:52:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 17:52:57.484376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab143e9-8dd7-49b5-a727-c77984860110 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:57.575433 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab143e9-8dd7-49b5-a727-c77984860110 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:57.581657 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a33126-f9b2-4677-a569-c45582376911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:57.582883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a33126-f9b2-4677-a569-c45582376911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:57.589819 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a33126-f9b2-4677-a569-c45582376911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:57.590176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a33126-f9b2-4677-a569-c45582376911 admin admin] PATH_INFO: `/v3/users/90aae7d6a5254ed885e60f13d05376b1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:57.591544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a33126-f9b2-4677-a569-c45582376911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90aae7d6a5254ed885e60f13d05376b1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:57.593585 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a33126-f9b2-4677-a569-c45582376911 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:57.750954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c0a33126-f9b2-4677-a569-c45582376911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90aae7d6a5254ed885e60f13d05376b1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:57.829283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c0a33126-f9b2-4677-a569-c45582376911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90aae7d6a5254ed885e60f13d05376b1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:57.829915 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c0a33126-f9b2-4677-a569-c45582376911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90aae7d6a5254ed885e60f13d05376b1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:57.837506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c0a33126-f9b2-4677-a569-c45582376911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90aae7d6a5254ed885e60f13d05376b1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:57.863680 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c0a33126-f9b2-4677-a569-c45582376911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90aae7d6a5254ed885e60f13d05376b1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:57.869818 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1141/2247] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:52:57 2022] DELETE /identity/v3/users/90aae7d6a5254ed885e60f13d05376b1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:57.875244 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15359997-1432-41db-9b82-5e127aca8fc8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:57.875817 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15359997-1432-41db-9b82-5e127aca8fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:57.875957 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15359997-1432-41db-9b82-5e127aca8fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:57.895687 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-15359997-1432-41db-9b82-5e127aca8fc8 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:57.896981 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-15359997-1432-41db-9b82-5e127aca8fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:57.964758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1107/2248] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:52:57.972685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a33126-f9b2-4677-a569-c45582376911 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:57.974531 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c0a33126-f9b2-4677-a569-c45582376911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:58.036903 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a33126-f9b2-4677-a569-c45582376911 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:58.040693 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c5f78-69de-4065-ad9e-4ea6a679d230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:58.041338 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c5f78-69de-4065-ad9e-4ea6a679d230 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:58.041619 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c5f78-69de-4065-ad9e-4ea6a679d230 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:58.041894 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c5f78-69de-4065-ad9e-4ea6a679d230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:58.052745 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c5f78-69de-4065-ad9e-4ea6a679d230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:58.054195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c5f78-69de-4065-ad9e-4ea6a679d230 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:58.078701 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1142/2249] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:52:58.689356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15359997-1432-41db-9b82-5e127aca8fc8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:58.689356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-15359997-1432-41db-9b82-5e127aca8fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:58.723905 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15359997-1432-41db-9b82-5e127aca8fc8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:58.739133 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93e469-2ce6-4ed2-92cd-d8eb3adf1492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:58.741321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93e469-2ce6-4ed2-92cd-d8eb3adf1492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:58.743105 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93e469-2ce6-4ed2-92cd-d8eb3adf1492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:58.743568 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93e469-2ce6-4ed2-92cd-d8eb3adf1492 admin admin] PATH_INFO: `/v3/projects/b0aa9b01b39c48faa17f13d3dda29ec4` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:58.745203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93e469-2ce6-4ed2-92cd-d8eb3adf1492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0aa9b01b39c48faa17f13d3dda29ec4)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:58.751211 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93e469-2ce6-4ed2-92cd-d8eb3adf1492 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:58.893405 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed93e469-2ce6-4ed2-92cd-d8eb3adf1492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0aa9b01b39c48faa17f13d3dda29ec4', 'request_id': 'req-ed93e469-2ce6-4ed2-92cd-d8eb3adf1492'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:58.899158 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed93e469-2ce6-4ed2-92cd-d8eb3adf1492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0aa9b01b39c48faa17f13d3dda29ec4', 'request_id': 'req-ed93e469-2ce6-4ed2-92cd-d8eb3adf1492'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:58.968622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed93e469-2ce6-4ed2-92cd-d8eb3adf1492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0aa9b01b39c48faa17f13d3dda29ec4', 'request_id': 'req-ed93e469-2ce6-4ed2-92cd-d8eb3adf1492'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:58.980870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed93e469-2ce6-4ed2-92cd-d8eb3adf1492 admin admin] The token cache is being invalidate because project b0aa9b01b39c48faa17f13d3dda29ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:52:58.981162 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed93e469-2ce6-4ed2-92cd-d8eb3adf1492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:58.981826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed93e469-2ce6-4ed2-92cd-d8eb3adf1492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:52:58.983951 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1108/2250] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:52:58 2022] DELETE /identity/v3/projects/b0aa9b01b39c48faa17f13d3dda29ec4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:52:58.989360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bf2a5-5f4e-442e-bd9f-bfe92d33de59 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:58.989923 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bf2a5-5f4e-442e-bd9f-bfe92d33de59 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:58.990119 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bf2a5-5f4e-442e-bd9f-bfe92d33de59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:59.012985 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-388bf2a5-5f4e-442e-bd9f-bfe92d33de59 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:59.014500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-388bf2a5-5f4e-442e-bd9f-bfe92d33de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:59.076405 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1143/2251] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:59.084515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434628d-2992-489c-8ca0-3498a246907c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:59.084810 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434628d-2992-489c-8ca0-3498a246907c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:59.085099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434628d-2992-489c-8ca0-3498a246907c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:59.104794 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2434628d-2992-489c-8ca0-3498a246907c None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:52:59.106087 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2434628d-2992-489c-8ca0-3498a246907c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:52:59.115890 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1109/2252] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:52:59.120027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bf2a5-5f4e-442e-bd9f-bfe92d33de59 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:59.131211 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bf2a5-5f4e-442e-bd9f-bfe92d33de59 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:59.138577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb857e-5b37-4cce-8e8b-d8d81941df56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:59.139248 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb857e-5b37-4cce-8e8b-d8d81941df56 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:59.139571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb857e-5b37-4cce-8e8b-d8d81941df56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:59.139891 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb857e-5b37-4cce-8e8b-d8d81941df56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:59.140620 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb857e-5b37-4cce-8e8b-d8d81941df56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:52:59.140924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb857e-5b37-4cce-8e8b-d8d81941df56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:59.142576 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb857e-5b37-4cce-8e8b-d8d81941df56 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:59.160175 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1144/2253] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:52:59.164750 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434628d-2992-489c-8ca0-3498a246907c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:59.175861 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434628d-2992-489c-8ca0-3498a246907c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:59.180956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3690cc7-88dd-49c4-bc5b-18b520b280b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:59.181764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3690cc7-88dd-49c4-bc5b-18b520b280b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:59.182053 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3690cc7-88dd-49c4-bc5b-18b520b280b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:59.182331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3690cc7-88dd-49c4-bc5b-18b520b280b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:59.183035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3690cc7-88dd-49c4-bc5b-18b520b280b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:59.185225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3690cc7-88dd-49c4-bc5b-18b520b280b0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:59.282088 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1110/2254] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:52:59 2022] POST /identity/v3/projects => generated 395 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:52:59.294799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb857e-5b37-4cce-8e8b-d8d81941df56 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:59.324416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb857e-5b37-4cce-8e8b-d8d81941df56 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:59.430831 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e25c48-0dea-421e-b5d3-60374c8de19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:59.431519 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e25c48-0dea-421e-b5d3-60374c8de19c admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:59.431802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e25c48-0dea-421e-b5d3-60374c8de19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:59.432189 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e25c48-0dea-421e-b5d3-60374c8de19c admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:59.432805 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e25c48-0dea-421e-b5d3-60374c8de19c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:59.434747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e25c48-0dea-421e-b5d3-60374c8de19c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:59.581267 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1145/2255] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:52:59 2022] POST /identity/v3/users => generated 298 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:52:59.593745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3690cc7-88dd-49c4-bc5b-18b520b280b0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:59.606400 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3690cc7-88dd-49c4-bc5b-18b520b280b0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:59.621928 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b1ff3-01fa-4b97-9a54-4781842c7b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:59.622729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b1ff3-01fa-4b97-9a54-4781842c7b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:59.623089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b1ff3-01fa-4b97-9a54-4781842c7b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:59.623587 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b1ff3-01fa-4b97-9a54-4781842c7b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:59.626226 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b1ff3-01fa-4b97-9a54-4781842c7b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:59.627955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b1ff3-01fa-4b97-9a54-4781842c7b03 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:59.645067 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1111/2256] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:52:59.646432 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e25c48-0dea-421e-b5d3-60374c8de19c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:59.658735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e25c48-0dea-421e-b5d3-60374c8de19c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:59.682383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153a6a8-360d-4ddd-85ad-5ddd6821bc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:59.684220 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153a6a8-360d-4ddd-85ad-5ddd6821bc7f admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:59.685101 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153a6a8-360d-4ddd-85ad-5ddd6821bc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:59.685467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153a6a8-360d-4ddd-85ad-5ddd6821bc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:59.687051 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153a6a8-360d-4ddd-85ad-5ddd6821bc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:59.688873 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153a6a8-360d-4ddd-85ad-5ddd6821bc7f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:52:59.700924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1146/2257] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:52:59.705710 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b1ff3-01fa-4b97-9a54-4781842c7b03 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:52:59.721697 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b1ff3-01fa-4b97-9a54-4781842c7b03 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:52:59.735125 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6ef6f-0e9f-48f5-9869-e59b13b59d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:52:59.736146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6ef6f-0e9f-48f5-9869-e59b13b59d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:52:59.736548 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6ef6f-0e9f-48f5-9869-e59b13b59d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:52:59.736900 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6ef6f-0e9f-48f5-9869-e59b13b59d68 admin admin] PATH_INFO: `/v3/projects/2abe36ba0b554cd68d80c65906a4a0bc/users/b7f4b956c33d493d953e5c44596e978a/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:52:59.767512 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6ef6f-0e9f-48f5-9869-e59b13b59d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abe36ba0b554cd68d80c65906a4a0bc, user_id=b7f4b956c33d493d953e5c44596e978a, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:52:59.770844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6ef6f-0e9f-48f5-9869-e59b13b59d68 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:00.182416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1112/2258] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:52:59 2022] PUT /identity/v3/projects/2abe36ba0b554cd68d80c65906a4a0bc/users/b7f4b956c33d493d953e5c44596e978a/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:53:00.197277 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c735a2-9eed-41d9-b503-5ef857208b49 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:00.197277 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c735a2-9eed-41d9-b503-5ef857208b49 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:00.197277 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c735a2-9eed-41d9-b503-5ef857208b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:00.228335 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a9c735a2-9eed-41d9-b503-5ef857208b49 None None] MFA Rules not processed for user `b7f4b956c33d493d953e5c44596e978a`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:53:00.269712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a9c735a2-9eed-41d9-b503-5ef857208b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:00.304006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1147/2259] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:53:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:53:00.345286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6ef6f-0e9f-48f5-9869-e59b13b59d68 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:00.347092 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0dc6ef6f-0e9f-48f5-9869-e59b13b59d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:00.413764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6ef6f-0e9f-48f5-9869-e59b13b59d68 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:00.417756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc85c2-f2e6-4ef6-9f5e-249406a2b04f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:00.418543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc85c2-f2e6-4ef6-9f5e-249406a2b04f service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:00.418894 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc85c2-f2e6-4ef6-9f5e-249406a2b04f service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:00.419241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc85c2-f2e6-4ef6-9f5e-249406a2b04f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:00.429993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc85c2-f2e6-4ef6-9f5e-249406a2b04f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:00.434028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc85c2-f2e6-4ef6-9f5e-249406a2b04f service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:00.440980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1113/2260] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:53:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:53:02.872103 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c735a2-9eed-41d9-b503-5ef857208b49 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:02.874882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a9c735a2-9eed-41d9-b503-5ef857208b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:02.946406 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c735a2-9eed-41d9-b503-5ef857208b49 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:02.950964 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8eb714-5cad-44e2-9334-33ac6a7b9f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:02.951880 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8eb714-5cad-44e2-9334-33ac6a7b9f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:02.955161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8eb714-5cad-44e2-9334-33ac6a7b9f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:02.955161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8eb714-5cad-44e2-9334-33ac6a7b9f73 admin admin] PATH_INFO: `/v3/users/38cac24198a34a4aa30d6cd920b2eae9` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:02.955161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8eb714-5cad-44e2-9334-33ac6a7b9f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38cac24198a34a4aa30d6cd920b2eae9)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:02.956374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8eb714-5cad-44e2-9334-33ac6a7b9f73 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:03.159673 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1b8eb714-5cad-44e2-9334-33ac6a7b9f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38cac24198a34a4aa30d6cd920b2eae9'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:03.508768 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1b8eb714-5cad-44e2-9334-33ac6a7b9f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38cac24198a34a4aa30d6cd920b2eae9'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:03.509515 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1b8eb714-5cad-44e2-9334-33ac6a7b9f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38cac24198a34a4aa30d6cd920b2eae9'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:03.518493 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1b8eb714-5cad-44e2-9334-33ac6a7b9f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38cac24198a34a4aa30d6cd920b2eae9'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:03.532517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1b8eb714-5cad-44e2-9334-33ac6a7b9f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38cac24198a34a4aa30d6cd920b2eae9'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:03.539206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1148/2261] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:53:02 2022] DELETE /identity/v3/users/38cac24198a34a4aa30d6cd920b2eae9 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:53:03.543652 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1732aa-a434-4ddf-b60d-e2fed3cc8d1e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:03.544624 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1732aa-a434-4ddf-b60d-e2fed3cc8d1e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:03.544916 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1732aa-a434-4ddf-b60d-e2fed3cc8d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:03.568212 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9c1732aa-a434-4ddf-b60d-e2fed3cc8d1e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:53:03.569494 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9c1732aa-a434-4ddf-b60d-e2fed3cc8d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:03.672258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1114/2262] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:53:03.682371 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8eb714-5cad-44e2-9334-33ac6a7b9f73 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:03.684430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1b8eb714-5cad-44e2-9334-33ac6a7b9f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:03.745758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8eb714-5cad-44e2-9334-33ac6a7b9f73 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:03.749727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27738c-ef28-4716-a7e7-98705d946d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:03.750440 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27738c-ef28-4716-a7e7-98705d946d96 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:03.750786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27738c-ef28-4716-a7e7-98705d946d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:03.751126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27738c-ef28-4716-a7e7-98705d946d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:03.760353 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27738c-ef28-4716-a7e7-98705d946d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:03.761921 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27738c-ef28-4716-a7e7-98705d946d96 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:03.775230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1149/2263] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:53:04.274950 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1732aa-a434-4ddf-b60d-e2fed3cc8d1e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:04.276506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9c1732aa-a434-4ddf-b60d-e2fed3cc8d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:04.290345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1732aa-a434-4ddf-b60d-e2fed3cc8d1e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:04.295303 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebae738-a47e-43dc-95d8-35440b69dd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:04.296765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebae738-a47e-43dc-95d8-35440b69dd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:04.296765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebae738-a47e-43dc-95d8-35440b69dd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:04.296979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebae738-a47e-43dc-95d8-35440b69dd94 admin admin] PATH_INFO: `/v3/projects/1c1d617a774942c0affc97c4b3968e8c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:04.299122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebae738-a47e-43dc-95d8-35440b69dd94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1d617a774942c0affc97c4b3968e8c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:04.301515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebae738-a47e-43dc-95d8-35440b69dd94 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:04.448771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bebae738-a47e-43dc-95d8-35440b69dd94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1d617a774942c0affc97c4b3968e8c', 'request_id': 'req-bebae738-a47e-43dc-95d8-35440b69dd94'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:04.456491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bebae738-a47e-43dc-95d8-35440b69dd94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1d617a774942c0affc97c4b3968e8c', 'request_id': 'req-bebae738-a47e-43dc-95d8-35440b69dd94'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:04.560264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bebae738-a47e-43dc-95d8-35440b69dd94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1d617a774942c0affc97c4b3968e8c', 'request_id': 'req-bebae738-a47e-43dc-95d8-35440b69dd94'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:04.573652 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bebae738-a47e-43dc-95d8-35440b69dd94 admin admin] The token cache is being invalidate because project 1c1d617a774942c0affc97c4b3968e8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:53:04.573938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bebae738-a47e-43dc-95d8-35440b69dd94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:04.574597 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bebae738-a47e-43dc-95d8-35440b69dd94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:04.576148 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1115/2264] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:53:04 2022] DELETE /identity/v3/projects/1c1d617a774942c0affc97c4b3968e8c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:53:04.584212 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e3390-f030-4b68-a186-60a2eb4b8369 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:04.585225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e3390-f030-4b68-a186-60a2eb4b8369 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:04.585225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e3390-f030-4b68-a186-60a2eb4b8369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:04.607379 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2d6e3390-f030-4b68-a186-60a2eb4b8369 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:53:04.609232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2d6e3390-f030-4b68-a186-60a2eb4b8369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:04.673514 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1150/2265] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:53:04.681199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2208f52-88ec-4fd6-a56b-96cc7a987db7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:04.681589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2208f52-88ec-4fd6-a56b-96cc7a987db7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:04.681945 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2208f52-88ec-4fd6-a56b-96cc7a987db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:04.700724 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c2208f52-88ec-4fd6-a56b-96cc7a987db7 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:53:04.702369 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c2208f52-88ec-4fd6-a56b-96cc7a987db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:04.710367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1116/2266] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:53:04.714855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e3390-f030-4b68-a186-60a2eb4b8369 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:04.727081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e3390-f030-4b68-a186-60a2eb4b8369 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:04.735578 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15a78d-b221-4c51-a525-0c785f6949b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:04.739336 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15a78d-b221-4c51-a525-0c785f6949b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:04.739336 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15a78d-b221-4c51-a525-0c785f6949b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:04.739336 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15a78d-b221-4c51-a525-0c785f6949b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:04.740136 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15a78d-b221-4c51-a525-0c785f6949b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:53:04.740628 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15a78d-b221-4c51-a525-0c785f6949b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:04.743748 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15a78d-b221-4c51-a525-0c785f6949b1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:04.761001 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1151/2267] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:53:04.762222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2208f52-88ec-4fd6-a56b-96cc7a987db7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:04.772506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2208f52-88ec-4fd6-a56b-96cc7a987db7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:04.777540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270ffa2-e3a6-4d6d-9941-a69e0f866d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:04.778266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ffa2-e3a6-4d6d-9941-a69e0f866d87 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:04.778620 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ffa2-e3a6-4d6d-9941-a69e0f866d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:04.778971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ffa2-e3a6-4d6d-9941-a69e0f866d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:04.779825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270ffa2-e3a6-4d6d-9941-a69e0f866d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:04.782252 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270ffa2-e3a6-4d6d-9941-a69e0f866d87 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:04.876575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1117/2268] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:53:04 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:53:04.880812 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15a78d-b221-4c51-a525-0c785f6949b1 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:04.896223 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15a78d-b221-4c51-a525-0c785f6949b1 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:04.957081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ed0ae-2af5-41ab-ae99-1b44d6054c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:04.957741 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ed0ae-2af5-41ab-ae99-1b44d6054c3e admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:04.958027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ed0ae-2af5-41ab-ae99-1b44d6054c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:04.958306 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ed0ae-2af5-41ab-ae99-1b44d6054c3e admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:04.959006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ed0ae-2af5-41ab-ae99-1b44d6054c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:04.960980 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ed0ae-2af5-41ab-ae99-1b44d6054c3e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:05.055377 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1152/2269] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:53:04 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:53:05.056583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270ffa2-e3a6-4d6d-9941-a69e0f866d87 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:05.066851 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270ffa2-e3a6-4d6d-9941-a69e0f866d87 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:05.071449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748fd72-9dcc-4c3e-ac7c-5e79df0c7dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:05.072102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748fd72-9dcc-4c3e-ac7c-5e79df0c7dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:05.072380 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748fd72-9dcc-4c3e-ac7c-5e79df0c7dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:05.072738 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748fd72-9dcc-4c3e-ac7c-5e79df0c7dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:05.073411 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748fd72-9dcc-4c3e-ac7c-5e79df0c7dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:05.074990 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748fd72-9dcc-4c3e-ac7c-5e79df0c7dfa admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:05.086114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1118/2270] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:53:05.090346 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ed0ae-2af5-41ab-ae99-1b44d6054c3e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:05.101475 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ed0ae-2af5-41ab-ae99-1b44d6054c3e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:05.106255 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638010a-e0d5-4ec2-a331-fd0c096459a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:05.112158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638010a-e0d5-4ec2-a331-fd0c096459a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:05.112158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638010a-e0d5-4ec2-a331-fd0c096459a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:05.112158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638010a-e0d5-4ec2-a331-fd0c096459a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:05.112158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638010a-e0d5-4ec2-a331-fd0c096459a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:05.112158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638010a-e0d5-4ec2-a331-fd0c096459a1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:05.122661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1153/2271] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:53:05.127026 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748fd72-9dcc-4c3e-ac7c-5e79df0c7dfa admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:05.136974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748fd72-9dcc-4c3e-ac7c-5e79df0c7dfa admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:05.142400 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421daf9-1b33-478b-905b-49ac9312da02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:05.143387 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421daf9-1b33-478b-905b-49ac9312da02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:05.143676 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421daf9-1b33-478b-905b-49ac9312da02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:05.143958 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421daf9-1b33-478b-905b-49ac9312da02 admin admin] PATH_INFO: `/v3/projects/7bf503d4d93642a196265e5250c73455/users/28c93905a28d452097c9b45bcbe3cfd2/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:05.159465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421daf9-1b33-478b-905b-49ac9312da02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf503d4d93642a196265e5250c73455, user_id=28c93905a28d452097c9b45bcbe3cfd2, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:05.162152 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421daf9-1b33-478b-905b-49ac9312da02 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:05.252493 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1119/2272] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:53:05 2022] PUT /identity/v3/projects/7bf503d4d93642a196265e5250c73455/users/28c93905a28d452097c9b45bcbe3cfd2/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:53:05.257670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe9432-88e2-462d-b3a5-944ce6da8c86 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:05.257986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe9432-88e2-462d-b3a5-944ce6da8c86 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:05.259441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe9432-88e2-462d-b3a5-944ce6da8c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:05.278455 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-89fe9432-88e2-462d-b3a5-944ce6da8c86 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:53:05.280805 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-89fe9432-88e2-462d-b3a5-944ce6da8c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:05.347650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1154/2273] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:53:05.357183 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421daf9-1b33-478b-905b-49ac9312da02 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:05.359411 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d421daf9-1b33-478b-905b-49ac9312da02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:05.416311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421daf9-1b33-478b-905b-49ac9312da02 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:05.420002 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09330a5e-841f-4f21-99ef-725f511797d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:05.420678 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09330a5e-841f-4f21-99ef-725f511797d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:05.420997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09330a5e-841f-4f21-99ef-725f511797d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:05.421280 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09330a5e-841f-4f21-99ef-725f511797d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:05.430868 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09330a5e-841f-4f21-99ef-725f511797d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:05.432610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09330a5e-841f-4f21-99ef-725f511797d6 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:05.443129 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1120/2274] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:53:10.194166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe9432-88e2-462d-b3a5-944ce6da8c86 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:10.195872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-89fe9432-88e2-462d-b3a5-944ce6da8c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:10.208518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe9432-88e2-462d-b3a5-944ce6da8c86 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:10.213786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d03341-0c04-4f76-8b8c-e77ac5fbf2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:10.214863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d03341-0c04-4f76-8b8c-e77ac5fbf2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:10.215310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d03341-0c04-4f76-8b8c-e77ac5fbf2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:10.216039 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d03341-0c04-4f76-8b8c-e77ac5fbf2a5 admin admin] PATH_INFO: `/v3/users/b7f4b956c33d493d953e5c44596e978a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:10.217645 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d03341-0c04-4f76-8b8c-e77ac5fbf2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f4b956c33d493d953e5c44596e978a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:10.220138 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d03341-0c04-4f76-8b8c-e77ac5fbf2a5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:10.450263 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-02d03341-0c04-4f76-8b8c-e77ac5fbf2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f4b956c33d493d953e5c44596e978a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:10.520721 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-02d03341-0c04-4f76-8b8c-e77ac5fbf2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f4b956c33d493d953e5c44596e978a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:10.521447 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-02d03341-0c04-4f76-8b8c-e77ac5fbf2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f4b956c33d493d953e5c44596e978a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:10.529439 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-02d03341-0c04-4f76-8b8c-e77ac5fbf2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f4b956c33d493d953e5c44596e978a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:10.543153 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-02d03341-0c04-4f76-8b8c-e77ac5fbf2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f4b956c33d493d953e5c44596e978a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:10.553198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1155/2275] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:53:10 2022] DELETE /identity/v3/users/b7f4b956c33d493d953e5c44596e978a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:53:10.555350 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52351234-232d-4d1a-ab4f-820233892f6b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:10.555840 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52351234-232d-4d1a-ab4f-820233892f6b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:10.556242 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52351234-232d-4d1a-ab4f-820233892f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:10.573775 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-52351234-232d-4d1a-ab4f-820233892f6b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:53:10.575009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-52351234-232d-4d1a-ab4f-820233892f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:10.636874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1121/2276] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:53:10.652804 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d03341-0c04-4f76-8b8c-e77ac5fbf2a5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:10.654618 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-02d03341-0c04-4f76-8b8c-e77ac5fbf2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:10.715379 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d03341-0c04-4f76-8b8c-e77ac5fbf2a5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:10.719065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786a290-6eab-4240-b8fd-67e12710dfca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:10.719710 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786a290-6eab-4240-b8fd-67e12710dfca service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:10.720009 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786a290-6eab-4240-b8fd-67e12710dfca service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:10.720260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786a290-6eab-4240-b8fd-67e12710dfca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:10.730118 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786a290-6eab-4240-b8fd-67e12710dfca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:10.731895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786a290-6eab-4240-b8fd-67e12710dfca service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:10.747199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1156/2277] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:53:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:53:11.410942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52351234-232d-4d1a-ab4f-820233892f6b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:11.412453 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-52351234-232d-4d1a-ab4f-820233892f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:11.430678 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52351234-232d-4d1a-ab4f-820233892f6b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:11.445225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658c7de-d198-4cfd-aa94-4c9a767c3e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:11.446202 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658c7de-d198-4cfd-aa94-4c9a767c3e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:11.446903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658c7de-d198-4cfd-aa94-4c9a767c3e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:11.447543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658c7de-d198-4cfd-aa94-4c9a767c3e56 admin admin] PATH_INFO: `/v3/projects/2abe36ba0b554cd68d80c65906a4a0bc` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:11.454032 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658c7de-d198-4cfd-aa94-4c9a767c3e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2abe36ba0b554cd68d80c65906a4a0bc)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:11.454032 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658c7de-d198-4cfd-aa94-4c9a767c3e56 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:11.601669 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c658c7de-d198-4cfd-aa94-4c9a767c3e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2abe36ba0b554cd68d80c65906a4a0bc', 'request_id': 'req-c658c7de-d198-4cfd-aa94-4c9a767c3e56'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:11.610071 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c658c7de-d198-4cfd-aa94-4c9a767c3e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2abe36ba0b554cd68d80c65906a4a0bc', 'request_id': 'req-c658c7de-d198-4cfd-aa94-4c9a767c3e56'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:11.712167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c658c7de-d198-4cfd-aa94-4c9a767c3e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2abe36ba0b554cd68d80c65906a4a0bc', 'request_id': 'req-c658c7de-d198-4cfd-aa94-4c9a767c3e56'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:11.729098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c658c7de-d198-4cfd-aa94-4c9a767c3e56 admin admin] The token cache is being invalidate because project 2abe36ba0b554cd68d80c65906a4a0bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:53:11.729393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c658c7de-d198-4cfd-aa94-4c9a767c3e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:11.730072 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c658c7de-d198-4cfd-aa94-4c9a767c3e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:53:11.740615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1122/2278] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:53:11 2022] DELETE /identity/v3/projects/2abe36ba0b554cd68d80c65906a4a0bc => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:53:11.833666 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786a290-6eab-4240-b8fd-67e12710dfca service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:11.838350 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2786a290-6eab-4240-b8fd-67e12710dfca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:12.158395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786a290-6eab-4240-b8fd-67e12710dfca service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:12.260027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e243f81-77da-4cb6-bcd7-d48c8112e34e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ff8c001247c43ccbc4ccb26daa17201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:12.261144 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e243f81-77da-4cb6-bcd7-d48c8112e34e service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:12.270607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e243f81-77da-4cb6-bcd7-d48c8112e34e service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:12.270607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e243f81-77da-4cb6-bcd7-d48c8112e34e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:12.270607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0e243f81-77da-4cb6-bcd7-d48c8112e34e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:12.277959 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e243f81-77da-4cb6-bcd7-d48c8112e34e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:12.279903 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e243f81-77da-4cb6-bcd7-d48c8112e34e service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:12.295251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1157/2279] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:53:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:53:13.761491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9c40f-6414-4c3a-89ea-a17f9d22916a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:13.762447 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9c40f-6414-4c3a-89ea-a17f9d22916a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:13.762939 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9c40f-6414-4c3a-89ea-a17f9d22916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:13.803715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2de9c40f-6414-4c3a-89ea-a17f9d22916a None None] MFA Rules not processed for user `28c93905a28d452097c9b45bcbe3cfd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:53:13.807692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2de9c40f-6414-4c3a-89ea-a17f9d22916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:13.912241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1123/2280] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:53:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:53:13.917104 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e243f81-77da-4cb6-bcd7-d48c8112e34e service placement] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:13.918533 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0e243f81-77da-4cb6-bcd7-d48c8112e34e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:13.995434 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e243f81-77da-4cb6-bcd7-d48c8112e34e service placement] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:14.003108 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9e230-a8bf-48db-8c66-f166497f3e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:14.004090 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9e230-a8bf-48db-8c66-f166497f3e80 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:14.004601 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9e230-a8bf-48db-8c66-f166497f3e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:14.004946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9e230-a8bf-48db-8c66-f166497f3e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:14.005722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9e230-a8bf-48db-8c66-f166497f3e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:14.007931 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9e230-a8bf-48db-8c66-f166497f3e80 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:14.124081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1158/2281] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:53:13 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:53:14.128714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9c40f-6414-4c3a-89ea-a17f9d22916a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:14.139474 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9c40f-6414-4c3a-89ea-a17f9d22916a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:14.212864 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859987d7-ac81-47aa-b33d-41bbd17112d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:14.219324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859987d7-ac81-47aa-b33d-41bbd17112d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:14.219324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859987d7-ac81-47aa-b33d-41bbd17112d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:14.219324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859987d7-ac81-47aa-b33d-41bbd17112d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:14.219324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859987d7-ac81-47aa-b33d-41bbd17112d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:14.219324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859987d7-ac81-47aa-b33d-41bbd17112d7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:14.352686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1124/2282] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:53:14 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:53:14.358423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9e230-a8bf-48db-8c66-f166497f3e80 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:14.371877 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9e230-a8bf-48db-8c66-f166497f3e80 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:14.400413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fb19f-7157-4d66-9a46-8c84baf16f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:14.403424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb19f-7157-4d66-9a46-8c84baf16f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:14.406201 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb19f-7157-4d66-9a46-8c84baf16f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:14.406603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb19f-7157-4d66-9a46-8c84baf16f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:14.407585 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fb19f-7157-4d66-9a46-8c84baf16f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:14.417547 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fb19f-7157-4d66-9a46-8c84baf16f30 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:14.449709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1159/2283] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:53:14.454151 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859987d7-ac81-47aa-b33d-41bbd17112d7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:14.469138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859987d7-ac81-47aa-b33d-41bbd17112d7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:14.477080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8bf29-1379-4842-8e62-2839805f249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:14.478393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8bf29-1379-4842-8e62-2839805f249c admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:14.478767 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8bf29-1379-4842-8e62-2839805f249c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:14.479502 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8bf29-1379-4842-8e62-2839805f249c admin admin] PATH_INFO: `/v3/projects/675947c2f62242d599bb193dc73d6fd1/users/f15e3675374149ddbe1fb46eb1fed3a0/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:14.503593 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8bf29-1379-4842-8e62-2839805f249c admin admin] RBAC: Authorizing `identity:create_grant(project_id=675947c2f62242d599bb193dc73d6fd1, user_id=f15e3675374149ddbe1fb46eb1fed3a0, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:14.510091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8bf29-1379-4842-8e62-2839805f249c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:14.607058 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1125/2284] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:53:14 2022] PUT /identity/v3/projects/675947c2f62242d599bb193dc73d6fd1/users/f15e3675374149ddbe1fb46eb1fed3a0/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:53:14.611535 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fb19f-7157-4d66-9a46-8c84baf16f30 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:14.627708 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fb19f-7157-4d66-9a46-8c84baf16f30 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:14.707823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146e37f-91de-44cd-9158-989685c412d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:14.708781 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146e37f-91de-44cd-9158-989685c412d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:14.708990 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146e37f-91de-44cd-9158-989685c412d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:14.709260 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146e37f-91de-44cd-9158-989685c412d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:14.710212 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146e37f-91de-44cd-9158-989685c412d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:14.712084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146e37f-91de-44cd-9158-989685c412d4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:14.724566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1160/2285] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:53:14.728612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8bf29-1379-4842-8e62-2839805f249c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:14.742060 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8bf29-1379-4842-8e62-2839805f249c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:14.753234 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bae332-e62e-42c1-9e92-c78ad3096b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:14.754197 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae332-e62e-42c1-9e92-c78ad3096b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:14.754692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae332-e62e-42c1-9e92-c78ad3096b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:14.755127 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae332-e62e-42c1-9e92-c78ad3096b87 admin admin] PATH_INFO: `/v3/projects/675947c2f62242d599bb193dc73d6fd1/users/f15e3675374149ddbe1fb46eb1fed3a0/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:14.757591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bae332-e62e-42c1-9e92-c78ad3096b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=675947c2f62242d599bb193dc73d6fd1, user_id=f15e3675374149ddbe1fb46eb1fed3a0, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:14.760790 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bae332-e62e-42c1-9e92-c78ad3096b87 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:14.775820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1126/2286] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:53:14 2022] PUT /identity/v3/projects/675947c2f62242d599bb193dc73d6fd1/users/f15e3675374149ddbe1fb46eb1fed3a0/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:53:16.714266 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655e7ca-3307-46fe-bb40-549a5b9c48f0 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:16.715814 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655e7ca-3307-46fe-bb40-549a5b9c48f0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:16.716380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655e7ca-3307-46fe-bb40-549a5b9c48f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:16.741442 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1655e7ca-3307-46fe-bb40-549a5b9c48f0 None None] MFA Rules not processed for user `f53c54c0847349599b3cccbb4eeb2e93`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:53:16.744948 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1655e7ca-3307-46fe-bb40-549a5b9c48f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:16.832647 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1161/2287] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:53:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:53:17.985933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf26b7-da50-4190-aa33-004bfb000cd6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:17.986449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf26b7-da50-4190-aa33-004bfb000cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:17.986542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf26b7-da50-4190-aa33-004bfb000cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:18.021886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-08bf26b7-da50-4190-aa33-004bfb000cd6 None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:53:18.023325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-08bf26b7-da50-4190-aa33-004bfb000cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:18.130904 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1127/2288] 10.222.0.81 () {58 vars in 967 bytes} [Wed May 4 17:53:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:53:18.146791 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655e7ca-3307-46fe-bb40-549a5b9c48f0 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:18.148893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1655e7ca-3307-46fe-bb40-549a5b9c48f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:18.151095 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6faeb9-7d44-4706-8bfe-43922dc55a6d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:18.151326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6faeb9-7d44-4706-8bfe-43922dc55a6d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:18.151701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6faeb9-7d44-4706-8bfe-43922dc55a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:18.198111 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6c6faeb9-7d44-4706-8bfe-43922dc55a6d None None] MFA Rules not processed for user `546c3447688f473fb256f4bc3dd99188`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:53:18.200343 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6c6faeb9-7d44-4706-8bfe-43922dc55a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:18.295754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1128/2289] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:53:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:53:18.309547 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655e7ca-3307-46fe-bb40-549a5b9c48f0 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:18.317205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4a00f-eb1f-4bba-94a7-09b3ca1b7e68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:18.318161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4a00f-eb1f-4bba-94a7-09b3ca1b7e68 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:18.318616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4a00f-eb1f-4bba-94a7-09b3ca1b7e68 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:18.319048 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4a00f-eb1f-4bba-94a7-09b3ca1b7e68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:18.354847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4a00f-eb1f-4bba-94a7-09b3ca1b7e68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:18.357555 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4a00f-eb1f-4bba-94a7-09b3ca1b7e68 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:18.384930 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1162/2290] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 17:53:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 17:53:22.712059 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa48a97-3cfd-4589-851e-780791ff3e32 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:22.712894 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa48a97-3cfd-4589-851e-780791ff3e32 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:22.713326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa48a97-3cfd-4589-851e-780791ff3e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:22.743951 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8fa48a97-3cfd-4589-851e-780791ff3e32 None None] MFA Rules not processed for user `f15e3675374149ddbe1fb46eb1fed3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:53:22.745274 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8fa48a97-3cfd-4589-851e-780791ff3e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:22.845665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1129/2291] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:53:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:53:22.856618 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4a00f-eb1f-4bba-94a7-09b3ca1b7e68 service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:22.858092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-25a4a00f-eb1f-4bba-94a7-09b3ca1b7e68 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:22.940362 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4a00f-eb1f-4bba-94a7-09b3ca1b7e68 service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:22.947340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865b16d-46b2-4707-a166-93a1fb73455d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:22.947997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865b16d-46b2-4707-a166-93a1fb73455d service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:22.948276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865b16d-46b2-4707-a166-93a1fb73455d service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:22.948592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865b16d-46b2-4707-a166-93a1fb73455d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:23.010731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865b16d-46b2-4707-a166-93a1fb73455d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:23.012425 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865b16d-46b2-4707-a166-93a1fb73455d service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:23.022158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1163/2292] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:53:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:53:23.443640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa48a97-3cfd-4589-851e-780791ff3e32 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:23.445146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8fa48a97-3cfd-4589-851e-780791ff3e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:23.501412 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa48a97-3cfd-4589-851e-780791ff3e32 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:23.505100 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bcd71-0614-49a1-a110-b3296b086ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:23.505781 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bcd71-0614-49a1-a110-b3296b086ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:23.506062 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bcd71-0614-49a1-a110-b3296b086ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:23.506339 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bcd71-0614-49a1-a110-b3296b086ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:23.508163 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e37bcd71-0614-49a1-a110-b3296b086ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:23.575780 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bcd71-0614-49a1-a110-b3296b086ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:23.577246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bcd71-0614-49a1-a110-b3296b086ec2 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:23.586860 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1130/2293] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:53:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:53:28.484352 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082e3c6-203a-470e-b838-244be31aaa16 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:28.484853 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082e3c6-203a-470e-b838-244be31aaa16 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:28.484934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082e3c6-203a-470e-b838-244be31aaa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:28.507768 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d082e3c6-203a-470e-b838-244be31aaa16 None None] MFA Rules not processed for user `28c93905a28d452097c9b45bcbe3cfd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:53:28.509019 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d082e3c6-203a-470e-b838-244be31aaa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:28.517217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1164/2294] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:53:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:53:50.515950 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c6505-126f-44b2-b831-1e351bb2c885 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:50.516488 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c6505-126f-44b2-b831-1e351bb2c885 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:50.516589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c6505-126f-44b2-b831-1e351bb2c885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:50.553301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c15c6505-126f-44b2-b831-1e351bb2c885 None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:53:50.553301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c15c6505-126f-44b2-b831-1e351bb2c885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:53:50.553301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1131/2295] 10.222.0.81 () {58 vars in 1009 bytes} [Wed May 4 17:53:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:53:50.567683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082e3c6-203a-470e-b838-244be31aaa16 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:53:50.580417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082e3c6-203a-470e-b838-244be31aaa16 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:53:50.585567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f881a6-89b6-45d0-9747-25c7a2c21531 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:53:50.586367 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f881a6-89b6-45d0-9747-25c7a2c21531 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:53:50.586717 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f881a6-89b6-45d0-9747-25c7a2c21531 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:53:50.587123 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f881a6-89b6-45d0-9747-25c7a2c21531 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:53:50.595483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f881a6-89b6-45d0-9747-25c7a2c21531 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:53:50.597438 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f881a6-89b6-45d0-9747-25c7a2c21531 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:53:50.605496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1165/2296] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 17:53:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 17:54:10.247356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e165b72-4c94-4000-907e-540de108d2e4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:10.247882 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e165b72-4c94-4000-907e-540de108d2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:10.247882 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e165b72-4c94-4000-907e-540de108d2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:10.265410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5e165b72-4c94-4000-907e-540de108d2e4 None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:54:10.266594 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5e165b72-4c94-4000-907e-540de108d2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:10.274424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1132/2297] 10.222.0.81 () {58 vars in 967 bytes} [Wed May 4 17:54:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:54:10.287284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f881a6-89b6-45d0-9747-25c7a2c21531 service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:10.297611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f881a6-89b6-45d0-9747-25c7a2c21531 service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:10.303048 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f399e-72fe-40fb-b2e9-f3268295df91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:10.303629 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f399e-72fe-40fb-b2e9-f3268295df91 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:10.303903 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f399e-72fe-40fb-b2e9-f3268295df91 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:10.304356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f399e-72fe-40fb-b2e9-f3268295df91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:10.312693 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f399e-72fe-40fb-b2e9-f3268295df91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:10.314302 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f399e-72fe-40fb-b2e9-f3268295df91 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:10.328389 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1166/2298] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 17:54:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 17:54:13.367562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e165b72-4c94-4000-907e-540de108d2e4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:13.370119 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5e165b72-4c94-4000-907e-540de108d2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:13.449601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e165b72-4c94-4000-907e-540de108d2e4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:13.454320 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24498e7e-f628-4c6e-a9b8-4e6c22fb5c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:13.456760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24498e7e-f628-4c6e-a9b8-4e6c22fb5c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:13.456760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24498e7e-f628-4c6e-a9b8-4e6c22fb5c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:13.456760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24498e7e-f628-4c6e-a9b8-4e6c22fb5c0e admin admin] PATH_INFO: `/v3/users/f53c54c0847349599b3cccbb4eeb2e93` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:13.457747 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24498e7e-f628-4c6e-a9b8-4e6c22fb5c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f53c54c0847349599b3cccbb4eeb2e93)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:13.458925 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24498e7e-f628-4c6e-a9b8-4e6c22fb5c0e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:13.654848 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-24498e7e-f628-4c6e-a9b8-4e6c22fb5c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f53c54c0847349599b3cccbb4eeb2e93'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:13.667789 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-24498e7e-f628-4c6e-a9b8-4e6c22fb5c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f53c54c0847349599b3cccbb4eeb2e93'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:13.731960 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-24498e7e-f628-4c6e-a9b8-4e6c22fb5c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f53c54c0847349599b3cccbb4eeb2e93'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:13.741777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-24498e7e-f628-4c6e-a9b8-4e6c22fb5c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f53c54c0847349599b3cccbb4eeb2e93'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:13.745277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-24498e7e-f628-4c6e-a9b8-4e6c22fb5c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f53c54c0847349599b3cccbb4eeb2e93'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:13.751790 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1133/2299] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:54:13 2022] DELETE /identity/v3/users/f53c54c0847349599b3cccbb4eeb2e93 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:54:13.990289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f399e-72fe-40fb-b2e9-f3268295df91 service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:14.002271 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f399e-72fe-40fb-b2e9-f3268295df91 service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:14.064925 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd3426-c20a-4a4f-92da-ebf62e4f4efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:14.065775 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd3426-c20a-4a4f-92da-ebf62e4f4efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:14.066052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd3426-c20a-4a4f-92da-ebf62e4f4efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:14.066318 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd3426-c20a-4a4f-92da-ebf62e4f4efb admin admin] PATH_INFO: `/v3/projects/a58f0a02b9604b74a0b7f7f5039ee809` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:14.067508 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd3426-c20a-4a4f-92da-ebf62e4f4efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58f0a02b9604b74a0b7f7f5039ee809)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:14.069755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd3426-c20a-4a4f-92da-ebf62e4f4efb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:14.167436 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6fbd3426-c20a-4a4f-92da-ebf62e4f4efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58f0a02b9604b74a0b7f7f5039ee809', 'request_id': 'req-6fbd3426-c20a-4a4f-92da-ebf62e4f4efb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:14.172792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6fbd3426-c20a-4a4f-92da-ebf62e4f4efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58f0a02b9604b74a0b7f7f5039ee809', 'request_id': 'req-6fbd3426-c20a-4a4f-92da-ebf62e4f4efb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:14.180064 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6fbd3426-c20a-4a4f-92da-ebf62e4f4efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58f0a02b9604b74a0b7f7f5039ee809', 'request_id': 'req-6fbd3426-c20a-4a4f-92da-ebf62e4f4efb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:14.228039 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24498e7e-f628-4c6e-a9b8-4e6c22fb5c0e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:14.229531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-24498e7e-f628-4c6e-a9b8-4e6c22fb5c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:14.254838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6fbd3426-c20a-4a4f-92da-ebf62e4f4efb admin admin] The token cache is being invalidate because project a58f0a02b9604b74a0b7f7f5039ee809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:54:14.258102 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6fbd3426-c20a-4a4f-92da-ebf62e4f4efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:14.258102 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6fbd3426-c20a-4a4f-92da-ebf62e4f4efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:14.258102 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1167/2300] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:54:13 2022] DELETE /identity/v3/projects/a58f0a02b9604b74a0b7f7f5039ee809 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:54:14.262376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c198ab3-a448-4390-a98e-ce614c944e0b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:14.262663 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c198ab3-a448-4390-a98e-ce614c944e0b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:14.262939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c198ab3-a448-4390-a98e-ce614c944e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:14.281626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7c198ab3-a448-4390-a98e-ce614c944e0b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:54:14.282968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7c198ab3-a448-4390-a98e-ce614c944e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:14.287099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24498e7e-f628-4c6e-a9b8-4e6c22fb5c0e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:14.333589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697caf64-9524-4f0e-9843-a8e9baec1ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:14.334725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697caf64-9524-4f0e-9843-a8e9baec1ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:14.335002 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697caf64-9524-4f0e-9843-a8e9baec1ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:14.335274 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697caf64-9524-4f0e-9843-a8e9baec1ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:14.337268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-697caf64-9524-4f0e-9843-a8e9baec1ed5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:14.342241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1168/2301] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:54:14.350687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0775afe-8dd1-4c37-ab64-fa306e709036 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:14.350985 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0775afe-8dd1-4c37-ab64-fa306e709036 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:14.351263 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0775afe-8dd1-4c37-ab64-fa306e709036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:14.368932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e0775afe-8dd1-4c37-ab64-fa306e709036 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:54:14.370130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e0775afe-8dd1-4c37-ab64-fa306e709036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:14.378216 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1169/2302] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:54:14.382100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0775afe-8dd1-4c37-ab64-fa306e709036 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:14.390782 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0775afe-8dd1-4c37-ab64-fa306e709036 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:14.395413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d359fe-6b8e-4943-86c5-657f6ce8625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:14.395976 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d359fe-6b8e-4943-86c5-657f6ce8625e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:14.396257 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d359fe-6b8e-4943-86c5-657f6ce8625e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:14.397085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d359fe-6b8e-4943-86c5-657f6ce8625e admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:14.397816 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d359fe-6b8e-4943-86c5-657f6ce8625e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:54:14.398122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d359fe-6b8e-4943-86c5-657f6ce8625e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:14.398822 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697caf64-9524-4f0e-9843-a8e9baec1ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:14.399724 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d359fe-6b8e-4943-86c5-657f6ce8625e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:14.400268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697caf64-9524-4f0e-9843-a8e9baec1ed5 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:14.410107 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1134/2303] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:54:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:54:14.411541 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1170/2304] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:54:14.416665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697caf64-9524-4f0e-9843-a8e9baec1ed5 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:14.426571 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697caf64-9524-4f0e-9843-a8e9baec1ed5 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:14.431589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d9a25-84cb-4a67-8fec-f409e540a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:14.432241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d9a25-84cb-4a67-8fec-f409e540a1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:14.432561 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d9a25-84cb-4a67-8fec-f409e540a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:14.432842 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d9a25-84cb-4a67-8fec-f409e540a1d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:14.433543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d9a25-84cb-4a67-8fec-f409e540a1d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:14.435430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d9a25-84cb-4a67-8fec-f409e540a1d7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:14.536203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1135/2305] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:54:14 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:54:14.541137 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d359fe-6b8e-4943-86c5-657f6ce8625e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:14.551171 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d359fe-6b8e-4943-86c5-657f6ce8625e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:14.611256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc547ce7-433f-4898-b3cc-05b0dcfd5dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:14.611932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc547ce7-433f-4898-b3cc-05b0dcfd5dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:14.612215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc547ce7-433f-4898-b3cc-05b0dcfd5dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:14.612530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc547ce7-433f-4898-b3cc-05b0dcfd5dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:14.613225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc547ce7-433f-4898-b3cc-05b0dcfd5dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:14.615151 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc547ce7-433f-4898-b3cc-05b0dcfd5dc2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:14.718231 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1171/2306] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:54:14 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:54:14.722389 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d9a25-84cb-4a67-8fec-f409e540a1d7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:14.735797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d9a25-84cb-4a67-8fec-f409e540a1d7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:14.741120 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690bf0d-b112-46d5-8d37-1879cca6c1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:14.741945 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690bf0d-b112-46d5-8d37-1879cca6c1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:14.742233 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690bf0d-b112-46d5-8d37-1879cca6c1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:14.742510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690bf0d-b112-46d5-8d37-1879cca6c1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:14.743274 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690bf0d-b112-46d5-8d37-1879cca6c1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:14.744901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690bf0d-b112-46d5-8d37-1879cca6c1b3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:14.756941 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1136/2307] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:54:14.761075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc547ce7-433f-4898-b3cc-05b0dcfd5dc2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:14.771077 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc547ce7-433f-4898-b3cc-05b0dcfd5dc2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:14.776504 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0158a6-6f07-4367-be53-f9edca250c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:14.777184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0158a6-6f07-4367-be53-f9edca250c56 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:14.777420 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0158a6-6f07-4367-be53-f9edca250c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:14.777694 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0158a6-6f07-4367-be53-f9edca250c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:14.778424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0158a6-6f07-4367-be53-f9edca250c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:14.780494 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0158a6-6f07-4367-be53-f9edca250c56 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:14.790462 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1172/2308] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:54:14.794812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690bf0d-b112-46d5-8d37-1879cca6c1b3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:14.804946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690bf0d-b112-46d5-8d37-1879cca6c1b3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:14.809554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49257c00-f028-4d26-9aaa-f341d3617c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:14.810449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49257c00-f028-4d26-9aaa-f341d3617c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:14.810728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49257c00-f028-4d26-9aaa-f341d3617c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:14.811003 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49257c00-f028-4d26-9aaa-f341d3617c04 admin admin] PATH_INFO: `/v3/projects/388a80fb643847e18baf23158d805f37/users/d56380ba7ee942e5a19d676e2d21141e/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:14.826339 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49257c00-f028-4d26-9aaa-f341d3617c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=388a80fb643847e18baf23158d805f37, user_id=d56380ba7ee942e5a19d676e2d21141e, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:14.829089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49257c00-f028-4d26-9aaa-f341d3617c04 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:14.912953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1137/2309] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:54:14 2022] PUT /identity/v3/projects/388a80fb643847e18baf23158d805f37/users/d56380ba7ee942e5a19d676e2d21141e/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:54:14.923632 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ec463-7600-4003-ab3b-f140a309a223 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:14.923957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ec463-7600-4003-ab3b-f140a309a223 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:14.924238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ec463-7600-4003-ab3b-f140a309a223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:14.950756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6f6ec463-7600-4003-ab3b-f140a309a223 None None] MFA Rules not processed for user `d56380ba7ee942e5a19d676e2d21141e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:54:14.951956 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6f6ec463-7600-4003-ab3b-f140a309a223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:15.016161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1173/2310] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:54:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:54:15.028292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49257c00-f028-4d26-9aaa-f341d3617c04 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:15.030016 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-49257c00-f028-4d26-9aaa-f341d3617c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:15.089133 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49257c00-f028-4d26-9aaa-f341d3617c04 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:15.093367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bceb03-5b78-419b-985c-820ad5e61395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:15.094021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bceb03-5b78-419b-985c-820ad5e61395 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:15.094304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bceb03-5b78-419b-985c-820ad5e61395 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:15.094579 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bceb03-5b78-419b-985c-820ad5e61395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:15.103502 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bceb03-5b78-419b-985c-820ad5e61395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:15.105037 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bceb03-5b78-419b-985c-820ad5e61395 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:15.114003 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1138/2311] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:54:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:54:18.227556 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ec463-7600-4003-ab3b-f140a309a223 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:18.289114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ec463-7600-4003-ab3b-f140a309a223 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:18.293688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421373b-5890-4581-ad3a-f0545599ac92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:18.294555 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421373b-5890-4581-ad3a-f0545599ac92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:18.294839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421373b-5890-4581-ad3a-f0545599ac92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:18.295113 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421373b-5890-4581-ad3a-f0545599ac92 admin admin] PATH_INFO: `/v3/users/d56380ba7ee942e5a19d676e2d21141e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:18.296299 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421373b-5890-4581-ad3a-f0545599ac92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d56380ba7ee942e5a19d676e2d21141e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:18.298252 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421373b-5890-4581-ad3a-f0545599ac92 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:18.487502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-0421373b-5890-4581-ad3a-f0545599ac92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd56380ba7ee942e5a19d676e2d21141e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:18.551977 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-0421373b-5890-4581-ad3a-f0545599ac92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd56380ba7ee942e5a19d676e2d21141e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:18.552651 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-0421373b-5890-4581-ad3a-f0545599ac92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd56380ba7ee942e5a19d676e2d21141e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:18.560305 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-0421373b-5890-4581-ad3a-f0545599ac92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd56380ba7ee942e5a19d676e2d21141e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:18.572537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-0421373b-5890-4581-ad3a-f0545599ac92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd56380ba7ee942e5a19d676e2d21141e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:18.578401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1174/2312] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:54:18 2022] DELETE /identity/v3/users/d56380ba7ee942e5a19d676e2d21141e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:54:18.582934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffac09-150e-452c-8be2-fa056521948e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:18.583417 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffac09-150e-452c-8be2-fa056521948e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:18.583524 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffac09-150e-452c-8be2-fa056521948e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:18.601314 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-24ffac09-150e-452c-8be2-fa056521948e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:54:18.602460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-24ffac09-150e-452c-8be2-fa056521948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:18.660236 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1139/2313] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:54:18.669891 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421373b-5890-4581-ad3a-f0545599ac92 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:18.671280 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0421373b-5890-4581-ad3a-f0545599ac92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:18.730511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421373b-5890-4581-ad3a-f0545599ac92 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:18.734150 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a439bd-4738-4b14-bf4a-9fb61132d0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:18.734788 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a439bd-4738-4b14-bf4a-9fb61132d0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:18.735061 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a439bd-4738-4b14-bf4a-9fb61132d0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:18.735329 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a439bd-4738-4b14-bf4a-9fb61132d0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:18.747835 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a439bd-4738-4b14-bf4a-9fb61132d0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:18.747835 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a439bd-4738-4b14-bf4a-9fb61132d0a7 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:18.755757 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1175/2314] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:54:19.190472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffac09-150e-452c-8be2-fa056521948e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:19.192146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-24ffac09-150e-452c-8be2-fa056521948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:19.205455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffac09-150e-452c-8be2-fa056521948e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:19.210614 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d59e5-1245-46e0-9206-1af5d6bfac43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:19.210979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d59e5-1245-46e0-9206-1af5d6bfac43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:19.211263 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d59e5-1245-46e0-9206-1af5d6bfac43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:19.211632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d59e5-1245-46e0-9206-1af5d6bfac43 admin admin] PATH_INFO: `/v3/projects/388a80fb643847e18baf23158d805f37` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:19.212870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d59e5-1245-46e0-9206-1af5d6bfac43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=388a80fb643847e18baf23158d805f37)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:19.214794 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d59e5-1245-46e0-9206-1af5d6bfac43 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:19.315770 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5c4d59e5-1245-46e0-9206-1af5d6bfac43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '388a80fb643847e18baf23158d805f37', 'request_id': 'req-5c4d59e5-1245-46e0-9206-1af5d6bfac43'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:19.321370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5c4d59e5-1245-46e0-9206-1af5d6bfac43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '388a80fb643847e18baf23158d805f37', 'request_id': 'req-5c4d59e5-1245-46e0-9206-1af5d6bfac43'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:19.403270 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5c4d59e5-1245-46e0-9206-1af5d6bfac43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '388a80fb643847e18baf23158d805f37', 'request_id': 'req-5c4d59e5-1245-46e0-9206-1af5d6bfac43'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:19.415309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5c4d59e5-1245-46e0-9206-1af5d6bfac43 admin admin] The token cache is being invalidate because project 388a80fb643847e18baf23158d805f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:54:19.415599 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5c4d59e5-1245-46e0-9206-1af5d6bfac43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:19.416247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5c4d59e5-1245-46e0-9206-1af5d6bfac43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:19.417838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1140/2315] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:54:19 2022] DELETE /identity/v3/projects/388a80fb643847e18baf23158d805f37 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:54:19.422711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226a798-1501-4dc9-bc78-81ad6a979eba None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:19.423183 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226a798-1501-4dc9-bc78-81ad6a979eba None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:19.423535 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226a798-1501-4dc9-bc78-81ad6a979eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:19.442251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b226a798-1501-4dc9-bc78-81ad6a979eba None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:54:19.443601 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b226a798-1501-4dc9-bc78-81ad6a979eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:19.502338 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1176/2316] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:54:19.510489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6037f-d89a-4cc3-a1cd-846643deccd6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:19.510892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6037f-d89a-4cc3-a1cd-846643deccd6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:19.511172 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6037f-d89a-4cc3-a1cd-846643deccd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:19.530008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-85f6037f-d89a-4cc3-a1cd-846643deccd6 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:54:19.531290 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-85f6037f-d89a-4cc3-a1cd-846643deccd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:19.540192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1141/2317] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:54:19.544342 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226a798-1501-4dc9-bc78-81ad6a979eba None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:19.554417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226a798-1501-4dc9-bc78-81ad6a979eba None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:19.563043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d49ad6-45e2-4293-a8ac-9578da294792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:19.563633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d49ad6-45e2-4293-a8ac-9578da294792 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:19.563914 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d49ad6-45e2-4293-a8ac-9578da294792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:19.564187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d49ad6-45e2-4293-a8ac-9578da294792 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:19.564955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d49ad6-45e2-4293-a8ac-9578da294792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:54:19.565261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d49ad6-45e2-4293-a8ac-9578da294792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:19.566905 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d49ad6-45e2-4293-a8ac-9578da294792 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:19.579522 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1177/2318] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:54:19.584132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6037f-d89a-4cc3-a1cd-846643deccd6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:19.593916 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6037f-d89a-4cc3-a1cd-846643deccd6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:19.598692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0c1a0-abb0-43ce-8ef1-14a2a87ddbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:19.599330 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0c1a0-abb0-43ce-8ef1-14a2a87ddbaa admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:19.599606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0c1a0-abb0-43ce-8ef1-14a2a87ddbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:19.599874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0c1a0-abb0-43ce-8ef1-14a2a87ddbaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:19.600622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0c1a0-abb0-43ce-8ef1-14a2a87ddbaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:19.603193 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0c1a0-abb0-43ce-8ef1-14a2a87ddbaa admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:19.685375 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1142/2319] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:54:19 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:54:19.689496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d49ad6-45e2-4293-a8ac-9578da294792 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:19.699941 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d49ad6-45e2-4293-a8ac-9578da294792 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:19.755417 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365f9ec-85a1-437b-8f16-0f1ab71c0c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:19.756081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365f9ec-85a1-437b-8f16-0f1ab71c0c74 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:19.756359 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365f9ec-85a1-437b-8f16-0f1ab71c0c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:19.756668 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365f9ec-85a1-437b-8f16-0f1ab71c0c74 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:19.757386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365f9ec-85a1-437b-8f16-0f1ab71c0c74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:19.759349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365f9ec-85a1-437b-8f16-0f1ab71c0c74 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:19.843887 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1178/2320] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:54:19 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:54:19.848136 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0c1a0-abb0-43ce-8ef1-14a2a87ddbaa admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:19.858349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0c1a0-abb0-43ce-8ef1-14a2a87ddbaa admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:19.862930 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f8fbb-1761-4808-8d4f-48721c5c3a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:19.863633 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f8fbb-1761-4808-8d4f-48721c5c3a76 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:19.863911 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f8fbb-1761-4808-8d4f-48721c5c3a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:19.864184 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f8fbb-1761-4808-8d4f-48721c5c3a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:19.864954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f8fbb-1761-4808-8d4f-48721c5c3a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:19.866532 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f8fbb-1761-4808-8d4f-48721c5c3a76 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:19.876973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1143/2321] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:54:19.880957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365f9ec-85a1-437b-8f16-0f1ab71c0c74 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:19.892071 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365f9ec-85a1-437b-8f16-0f1ab71c0c74 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:19.896719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7adf6-9c82-4364-9b5e-28a651f366c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:19.897368 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7adf6-9c82-4364-9b5e-28a651f366c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:19.897650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7adf6-9c82-4364-9b5e-28a651f366c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:19.897922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7adf6-9c82-4364-9b5e-28a651f366c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:19.899338 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7adf6-9c82-4364-9b5e-28a651f366c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:19.900964 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7adf6-9c82-4364-9b5e-28a651f366c8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:19.910779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1179/2322] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:54:19.914834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f8fbb-1761-4808-8d4f-48721c5c3a76 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:19.924405 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f8fbb-1761-4808-8d4f-48721c5c3a76 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:19.929384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063d5da-f87c-4e93-b821-18bd61905953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:19.930293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063d5da-f87c-4e93-b821-18bd61905953 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:19.930576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063d5da-f87c-4e93-b821-18bd61905953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:19.930848 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063d5da-f87c-4e93-b821-18bd61905953 admin admin] PATH_INFO: `/v3/projects/d6495d2675f5479195477f28e7d5f5bb/users/5ac892fba559467491543bccf09f0f75/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:19.944741 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063d5da-f87c-4e93-b821-18bd61905953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6495d2675f5479195477f28e7d5f5bb, user_id=5ac892fba559467491543bccf09f0f75, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:19.947885 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063d5da-f87c-4e93-b821-18bd61905953 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:20.000979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1144/2323] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:54:19 2022] PUT /identity/v3/projects/d6495d2675f5479195477f28e7d5f5bb/users/5ac892fba559467491543bccf09f0f75/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:54:20.065159 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80464c18-8f1e-4e9d-8273-4b1abe1e697f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:20.065443 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80464c18-8f1e-4e9d-8273-4b1abe1e697f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:20.065721 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80464c18-8f1e-4e9d-8273-4b1abe1e697f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:20.092506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-80464c18-8f1e-4e9d-8273-4b1abe1e697f None None] MFA Rules not processed for user `5ac892fba559467491543bccf09f0f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:54:20.093700 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-80464c18-8f1e-4e9d-8273-4b1abe1e697f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:20.155724 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1180/2324] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:54:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:54:20.166389 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063d5da-f87c-4e93-b821-18bd61905953 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:20.168113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6063d5da-f87c-4e93-b821-18bd61905953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:20.234356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063d5da-f87c-4e93-b821-18bd61905953 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:20.239170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b0e3e-23be-4b21-9215-b7ffd89b745e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:20.240108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b0e3e-23be-4b21-9215-b7ffd89b745e service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:20.240574 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b0e3e-23be-4b21-9215-b7ffd89b745e service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:20.240981 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b0e3e-23be-4b21-9215-b7ffd89b745e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:20.250648 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b0e3e-23be-4b21-9215-b7ffd89b745e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:20.252088 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b0e3e-23be-4b21-9215-b7ffd89b745e service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:20.261759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1145/2325] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:54:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:54:31.150343 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e5ee4-f938-4212-a050-88708206444a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:31.150878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e5ee4-f938-4212-a050-88708206444a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:31.150878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e5ee4-f938-4212-a050-88708206444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:31.168253 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-027e5ee4-f938-4212-a050-88708206444a None None] MFA Rules not processed for user `4f49f50b0a7841c4a117cc5e2e1dccb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:54:31.169486 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-027e5ee4-f938-4212-a050-88708206444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:31.223942 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1181/2326] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:54:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:54:41.056333 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b0e3e-23be-4b21-9215-b7ffd89b745e service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:41.131255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b0e3e-23be-4b21-9215-b7ffd89b745e service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:41.137149 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90b6ff-0263-4443-9933-44a4c15d9160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:41.138052 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90b6ff-0263-4443-9933-44a4c15d9160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:41.138341 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90b6ff-0263-4443-9933-44a4c15d9160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:41.138620 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90b6ff-0263-4443-9933-44a4c15d9160 admin admin] PATH_INFO: `/v3/users/5ac892fba559467491543bccf09f0f75` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:41.139921 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90b6ff-0263-4443-9933-44a4c15d9160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac892fba559467491543bccf09f0f75)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:41.141918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90b6ff-0263-4443-9933-44a4c15d9160 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:41.340801 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4d90b6ff-0263-4443-9933-44a4c15d9160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac892fba559467491543bccf09f0f75'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:41.353675 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4d90b6ff-0263-4443-9933-44a4c15d9160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac892fba559467491543bccf09f0f75'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:41.413580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4d90b6ff-0263-4443-9933-44a4c15d9160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac892fba559467491543bccf09f0f75'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:41.422699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4d90b6ff-0263-4443-9933-44a4c15d9160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac892fba559467491543bccf09f0f75'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:41.423511 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4d90b6ff-0263-4443-9933-44a4c15d9160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac892fba559467491543bccf09f0f75'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:41.430953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1146/2327] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:54:41 2022] DELETE /identity/v3/users/5ac892fba559467491543bccf09f0f75 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:54:41.435593 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec03dd-bddb-4c20-b78a-1af5e0487d4a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:41.436489 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec03dd-bddb-4c20-b78a-1af5e0487d4a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:41.436961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec03dd-bddb-4c20-b78a-1af5e0487d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:41.457092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d4ec03dd-bddb-4c20-b78a-1af5e0487d4a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:54:41.458529 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d4ec03dd-bddb-4c20-b78a-1af5e0487d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:41.551979 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1182/2328] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:54:41.553627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90b6ff-0263-4443-9933-44a4c15d9160 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:41.555469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4d90b6ff-0263-4443-9933-44a4c15d9160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:41.624553 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90b6ff-0263-4443-9933-44a4c15d9160 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:41.629170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89c34c-8d76-4f37-b9d6-e77e749a07cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:41.629851 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89c34c-8d76-4f37-b9d6-e77e749a07cf service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:41.630137 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89c34c-8d76-4f37-b9d6-e77e749a07cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:41.630413 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89c34c-8d76-4f37-b9d6-e77e749a07cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:41.642799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89c34c-8d76-4f37-b9d6-e77e749a07cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:41.644255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89c34c-8d76-4f37-b9d6-e77e749a07cf service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:41.656299 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1147/2329] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:54:42.217863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec03dd-bddb-4c20-b78a-1af5e0487d4a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:42.220171 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d4ec03dd-bddb-4c20-b78a-1af5e0487d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:42.247824 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec03dd-bddb-4c20-b78a-1af5e0487d4a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:42.261921 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:42.262835 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:42.263291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:42.263556 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91 admin admin] PATH_INFO: `/v3/projects/d6495d2675f5479195477f28e7d5f5bb` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:42.264961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6495d2675f5479195477f28e7d5f5bb)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:42.267055 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:42.410743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6495d2675f5479195477f28e7d5f5bb', 'request_id': 'req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:42.417355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6495d2675f5479195477f28e7d5f5bb', 'request_id': 'req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:42.424275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6495d2675f5479195477f28e7d5f5bb', 'request_id': 'req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:42.504570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91 admin admin] The token cache is being invalidate because project d6495d2675f5479195477f28e7d5f5bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:54:42.505174 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:42.505506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:54:42.507281 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1183/2330] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:54:42 2022] DELETE /identity/v3/projects/d6495d2675f5479195477f28e7d5f5bb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:54:44.877751 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335d819-6ea6-4efa-8e03-72d5bc530c07 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:44.878366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335d819-6ea6-4efa-8e03-72d5bc530c07 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:44.878366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335d819-6ea6-4efa-8e03-72d5bc530c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:44.897025 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c335d819-6ea6-4efa-8e03-72d5bc530c07 None None] MFA Rules not processed for user `0bf039be83b54817ac2f340cf9dfad63`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:54:44.898883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c335d819-6ea6-4efa-8e03-72d5bc530c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:44.953880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1148/2331] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:54:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:54:56.060761 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:56.062307 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:56.118254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3fb8e-4fc2-4142-9963-98fdac8d4e91 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:56.121926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1226dc-0b7b-4dbd-b83e-18742cb7f9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:56.122561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1226dc-0b7b-4dbd-b83e-18742cb7f9cb service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:56.122836 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1226dc-0b7b-4dbd-b83e-18742cb7f9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:56.123106 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1226dc-0b7b-4dbd-b83e-18742cb7f9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:56.124878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8f1226dc-0b7b-4dbd-b83e-18742cb7f9cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:56.193875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1226dc-0b7b-4dbd-b83e-18742cb7f9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:56.195314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1226dc-0b7b-4dbd-b83e-18742cb7f9cb service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:56.206088 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1184/2332] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:54:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:54:58.493448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335d819-6ea6-4efa-8e03-72d5bc530c07 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:54:58.495006 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c335d819-6ea6-4efa-8e03-72d5bc530c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:58.507448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335d819-6ea6-4efa-8e03-72d5bc530c07 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:54:58.512394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63fdf0-4d84-4f19-9de4-714936901913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:54:58.513237 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63fdf0-4d84-4f19-9de4-714936901913 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:54:58.513477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63fdf0-4d84-4f19-9de4-714936901913 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:54:58.513820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63fdf0-4d84-4f19-9de4-714936901913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:54:58.515704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8a63fdf0-4d84-4f19-9de4-714936901913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:54:58.530940 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63fdf0-4d84-4f19-9de4-714936901913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:54:58.532740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63fdf0-4d84-4f19-9de4-714936901913 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:54:58.545790 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1149/2333] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:54:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:55:12.618476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ecfd2-df69-4722-822b-a60c5f73a337 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:12.618971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ecfd2-df69-4722-822b-a60c5f73a337 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:12.619074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ecfd2-df69-4722-822b-a60c5f73a337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:12.636092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-453ecfd2-df69-4722-822b-a60c5f73a337 None None] MFA Rules not processed for user `546c3447688f473fb256f4bc3dd99188`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:12.637327 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-453ecfd2-df69-4722-822b-a60c5f73a337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:12.692172 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1185/2334] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:55:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:55:13.426067 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63fdf0-4d84-4f19-9de4-714936901913 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:13.427468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8a63fdf0-4d84-4f19-9de4-714936901913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:13.494849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63fdf0-4d84-4f19-9de4-714936901913 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:13.500580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b11ed-ef6c-46ec-9966-7e41506769e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ff8c001247c43ccbc4ccb26daa17201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:13.501254 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b11ed-ef6c-46ec-9966-7e41506769e8 service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:13.501545 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b11ed-ef6c-46ec-9966-7e41506769e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:13.501823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b11ed-ef6c-46ec-9966-7e41506769e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:13.503606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-828b11ed-ef6c-46ec-9966-7e41506769e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:13.514634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b11ed-ef6c-46ec-9966-7e41506769e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:13.516607 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b11ed-ef6c-46ec-9966-7e41506769e8 service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:13.526324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1150/2335] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:55:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:55:16.536727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ecfd2-df69-4722-822b-a60c5f73a337 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:16.544623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ecfd2-df69-4722-822b-a60c5f73a337 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:16.549572 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe8972-2837-47af-9def-a698af1a88c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:16.550209 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe8972-2837-47af-9def-a698af1a88c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:16.550490 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe8972-2837-47af-9def-a698af1a88c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:16.550769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe8972-2837-47af-9def-a698af1a88c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:16.552595 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5cfe8972-2837-47af-9def-a698af1a88c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:16.562623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe8972-2837-47af-9def-a698af1a88c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:16.565695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe8972-2837-47af-9def-a698af1a88c8 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:16.572630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1186/2336] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:55:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:55:22.549480 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b11ed-ef6c-46ec-9966-7e41506769e8 service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:22.550904 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-828b11ed-ef6c-46ec-9966-7e41506769e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:22.606448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b11ed-ef6c-46ec-9966-7e41506769e8 service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:22.610919 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f7233-95d5-4fff-8f6f-d86509294898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:22.611572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f7233-95d5-4fff-8f6f-d86509294898 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:22.611854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f7233-95d5-4fff-8f6f-d86509294898 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:22.612127 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f7233-95d5-4fff-8f6f-d86509294898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:22.614160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d41f7233-95d5-4fff-8f6f-d86509294898 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:22.681383 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f7233-95d5-4fff-8f6f-d86509294898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:22.681383 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f7233-95d5-4fff-8f6f-d86509294898 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:22.692633 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1151/2337] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:55:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:55:27.784174 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe8972-2837-47af-9def-a698af1a88c8 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:27.785697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5cfe8972-2837-47af-9def-a698af1a88c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:27.802612 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe8972-2837-47af-9def-a698af1a88c8 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:27.808060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02fa86-27bb-40bf-b77d-07284684a51b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:27.808834 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02fa86-27bb-40bf-b77d-07284684a51b service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:27.809726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02fa86-27bb-40bf-b77d-07284684a51b service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:27.810035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02fa86-27bb-40bf-b77d-07284684a51b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:27.811990 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8d02fa86-27bb-40bf-b77d-07284684a51b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:27.824545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02fa86-27bb-40bf-b77d-07284684a51b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:27.826150 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02fa86-27bb-40bf-b77d-07284684a51b service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:27.836798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1187/2338] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:55:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:55:35.684266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f7233-95d5-4fff-8f6f-d86509294898 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:35.685721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d41f7233-95d5-4fff-8f6f-d86509294898 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:35.697001 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f7233-95d5-4fff-8f6f-d86509294898 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:35.701547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafc6ef-2f2e-4a41-9196-b30d07b82a82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:35.702190 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafc6ef-2f2e-4a41-9196-b30d07b82a82 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:35.702469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafc6ef-2f2e-4a41-9196-b30d07b82a82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:35.702741 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafc6ef-2f2e-4a41-9196-b30d07b82a82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:35.704691 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2eafc6ef-2f2e-4a41-9196-b30d07b82a82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:35.763303 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafc6ef-2f2e-4a41-9196-b30d07b82a82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:35.764778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafc6ef-2f2e-4a41-9196-b30d07b82a82 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:35.773797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1152/2339] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:55:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:55:41.949306 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02fa86-27bb-40bf-b77d-07284684a51b service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:41.973255 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02fa86-27bb-40bf-b77d-07284684a51b service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:41.988127 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ee07e-f2ec-426e-a14c-ab65a9be5b70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:41.989116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ee07e-f2ec-426e-a14c-ab65a9be5b70 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:41.989653 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ee07e-f2ec-426e-a14c-ab65a9be5b70 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:41.990242 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ee07e-f2ec-426e-a14c-ab65a9be5b70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:41.992583 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-db4ee07e-f2ec-426e-a14c-ab65a9be5b70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:42.007581 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ee07e-f2ec-426e-a14c-ab65a9be5b70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:42.010482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ee07e-f2ec-426e-a14c-ab65a9be5b70 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:42.023110 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1188/2340] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:55:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:55:46.932869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c0b20-dbfa-43d0-b340-22a325362821 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:46.933428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c0b20-dbfa-43d0-b340-22a325362821 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:46.933428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c0b20-dbfa-43d0-b340-22a325362821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:46.952044 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9b1c0b20-dbfa-43d0-b340-22a325362821 None None] MFA Rules not processed for user `3b220b08ef304644b329bcd31f0247f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:46.953431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9b1c0b20-dbfa-43d0-b340-22a325362821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:46.960505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1153/2341] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:55:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:55:47.420042 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ee07e-f2ec-426e-a14c-ab65a9be5b70 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:47.430733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ee07e-f2ec-426e-a14c-ab65a9be5b70 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:47.434570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1d932-0738-431c-b6af-a3504f7f14b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:47.435204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1d932-0738-431c-b6af-a3504f7f14b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:47.443492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1d932-0738-431c-b6af-a3504f7f14b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:47.443784 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1d932-0738-431c-b6af-a3504f7f14b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:47.445836 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5dd1d932-0738-431c-b6af-a3504f7f14b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:47.456233 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1d932-0738-431c-b6af-a3504f7f14b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:47.458005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1d932-0738-431c-b6af-a3504f7f14b4 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:47.465754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1189/2342] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:55:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:55:47.824634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c0b20-dbfa-43d0-b340-22a325362821 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:47.826087 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9b1c0b20-dbfa-43d0-b340-22a325362821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:47.842299 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c0b20-dbfa-43d0-b340-22a325362821 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:47.848072 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf9753-fc38-4fea-90ba-5c88809f41bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:47.848749 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf9753-fc38-4fea-90ba-5c88809f41bd service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:47.849199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf9753-fc38-4fea-90ba-5c88809f41bd service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:47.849658 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf9753-fc38-4fea-90ba-5c88809f41bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:47.852528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d8bf9753-fc38-4fea-90ba-5c88809f41bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:47.864174 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf9753-fc38-4fea-90ba-5c88809f41bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:47.865859 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf9753-fc38-4fea-90ba-5c88809f41bd service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:47.877266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1154/2343] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:55:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:55:49.918649 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1d932-0738-431c-b6af-a3504f7f14b4 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:49.927302 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1d932-0738-431c-b6af-a3504f7f14b4 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:49.931402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442484ad-ee17-4f08-9469-55997e2ccb8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:49.932051 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442484ad-ee17-4f08-9469-55997e2ccb8f service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:49.932327 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442484ad-ee17-4f08-9469-55997e2ccb8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:49.932638 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442484ad-ee17-4f08-9469-55997e2ccb8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:49.934371 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-442484ad-ee17-4f08-9469-55997e2ccb8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:49.997297 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442484ad-ee17-4f08-9469-55997e2ccb8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:49.998782 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442484ad-ee17-4f08-9469-55997e2ccb8f service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:50.008571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1190/2344] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:55:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:55:54.945828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf9753-fc38-4fea-90ba-5c88809f41bd service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:54.947288 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d8bf9753-fc38-4fea-90ba-5c88809f41bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:54.968292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf9753-fc38-4fea-90ba-5c88809f41bd service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:54.968292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb81320-d57f-4d1b-9172-24d5887f68a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:54.968292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb81320-d57f-4d1b-9172-24d5887f68a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:54.968292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb81320-d57f-4d1b-9172-24d5887f68a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:54.968704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb81320-d57f-4d1b-9172-24d5887f68a9 admin admin] PATH_INFO: `/v3/users/4f49f50b0a7841c4a117cc5e2e1dccb1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:54.968704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb81320-d57f-4d1b-9172-24d5887f68a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f49f50b0a7841c4a117cc5e2e1dccb1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:54.969453 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb81320-d57f-4d1b-9172-24d5887f68a9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:55.212426 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2bb81320-d57f-4d1b-9172-24d5887f68a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f49f50b0a7841c4a117cc5e2e1dccb1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:55.235561 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2bb81320-d57f-4d1b-9172-24d5887f68a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f49f50b0a7841c4a117cc5e2e1dccb1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:55.310755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2bb81320-d57f-4d1b-9172-24d5887f68a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f49f50b0a7841c4a117cc5e2e1dccb1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:55.317862 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2bb81320-d57f-4d1b-9172-24d5887f68a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f49f50b0a7841c4a117cc5e2e1dccb1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:55.318521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2bb81320-d57f-4d1b-9172-24d5887f68a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f49f50b0a7841c4a117cc5e2e1dccb1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:55.326178 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1155/2345] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:55:54 2022] DELETE /identity/v3/users/4f49f50b0a7841c4a117cc5e2e1dccb1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:55:55.559259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442484ad-ee17-4f08-9469-55997e2ccb8f service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:55.574734 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442484ad-ee17-4f08-9469-55997e2ccb8f service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:55.646405 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c2b2d-b056-4837-adea-5c324f9aad79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:55.647272 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c2b2d-b056-4837-adea-5c324f9aad79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.647548 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c2b2d-b056-4837-adea-5c324f9aad79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.647963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c2b2d-b056-4837-adea-5c324f9aad79 admin admin] PATH_INFO: `/v3/projects/0a80a63e96c840f1a780b0b263f68aa9` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.649226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c2b2d-b056-4837-adea-5c324f9aad79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a80a63e96c840f1a780b0b263f68aa9)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:55.651221 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c2b2d-b056-4837-adea-5c324f9aad79 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:55.756076 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4e5c2b2d-b056-4837-adea-5c324f9aad79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a80a63e96c840f1a780b0b263f68aa9', 'request_id': 'req-4e5c2b2d-b056-4837-adea-5c324f9aad79'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:55.764135 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4e5c2b2d-b056-4837-adea-5c324f9aad79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a80a63e96c840f1a780b0b263f68aa9', 'request_id': 'req-4e5c2b2d-b056-4837-adea-5c324f9aad79'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:55.770673 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4e5c2b2d-b056-4837-adea-5c324f9aad79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a80a63e96c840f1a780b0b263f68aa9', 'request_id': 'req-4e5c2b2d-b056-4837-adea-5c324f9aad79'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:55.841825 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4e5c2b2d-b056-4837-adea-5c324f9aad79 admin admin] The token cache is being invalidate because project 0a80a63e96c840f1a780b0b263f68aa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:55:55.842113 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4e5c2b2d-b056-4837-adea-5c324f9aad79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:55.842763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4e5c2b2d-b056-4837-adea-5c324f9aad79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:55.844320 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1191/2346] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:55:55 2022] DELETE /identity/v3/projects/0a80a63e96c840f1a780b0b263f68aa9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:55:55.849342 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85ac67-855d-4dc3-9b6f-d78f0c6d0851 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.853498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85ac67-855d-4dc3-9b6f-d78f0c6d0851 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.853498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85ac67-855d-4dc3-9b6f-d78f0c6d0851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.868533 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3c85ac67-855d-4dc3-9b6f-d78f0c6d0851 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:55.869744 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3c85ac67-855d-4dc3-9b6f-d78f0c6d0851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:55.927362 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1156/2347] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:55:55.935398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dbf64-233b-441c-8277-4f4c4e0d3b3b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.935687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dbf64-233b-441c-8277-4f4c4e0d3b3b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.935994 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dbf64-233b-441c-8277-4f4c4e0d3b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.955651 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-036dbf64-233b-441c-8277-4f4c4e0d3b3b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:55.957008 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-036dbf64-233b-441c-8277-4f4c4e0d3b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:55.966145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1192/2348] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:55:55.976605 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85ac67-855d-4dc3-9b6f-d78f0c6d0851 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:55.986414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85ac67-855d-4dc3-9b6f-d78f0c6d0851 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:55.991340 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd2758-2288-4aec-9bd3-a1431e67bdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:55.991994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd2758-2288-4aec-9bd3-a1431e67bdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:55.992280 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd2758-2288-4aec-9bd3-a1431e67bdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:55.992596 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd2758-2288-4aec-9bd3-a1431e67bdc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:55.993314 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd2758-2288-4aec-9bd3-a1431e67bdc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:55.993619 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd2758-2288-4aec-9bd3-a1431e67bdc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:55.995200 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd2758-2288-4aec-9bd3-a1431e67bdc2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.006804 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1157/2349] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:55:56.011105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dbf64-233b-441c-8277-4f4c4e0d3b3b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.020113 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dbf64-233b-441c-8277-4f4c4e0d3b3b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.025287 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c30be-3d09-45ee-86e6-d3ea8036dec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.025918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c30be-3d09-45ee-86e6-d3ea8036dec4 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.026193 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c30be-3d09-45ee-86e6-d3ea8036dec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.026466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c30be-3d09-45ee-86e6-d3ea8036dec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.027150 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c30be-3d09-45ee-86e6-d3ea8036dec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:56.029070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c30be-3d09-45ee-86e6-d3ea8036dec4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.106023 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1193/2350] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:55:56 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:55:56.110156 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd2758-2288-4aec-9bd3-a1431e67bdc2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.121163 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd2758-2288-4aec-9bd3-a1431e67bdc2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.178486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40833f3-f98a-45fb-b954-d06e1f1b995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.179270 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40833f3-f98a-45fb-b954-d06e1f1b995e admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.179561 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40833f3-f98a-45fb-b954-d06e1f1b995e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.179836 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40833f3-f98a-45fb-b954-d06e1f1b995e admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.180606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40833f3-f98a-45fb-b954-d06e1f1b995e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:56.182595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40833f3-f98a-45fb-b954-d06e1f1b995e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.311889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1158/2351] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:55:56 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:55:56.316048 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c30be-3d09-45ee-86e6-d3ea8036dec4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.328857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c30be-3d09-45ee-86e6-d3ea8036dec4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.333726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfde9b-1f3e-4f5c-bfc4-046e7c7d1758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.334881 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfde9b-1f3e-4f5c-bfc4-046e7c7d1758 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.335157 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfde9b-1f3e-4f5c-bfc4-046e7c7d1758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.335426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfde9b-1f3e-4f5c-bfc4-046e7c7d1758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.336152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfde9b-1f3e-4f5c-bfc4-046e7c7d1758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:56.338280 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfde9b-1f3e-4f5c-bfc4-046e7c7d1758 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.348577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1194/2352] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:55:56.353117 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40833f3-f98a-45fb-b954-d06e1f1b995e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.362958 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40833f3-f98a-45fb-b954-d06e1f1b995e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.368405 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cba232-a8fc-42b0-884e-8b27f2964c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.369082 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cba232-a8fc-42b0-884e-8b27f2964c4b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.369366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cba232-a8fc-42b0-884e-8b27f2964c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.369640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cba232-a8fc-42b0-884e-8b27f2964c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.370366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cba232-a8fc-42b0-884e-8b27f2964c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:56.371946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cba232-a8fc-42b0-884e-8b27f2964c4b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.381640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1159/2353] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:55:56.385604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfde9b-1f3e-4f5c-bfc4-046e7c7d1758 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.395304 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfde9b-1f3e-4f5c-bfc4-046e7c7d1758 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.399971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94533eea-b701-41ef-8914-9269131dd615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.400872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94533eea-b701-41ef-8914-9269131dd615 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.401159 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94533eea-b701-41ef-8914-9269131dd615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.401424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94533eea-b701-41ef-8914-9269131dd615 admin admin] PATH_INFO: `/v3/projects/a57fde17bcb049999bd3f49ab1a30f6d/users/1db75ca98150449183e02261b8badcd5/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.417656 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94533eea-b701-41ef-8914-9269131dd615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a57fde17bcb049999bd3f49ab1a30f6d, user_id=1db75ca98150449183e02261b8badcd5, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:56.420292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94533eea-b701-41ef-8914-9269131dd615 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.514026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1195/2354] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:55:56 2022] PUT /identity/v3/projects/a57fde17bcb049999bd3f49ab1a30f6d/users/1db75ca98150449183e02261b8badcd5/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:55:56.524411 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71466826-4696-4d8a-878e-01444139611d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.524737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71466826-4696-4d8a-878e-01444139611d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.525024 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71466826-4696-4d8a-878e-01444139611d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.551804 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-71466826-4696-4d8a-878e-01444139611d None None] MFA Rules not processed for user `1db75ca98150449183e02261b8badcd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:56.553809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-71466826-4696-4d8a-878e-01444139611d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:56.636714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1160/2355] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:55:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:55:56.652671 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94533eea-b701-41ef-8914-9269131dd615 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:56.654491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-94533eea-b701-41ef-8914-9269131dd615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:56.730833 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94533eea-b701-41ef-8914-9269131dd615 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:56.736555 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ab8cc-df48-4b9b-b4cb-fcf0f665166b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:56.737206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ab8cc-df48-4b9b-b4cb-fcf0f665166b service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:56.737488 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ab8cc-df48-4b9b-b4cb-fcf0f665166b service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:56.737763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ab8cc-df48-4b9b-b4cb-fcf0f665166b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:56.746747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ab8cc-df48-4b9b-b4cb-fcf0f665166b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:56.748506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ab8cc-df48-4b9b-b4cb-fcf0f665166b service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:56.758043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1196/2356] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:55:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:55:56.940965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71466826-4696-4d8a-878e-01444139611d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:57.019603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71466826-4696-4d8a-878e-01444139611d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:57.024992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f133a-9fd3-4028-90a7-726f15b7d529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:57.025853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f133a-9fd3-4028-90a7-726f15b7d529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:57.026130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f133a-9fd3-4028-90a7-726f15b7d529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:57.026399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f133a-9fd3-4028-90a7-726f15b7d529 admin admin] PATH_INFO: `/v3/users/1db75ca98150449183e02261b8badcd5` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:57.027582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f133a-9fd3-4028-90a7-726f15b7d529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db75ca98150449183e02261b8badcd5)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:57.029528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f133a-9fd3-4028-90a7-726f15b7d529 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:57.216535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-979f133a-9fd3-4028-90a7-726f15b7d529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db75ca98150449183e02261b8badcd5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:57.228005 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-979f133a-9fd3-4028-90a7-726f15b7d529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db75ca98150449183e02261b8badcd5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:57.327677 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-979f133a-9fd3-4028-90a7-726f15b7d529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db75ca98150449183e02261b8badcd5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:57.336003 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-979f133a-9fd3-4028-90a7-726f15b7d529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db75ca98150449183e02261b8badcd5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:57.336869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-979f133a-9fd3-4028-90a7-726f15b7d529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db75ca98150449183e02261b8badcd5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:57.343271 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1161/2357] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:55:56 2022] DELETE /identity/v3/users/1db75ca98150449183e02261b8badcd5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:55:57.347723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f235d-cedd-46c5-b01d-7f8b1035a7fc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:57.348013 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f235d-cedd-46c5-b01d-7f8b1035a7fc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:57.348293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f235d-cedd-46c5-b01d-7f8b1035a7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:57.366331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7e4f235d-cedd-46c5-b01d-7f8b1035a7fc None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:57.368089 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7e4f235d-cedd-46c5-b01d-7f8b1035a7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:57.430145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1197/2358] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:55:57.440862 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f133a-9fd3-4028-90a7-726f15b7d529 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:57.442405 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-979f133a-9fd3-4028-90a7-726f15b7d529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:57.500771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f133a-9fd3-4028-90a7-726f15b7d529 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:57.504487 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fb4c4-de62-4b8c-8a5a-3c427051205d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:57.505126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fb4c4-de62-4b8c-8a5a-3c427051205d service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:57.505406 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fb4c4-de62-4b8c-8a5a-3c427051205d service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:57.506345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fb4c4-de62-4b8c-8a5a-3c427051205d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:57.515387 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fb4c4-de62-4b8c-8a5a-3c427051205d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:57.516850 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fb4c4-de62-4b8c-8a5a-3c427051205d service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:57.526225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1162/2359] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:55:57.938496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f235d-cedd-46c5-b01d-7f8b1035a7fc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:57.939914 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7e4f235d-cedd-46c5-b01d-7f8b1035a7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:57.954683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f235d-cedd-46c5-b01d-7f8b1035a7fc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:57.959468 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276ab38-a96b-4723-b903-cf8267ece3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:57.960330 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276ab38-a96b-4723-b903-cf8267ece3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:57.960648 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276ab38-a96b-4723-b903-cf8267ece3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:57.960926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276ab38-a96b-4723-b903-cf8267ece3ba admin admin] PATH_INFO: `/v3/projects/a57fde17bcb049999bd3f49ab1a30f6d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:57.962121 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276ab38-a96b-4723-b903-cf8267ece3ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a57fde17bcb049999bd3f49ab1a30f6d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:57.964258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276ab38-a96b-4723-b903-cf8267ece3ba admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:58.141544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8276ab38-a96b-4723-b903-cf8267ece3ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a57fde17bcb049999bd3f49ab1a30f6d', 'request_id': 'req-8276ab38-a96b-4723-b903-cf8267ece3ba'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:58.149521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8276ab38-a96b-4723-b903-cf8267ece3ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a57fde17bcb049999bd3f49ab1a30f6d', 'request_id': 'req-8276ab38-a96b-4723-b903-cf8267ece3ba'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:58.156265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8276ab38-a96b-4723-b903-cf8267ece3ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a57fde17bcb049999bd3f49ab1a30f6d', 'request_id': 'req-8276ab38-a96b-4723-b903-cf8267ece3ba'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:58.262444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8276ab38-a96b-4723-b903-cf8267ece3ba admin admin] The token cache is being invalidate because project a57fde17bcb049999bd3f49ab1a30f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:55:58.262728 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8276ab38-a96b-4723-b903-cf8267ece3ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:58.263336 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8276ab38-a96b-4723-b903-cf8267ece3ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:55:58.264918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1198/2360] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:55:57 2022] DELETE /identity/v3/projects/a57fde17bcb049999bd3f49ab1a30f6d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:55:58.269690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101142e-4457-4d45-ae0f-ce2a0cbbb4c1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:58.270144 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101142e-4457-4d45-ae0f-ce2a0cbbb4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:58.270268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101142e-4457-4d45-ae0f-ce2a0cbbb4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:58.289126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6101142e-4457-4d45-ae0f-ce2a0cbbb4c1 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:58.290509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6101142e-4457-4d45-ae0f-ce2a0cbbb4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:58.348566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1163/2361] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:55:58.358018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515652c-0f02-4763-b521-893c83fe152a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:58.358341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515652c-0f02-4763-b521-893c83fe152a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:58.358618 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515652c-0f02-4763-b521-893c83fe152a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:58.377390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e515652c-0f02-4763-b521-893c83fe152a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:58.378595 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e515652c-0f02-4763-b521-893c83fe152a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:58.386621 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1199/2362] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:55:58.391006 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101142e-4457-4d45-ae0f-ce2a0cbbb4c1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:58.402636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101142e-4457-4d45-ae0f-ce2a0cbbb4c1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:58.407548 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf05a0c-b2e7-4e35-acd8-95ad50c73be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:58.408207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf05a0c-b2e7-4e35-acd8-95ad50c73be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:58.408523 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf05a0c-b2e7-4e35-acd8-95ad50c73be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:58.408803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf05a0c-b2e7-4e35-acd8-95ad50c73be2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:58.410182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf05a0c-b2e7-4e35-acd8-95ad50c73be2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:55:58.410671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf05a0c-b2e7-4e35-acd8-95ad50c73be2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:58.412919 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf05a0c-b2e7-4e35-acd8-95ad50c73be2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:58.428488 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1164/2363] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:55:58.429880 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515652c-0f02-4763-b521-893c83fe152a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:58.439174 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515652c-0f02-4763-b521-893c83fe152a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:58.444504 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d43fac-dfb4-406b-ad7d-4673fbd8d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:58.445151 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d43fac-dfb4-406b-ad7d-4673fbd8d1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:58.445428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d43fac-dfb4-406b-ad7d-4673fbd8d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:58.445701 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d43fac-dfb4-406b-ad7d-4673fbd8d1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:58.446389 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d43fac-dfb4-406b-ad7d-4673fbd8d1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:58.448286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d43fac-dfb4-406b-ad7d-4673fbd8d1a8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:58.595953 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1200/2364] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:55:58 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:55:58.600583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf05a0c-b2e7-4e35-acd8-95ad50c73be2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:58.622617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf05a0c-b2e7-4e35-acd8-95ad50c73be2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:58.700053 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cbe55-3fab-447f-8f09-be142db6a723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:58.700053 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cbe55-3fab-447f-8f09-be142db6a723 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:58.700053 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cbe55-3fab-447f-8f09-be142db6a723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:58.700053 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cbe55-3fab-447f-8f09-be142db6a723 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:58.700413 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cbe55-3fab-447f-8f09-be142db6a723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:58.700413 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cbe55-3fab-447f-8f09-be142db6a723 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:58.820923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1165/2365] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:55:58 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:55:58.825050 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d43fac-dfb4-406b-ad7d-4673fbd8d1a8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:58.834464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cbe55-3fab-447f-8f09-be142db6a723 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:58.836259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d43fac-dfb4-406b-ad7d-4673fbd8d1a8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:58.836582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9d7cbe55-3fab-447f-8f09-be142db6a723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:58.841151 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a66b7f-39e7-4de5-a79d-19dcc80afc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:58.841975 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a66b7f-39e7-4de5-a79d-19dcc80afc7a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:58.842092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a66b7f-39e7-4de5-a79d-19dcc80afc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:58.842356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a66b7f-39e7-4de5-a79d-19dcc80afc7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:58.843088 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a66b7f-39e7-4de5-a79d-19dcc80afc7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:58.844760 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a66b7f-39e7-4de5-a79d-19dcc80afc7a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:58.855875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1201/2366] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:55:58.859841 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a66b7f-39e7-4de5-a79d-19dcc80afc7a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:58.869890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a66b7f-39e7-4de5-a79d-19dcc80afc7a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:58.875029 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dfb25-3dd7-4601-b8b9-4f12758b6f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:58.875662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dfb25-3dd7-4601-b8b9-4f12758b6f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:58.875934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dfb25-3dd7-4601-b8b9-4f12758b6f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:58.876206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dfb25-3dd7-4601-b8b9-4f12758b6f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:58.876949 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dfb25-3dd7-4601-b8b9-4f12758b6f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:58.878521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dfb25-3dd7-4601-b8b9-4f12758b6f2b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:58.888899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1202/2367] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:55:58.892862 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dfb25-3dd7-4601-b8b9-4f12758b6f2b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:58.903023 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dfb25-3dd7-4601-b8b9-4f12758b6f2b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:58.908072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d40b36-d636-43b7-b83b-cfd6fcba9535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:58.909056 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d40b36-d636-43b7-b83b-cfd6fcba9535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:58.909387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d40b36-d636-43b7-b83b-cfd6fcba9535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:58.909716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d40b36-d636-43b7-b83b-cfd6fcba9535 admin admin] PATH_INFO: `/v3/projects/923e6a03a0e849e191d08f33dba6e2ec/users/68ba2e7c527748bbb8c500664222a31f/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:58.911866 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cbe55-3fab-447f-8f09-be142db6a723 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:58.919175 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c994185-db7e-40e7-9b8f-1071c364a677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:58.920309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c994185-db7e-40e7-9b8f-1071c364a677 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:58.920607 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c994185-db7e-40e7-9b8f-1071c364a677 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:58.920891 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c994185-db7e-40e7-9b8f-1071c364a677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:58.922882 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5c994185-db7e-40e7-9b8f-1071c364a677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:58.926492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d40b36-d636-43b7-b83b-cfd6fcba9535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=923e6a03a0e849e191d08f33dba6e2ec, user_id=68ba2e7c527748bbb8c500664222a31f, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:58.929953 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d40b36-d636-43b7-b83b-cfd6fcba9535 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:58.936685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c994185-db7e-40e7-9b8f-1071c364a677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:58.938390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c994185-db7e-40e7-9b8f-1071c364a677 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:58.949966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1166/2368] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:55:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:55:59.013642 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1203/2369] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:55:58 2022] PUT /identity/v3/projects/923e6a03a0e849e191d08f33dba6e2ec/users/68ba2e7c527748bbb8c500664222a31f/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:55:59.023948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27a968-8d87-48d2-a850-ebd33414da48 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:59.024235 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27a968-8d87-48d2-a850-ebd33414da48 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:59.024543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27a968-8d87-48d2-a850-ebd33414da48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:59.050772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3b27a968-8d87-48d2-a850-ebd33414da48 None None] MFA Rules not processed for user `68ba2e7c527748bbb8c500664222a31f`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:59.051977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3b27a968-8d87-48d2-a850-ebd33414da48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:59.112787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1167/2370] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:55:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:55:59.117632 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d40b36-d636-43b7-b83b-cfd6fcba9535 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:59.177192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d40b36-d636-43b7-b83b-cfd6fcba9535 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:59.182575 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e2f41-6e93-40b9-b267-644d32e43427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:59.183225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e2f41-6e93-40b9-b267-644d32e43427 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:59.183505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e2f41-6e93-40b9-b267-644d32e43427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:59.183779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e2f41-6e93-40b9-b267-644d32e43427 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:59.184499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e2f41-6e93-40b9-b267-644d32e43427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:59.186407 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e2f41-6e93-40b9-b267-644d32e43427 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:59.300138 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1204/2371] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:55:59 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:55:59.304824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27a968-8d87-48d2-a850-ebd33414da48 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:59.315416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27a968-8d87-48d2-a850-ebd33414da48 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:59.372523 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17515bdd-c89a-4e7e-a7e2-77a108d18a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:59.373110 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17515bdd-c89a-4e7e-a7e2-77a108d18a3c admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:59.373413 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17515bdd-c89a-4e7e-a7e2-77a108d18a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:59.373663 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17515bdd-c89a-4e7e-a7e2-77a108d18a3c admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:59.374345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17515bdd-c89a-4e7e-a7e2-77a108d18a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:59.376286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17515bdd-c89a-4e7e-a7e2-77a108d18a3c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:59.487314 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1168/2372] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:55:59 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:55:59.492035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e2f41-6e93-40b9-b267-644d32e43427 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:59.502520 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e2f41-6e93-40b9-b267-644d32e43427 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:59.507753 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c521b-0ec4-4ae6-99b4-657ebfbcf32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:59.508419 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c521b-0ec4-4ae6-99b4-657ebfbcf32f admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:59.508730 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c521b-0ec4-4ae6-99b4-657ebfbcf32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:59.509007 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c521b-0ec4-4ae6-99b4-657ebfbcf32f admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:59.509868 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c521b-0ec4-4ae6-99b4-657ebfbcf32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:59.511405 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c521b-0ec4-4ae6-99b4-657ebfbcf32f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:59.522502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1205/2373] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:55:59.526450 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17515bdd-c89a-4e7e-a7e2-77a108d18a3c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:59.536199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17515bdd-c89a-4e7e-a7e2-77a108d18a3c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:59.541619 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3dc754-6367-4e36-ac16-00e9e80955dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:59.542770 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dc754-6367-4e36-ac16-00e9e80955dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:59.542770 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dc754-6367-4e36-ac16-00e9e80955dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:59.543006 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dc754-6367-4e36-ac16-00e9e80955dc admin admin] PATH_INFO: `/v3/projects/7e19ac32c9944e6c8b3135ca9833e382/users/84a7d1d3d4e84555bb68259b9792601e/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:59.558239 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3dc754-6367-4e36-ac16-00e9e80955dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e19ac32c9944e6c8b3135ca9833e382, user_id=84a7d1d3d4e84555bb68259b9792601e, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:59.560904 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3dc754-6367-4e36-ac16-00e9e80955dc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:59.658849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1169/2374] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:55:59 2022] PUT /identity/v3/projects/7e19ac32c9944e6c8b3135ca9833e382/users/84a7d1d3d4e84555bb68259b9792601e/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:55:59.663519 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c521b-0ec4-4ae6-99b4-657ebfbcf32f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:59.673784 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c521b-0ec4-4ae6-99b4-657ebfbcf32f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:59.734166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e9464-45c6-40fb-b689-ac5a28208602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:59.734834 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e9464-45c6-40fb-b689-ac5a28208602 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:59.735116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e9464-45c6-40fb-b689-ac5a28208602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:59.735390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e9464-45c6-40fb-b689-ac5a28208602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:59.736204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e9464-45c6-40fb-b689-ac5a28208602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:59.737873 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e9464-45c6-40fb-b689-ac5a28208602 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:59.751393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1206/2375] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:55:59.752667 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3dc754-6367-4e36-ac16-00e9e80955dc admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:59.763824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3dc754-6367-4e36-ac16-00e9e80955dc admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:55:59.768665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700aa74-1634-4eb5-9d57-36661bbae083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:55:59.769565 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700aa74-1634-4eb5-9d57-36661bbae083 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:59.769876 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700aa74-1634-4eb5-9d57-36661bbae083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:59.771302 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700aa74-1634-4eb5-9d57-36661bbae083 admin admin] PATH_INFO: `/v3/projects/7e19ac32c9944e6c8b3135ca9833e382/users/84a7d1d3d4e84555bb68259b9792601e/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:59.774587 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700aa74-1634-4eb5-9d57-36661bbae083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e19ac32c9944e6c8b3135ca9833e382, user_id=84a7d1d3d4e84555bb68259b9792601e, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:55:59.777587 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700aa74-1634-4eb5-9d57-36661bbae083 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:55:59.805066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1170/2376] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:55:59 2022] PUT /identity/v3/projects/7e19ac32c9944e6c8b3135ca9833e382/users/84a7d1d3d4e84555bb68259b9792601e/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:55:59.815412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111a351-8f77-4716-8b47-990e7942d37b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:55:59.815695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111a351-8f77-4716-8b47-990e7942d37b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:55:59.815967 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111a351-8f77-4716-8b47-990e7942d37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:55:59.856141 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7111a351-8f77-4716-8b47-990e7942d37b None None] MFA Rules not processed for user `84a7d1d3d4e84555bb68259b9792601e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:55:59.857780 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7111a351-8f77-4716-8b47-990e7942d37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:55:59.931012 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1207/2377] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:55:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:55:59.944709 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700aa74-1634-4eb5-9d57-36661bbae083 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:55:59.946456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e700aa74-1634-4eb5-9d57-36661bbae083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:00.012554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700aa74-1634-4eb5-9d57-36661bbae083 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:00.016312 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c96717-75ba-47a3-8051-7d86381b71e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:00.017047 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c96717-75ba-47a3-8051-7d86381b71e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:00.017356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c96717-75ba-47a3-8051-7d86381b71e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:00.017637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c96717-75ba-47a3-8051-7d86381b71e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:00.027800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c96717-75ba-47a3-8051-7d86381b71e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:00.029280 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c96717-75ba-47a3-8051-7d86381b71e2 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:00.039245 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1171/2378] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:55:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:56:00.977036 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111a351-8f77-4716-8b47-990e7942d37b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:01.056848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111a351-8f77-4716-8b47-990e7942d37b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:01.062892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee1b61-4fe2-489d-8f64-ee9c505dc7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:01.063777 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee1b61-4fe2-489d-8f64-ee9c505dc7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:01.064057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee1b61-4fe2-489d-8f64-ee9c505dc7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:01.064492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee1b61-4fe2-489d-8f64-ee9c505dc7e0 admin admin] PATH_INFO: `/v3/users/68ba2e7c527748bbb8c500664222a31f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:01.066563 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee1b61-4fe2-489d-8f64-ee9c505dc7e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ba2e7c527748bbb8c500664222a31f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:01.072485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee1b61-4fe2-489d-8f64-ee9c505dc7e0 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:01.251555 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6aee1b61-4fe2-489d-8f64-ee9c505dc7e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ba2e7c527748bbb8c500664222a31f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:01.313564 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6aee1b61-4fe2-489d-8f64-ee9c505dc7e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ba2e7c527748bbb8c500664222a31f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:01.314128 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6aee1b61-4fe2-489d-8f64-ee9c505dc7e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ba2e7c527748bbb8c500664222a31f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:01.322251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6aee1b61-4fe2-489d-8f64-ee9c505dc7e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ba2e7c527748bbb8c500664222a31f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:01.334610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6aee1b61-4fe2-489d-8f64-ee9c505dc7e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ba2e7c527748bbb8c500664222a31f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:01.341460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1208/2379] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:56:00 2022] DELETE /identity/v3/users/68ba2e7c527748bbb8c500664222a31f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:01.352324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c181db-56d3-4837-96e7-e6f2f55c2582 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:01.352928 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c181db-56d3-4837-96e7-e6f2f55c2582 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:01.352928 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c181db-56d3-4837-96e7-e6f2f55c2582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:01.373965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-39c181db-56d3-4837-96e7-e6f2f55c2582 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:01.375277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-39c181db-56d3-4837-96e7-e6f2f55c2582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:01.436002 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1172/2380] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:56:01.447495 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee1b61-4fe2-489d-8f64-ee9c505dc7e0 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:01.449613 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6aee1b61-4fe2-489d-8f64-ee9c505dc7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:01.507163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee1b61-4fe2-489d-8f64-ee9c505dc7e0 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:01.510770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92b564-9d43-42de-82dd-2c26c4a2e861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:01.511420 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92b564-9d43-42de-82dd-2c26c4a2e861 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:01.511696 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92b564-9d43-42de-82dd-2c26c4a2e861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:01.511968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92b564-9d43-42de-82dd-2c26c4a2e861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:01.521678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92b564-9d43-42de-82dd-2c26c4a2e861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:01.523109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92b564-9d43-42de-82dd-2c26c4a2e861 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:01.533032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1209/2381] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:56:02.088955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c181db-56d3-4837-96e7-e6f2f55c2582 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:02.090547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-39c181db-56d3-4837-96e7-e6f2f55c2582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:02.104551 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c181db-56d3-4837-96e7-e6f2f55c2582 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:02.109606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:02.110563 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:02.110913 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:02.111634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023 admin admin] PATH_INFO: `/v3/projects/923e6a03a0e849e191d08f33dba6e2ec` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:02.112546 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=923e6a03a0e849e191d08f33dba6e2ec)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:02.115441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:02.266334 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923e6a03a0e849e191d08f33dba6e2ec', 'request_id': 'req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:02.272493 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923e6a03a0e849e191d08f33dba6e2ec', 'request_id': 'req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:02.376143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923e6a03a0e849e191d08f33dba6e2ec', 'request_id': 'req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:02.398527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023 admin admin] The token cache is being invalidate because project 923e6a03a0e849e191d08f33dba6e2ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:56:02.399018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:02.400165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:02.413265 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1173/2382] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:56:02 2022] DELETE /identity/v3/projects/923e6a03a0e849e191d08f33dba6e2ec => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:02.417708 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92b564-9d43-42de-82dd-2c26c4a2e861 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:02.429258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92b564-9d43-42de-82dd-2c26c4a2e861 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:02.507322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b9d5a-820f-461a-8a01-918e517e215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:02.508630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b9d5a-820f-461a-8a01-918e517e215a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:02.508907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b9d5a-820f-461a-8a01-918e517e215a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:02.509354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b9d5a-820f-461a-8a01-918e517e215a admin admin] PATH_INFO: `/v3/users/84a7d1d3d4e84555bb68259b9792601e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:02.510933 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b9d5a-820f-461a-8a01-918e517e215a admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a7d1d3d4e84555bb68259b9792601e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:02.512916 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b9d5a-820f-461a-8a01-918e517e215a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:02.784418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-239b9d5a-820f-461a-8a01-918e517e215a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a7d1d3d4e84555bb68259b9792601e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:03.000959 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-239b9d5a-820f-461a-8a01-918e517e215a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a7d1d3d4e84555bb68259b9792601e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:03.002193 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-239b9d5a-820f-461a-8a01-918e517e215a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a7d1d3d4e84555bb68259b9792601e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:03.011280 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-239b9d5a-820f-461a-8a01-918e517e215a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a7d1d3d4e84555bb68259b9792601e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:03.028016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-239b9d5a-820f-461a-8a01-918e517e215a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a7d1d3d4e84555bb68259b9792601e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:03.031475 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1210/2383] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:56:02 2022] DELETE /identity/v3/users/84a7d1d3d4e84555bb68259b9792601e => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:56:03.551042 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:03.553010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:03.576127 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ef1af-c5c5-4cfc-8dcc-c1f395fdc023 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:03.652488 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373504a-94a9-4881-85a9-388c60b9f0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:03.652707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373504a-94a9-4881-85a9-388c60b9f0b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:03.652986 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373504a-94a9-4881-85a9-388c60b9f0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:03.653254 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373504a-94a9-4881-85a9-388c60b9f0b4 admin admin] PATH_INFO: `/v3/projects/7e19ac32c9944e6c8b3135ca9833e382` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:03.654447 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373504a-94a9-4881-85a9-388c60b9f0b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e19ac32c9944e6c8b3135ca9833e382)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:03.656388 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373504a-94a9-4881-85a9-388c60b9f0b4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:03.820151 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5373504a-94a9-4881-85a9-388c60b9f0b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e19ac32c9944e6c8b3135ca9833e382', 'request_id': 'req-5373504a-94a9-4881-85a9-388c60b9f0b4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:03.825587 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5373504a-94a9-4881-85a9-388c60b9f0b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e19ac32c9944e6c8b3135ca9833e382', 'request_id': 'req-5373504a-94a9-4881-85a9-388c60b9f0b4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:03.924322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5373504a-94a9-4881-85a9-388c60b9f0b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e19ac32c9944e6c8b3135ca9833e382', 'request_id': 'req-5373504a-94a9-4881-85a9-388c60b9f0b4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:03.937434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5373504a-94a9-4881-85a9-388c60b9f0b4 admin admin] The token cache is being invalidate because project 7e19ac32c9944e6c8b3135ca9833e382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:56:03.937721 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5373504a-94a9-4881-85a9-388c60b9f0b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:03.938376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5373504a-94a9-4881-85a9-388c60b9f0b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:03.943279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1174/2384] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:56:03 2022] DELETE /identity/v3/projects/7e19ac32c9944e6c8b3135ca9833e382 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:03.945095 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6de70-c56f-4212-8bd5-f989ca86ef0a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:03.945562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6de70-c56f-4212-8bd5-f989ca86ef0a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:03.945653 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6de70-c56f-4212-8bd5-f989ca86ef0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:03.965784 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5fe6de70-c56f-4212-8bd5-f989ca86ef0a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:03.967329 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5fe6de70-c56f-4212-8bd5-f989ca86ef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:04.031494 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1211/2385] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:04.040414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e3cbc-1618-4c29-b014-2a3f3f03a9c9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:04.040737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e3cbc-1618-4c29-b014-2a3f3f03a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:04.041015 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e3cbc-1618-4c29-b014-2a3f3f03a9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:04.059329 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-869e3cbc-1618-4c29-b014-2a3f3f03a9c9 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:04.060584 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-869e3cbc-1618-4c29-b014-2a3f3f03a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:04.068593 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1175/2386] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:56:04.072820 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6de70-c56f-4212-8bd5-f989ca86ef0a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:04.082278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6de70-c56f-4212-8bd5-f989ca86ef0a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:04.087793 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cbec1-39ae-445f-b95d-4891306a9c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:04.088461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cbec1-39ae-445f-b95d-4891306a9c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:04.088755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cbec1-39ae-445f-b95d-4891306a9c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:04.089027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cbec1-39ae-445f-b95d-4891306a9c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:04.089759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cbec1-39ae-445f-b95d-4891306a9c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:04.090058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cbec1-39ae-445f-b95d-4891306a9c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:04.091652 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cbec1-39ae-445f-b95d-4891306a9c8e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:04.107716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1212/2387] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:04.112026 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e3cbc-1618-4c29-b014-2a3f3f03a9c9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:04.124030 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e3cbc-1618-4c29-b014-2a3f3f03a9c9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:04.128945 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f6583-4b1d-4155-b29d-d8126d6cf56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:04.129632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f6583-4b1d-4155-b29d-d8126d6cf56c admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:04.129908 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f6583-4b1d-4155-b29d-d8126d6cf56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:04.130181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f6583-4b1d-4155-b29d-d8126d6cf56c admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:04.132469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f6583-4b1d-4155-b29d-d8126d6cf56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:04.132924 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f6583-4b1d-4155-b29d-d8126d6cf56c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:04.352857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1176/2388] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:56:04 2022] POST /identity/v3/projects => generated 369 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:04.354326 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cbec1-39ae-445f-b95d-4891306a9c8e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:04.364564 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cbec1-39ae-445f-b95d-4891306a9c8e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:04.422466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb12f4-62f5-4b8b-8399-70ebe6f6b781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:04.423151 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb12f4-62f5-4b8b-8399-70ebe6f6b781 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:04.423425 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb12f4-62f5-4b8b-8399-70ebe6f6b781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:04.423688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb12f4-62f5-4b8b-8399-70ebe6f6b781 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:04.424395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb12f4-62f5-4b8b-8399-70ebe6f6b781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:04.426320 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb12f4-62f5-4b8b-8399-70ebe6f6b781 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:04.514482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f167f0d-c1af-4f7c-bb6a-703499316c9b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:04.514790 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f167f0d-c1af-4f7c-bb6a-703499316c9b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:04.515056 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f167f0d-c1af-4f7c-bb6a-703499316c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:04.536630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6f167f0d-c1af-4f7c-bb6a-703499316c9b None None] MFA Rules not processed for user `d653275573ef4485ad38892d703f2159`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:04.538273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6f167f0d-c1af-4f7c-bb6a-703499316c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:04.580818 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1213/2389] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:56:04 2022] POST /identity/v3/users => generated 285 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:56:04.588178 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb12f4-62f5-4b8b-8399-70ebe6f6b781 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:04.612224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1177/2390] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:04.614130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb12f4-62f5-4b8b-8399-70ebe6f6b781 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:04.615361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda7c78-ea03-431e-8643-4c1027df9c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:04.616355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda7c78-ea03-431e-8643-4c1027df9c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:04.616765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda7c78-ea03-431e-8643-4c1027df9c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:04.617138 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda7c78-ea03-431e-8643-4c1027df9c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:04.620144 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda7c78-ea03-431e-8643-4c1027df9c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:04.620460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda7c78-ea03-431e-8643-4c1027df9c0d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:04.633334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1214/2391] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:56:04.637267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f167f0d-c1af-4f7c-bb6a-703499316c9b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:04.652167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f167f0d-c1af-4f7c-bb6a-703499316c9b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:04.658424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217fc46-c806-430f-bb03-a11808a282db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:04.658886 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217fc46-c806-430f-bb03-a11808a282db admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:04.659272 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217fc46-c806-430f-bb03-a11808a282db admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:04.659651 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217fc46-c806-430f-bb03-a11808a282db admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:04.660572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217fc46-c806-430f-bb03-a11808a282db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:04.662353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217fc46-c806-430f-bb03-a11808a282db admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:04.677314 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1178/2392] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:56:04.681954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda7c78-ea03-431e-8643-4c1027df9c0d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:04.694464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda7c78-ea03-431e-8643-4c1027df9c0d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:04.700028 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c806f05-0b0b-4457-88c1-a6fd17cfd75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:04.701426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c806f05-0b0b-4457-88c1-a6fd17cfd75c admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:04.701993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c806f05-0b0b-4457-88c1-a6fd17cfd75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:04.702421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c806f05-0b0b-4457-88c1-a6fd17cfd75c admin admin] PATH_INFO: `/v3/projects/ee241ec9ea7e4b7799ad2188bb8b6631/users/e1ac81c1f8f143199dd640d76e231f1c/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:04.728401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c806f05-0b0b-4457-88c1-a6fd17cfd75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee241ec9ea7e4b7799ad2188bb8b6631, user_id=e1ac81c1f8f143199dd640d76e231f1c, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:04.731516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c806f05-0b0b-4457-88c1-a6fd17cfd75c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:04.847286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1215/2393] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:56:04 2022] PUT /identity/v3/projects/ee241ec9ea7e4b7799ad2188bb8b6631/users/e1ac81c1f8f143199dd640d76e231f1c/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:04.858524 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfb74f-75c6-4d43-bc1f-c80bde1b600a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:04.858524 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfb74f-75c6-4d43-bc1f-c80bde1b600a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:04.858800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfb74f-75c6-4d43-bc1f-c80bde1b600a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:04.893631 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e1cfb74f-75c6-4d43-bc1f-c80bde1b600a None None] MFA Rules not processed for user `e1ac81c1f8f143199dd640d76e231f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:04.894858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e1cfb74f-75c6-4d43-bc1f-c80bde1b600a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:04.969901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1179/2394] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:04.975376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c806f05-0b0b-4457-88c1-a6fd17cfd75c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:05.047487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c806f05-0b0b-4457-88c1-a6fd17cfd75c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:05.052692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce882e-2573-4a2d-a04a-0d249d3c1e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:05.053977 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce882e-2573-4a2d-a04a-0d249d3c1e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:05.054258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce882e-2573-4a2d-a04a-0d249d3c1e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:05.054530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce882e-2573-4a2d-a04a-0d249d3c1e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:05.055226 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce882e-2573-4a2d-a04a-0d249d3c1e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:05.057170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce882e-2573-4a2d-a04a-0d249d3c1e7b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:05.147808 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1216/2395] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:56:04 2022] POST /identity/v3/projects => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:05.150687 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfb74f-75c6-4d43-bc1f-c80bde1b600a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:05.168205 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfb74f-75c6-4d43-bc1f-c80bde1b600a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:05.230056 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe77fc8-729e-47fc-ab6a-f883d81d0aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:05.230740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe77fc8-729e-47fc-ab6a-f883d81d0aab admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:05.231020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe77fc8-729e-47fc-ab6a-f883d81d0aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:05.231296 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe77fc8-729e-47fc-ab6a-f883d81d0aab admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:05.232111 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe77fc8-729e-47fc-ab6a-f883d81d0aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:05.234098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe77fc8-729e-47fc-ab6a-f883d81d0aab admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:05.322141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1180/2396] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:56:05 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:05.326077 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce882e-2573-4a2d-a04a-0d249d3c1e7b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:05.337593 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce882e-2573-4a2d-a04a-0d249d3c1e7b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:05.343189 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edff26f-1d08-41fc-a517-5712aa60dab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:05.344069 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edff26f-1d08-41fc-a517-5712aa60dab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:05.344410 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edff26f-1d08-41fc-a517-5712aa60dab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:05.344792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edff26f-1d08-41fc-a517-5712aa60dab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:05.345594 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edff26f-1d08-41fc-a517-5712aa60dab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:05.347331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edff26f-1d08-41fc-a517-5712aa60dab3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:05.361990 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1217/2397] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:56:05.366683 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe77fc8-729e-47fc-ab6a-f883d81d0aab admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:05.377791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe77fc8-729e-47fc-ab6a-f883d81d0aab admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:05.383402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c030b8d-d178-4608-bb46-ba3f3d1f6530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:05.384833 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c030b8d-d178-4608-bb46-ba3f3d1f6530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:05.385065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c030b8d-d178-4608-bb46-ba3f3d1f6530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:05.385434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c030b8d-d178-4608-bb46-ba3f3d1f6530 admin admin] PATH_INFO: `/v3/projects/f1c7817612f846f3aea1d2e192fa2721/users/f2ca354082d84ae49b106025d59376cc/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:05.415308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c030b8d-d178-4608-bb46-ba3f3d1f6530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c7817612f846f3aea1d2e192fa2721, user_id=f2ca354082d84ae49b106025d59376cc, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:05.418447 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c030b8d-d178-4608-bb46-ba3f3d1f6530 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:05.523607 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1181/2398] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:56:05 2022] PUT /identity/v3/projects/f1c7817612f846f3aea1d2e192fa2721/users/f2ca354082d84ae49b106025d59376cc/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:05.525094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edff26f-1d08-41fc-a517-5712aa60dab3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:05.539847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edff26f-1d08-41fc-a517-5712aa60dab3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:05.637521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0b687-b46a-4d15-856b-2e0aecf03bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:05.638184 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0b687-b46a-4d15-856b-2e0aecf03bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:05.638462 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0b687-b46a-4d15-856b-2e0aecf03bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:05.638731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0b687-b46a-4d15-856b-2e0aecf03bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:05.639648 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0b687-b46a-4d15-856b-2e0aecf03bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:05.641423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0b687-b46a-4d15-856b-2e0aecf03bb6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:05.652174 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1218/2399] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:56:05.656166 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c030b8d-d178-4608-bb46-ba3f3d1f6530 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:05.667570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c030b8d-d178-4608-bb46-ba3f3d1f6530 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:05.672459 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51d5fe-582e-49b6-96ce-53c768b9b98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:05.673491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51d5fe-582e-49b6-96ce-53c768b9b98c admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:05.673842 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51d5fe-582e-49b6-96ce-53c768b9b98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:05.674187 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51d5fe-582e-49b6-96ce-53c768b9b98c admin admin] PATH_INFO: `/v3/projects/f1c7817612f846f3aea1d2e192fa2721/users/f2ca354082d84ae49b106025d59376cc/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:05.676260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51d5fe-582e-49b6-96ce-53c768b9b98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c7817612f846f3aea1d2e192fa2721, user_id=f2ca354082d84ae49b106025d59376cc, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:05.679737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51d5fe-582e-49b6-96ce-53c768b9b98c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:05.690599 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1182/2400] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:56:05 2022] PUT /identity/v3/projects/f1c7817612f846f3aea1d2e192fa2721/users/f2ca354082d84ae49b106025d59376cc/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:05.702607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287936a-730f-4626-a99c-c3def673457a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:05.703082 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287936a-730f-4626-a99c-c3def673457a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:05.703530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287936a-730f-4626-a99c-c3def673457a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:05.734731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c287936a-730f-4626-a99c-c3def673457a None None] MFA Rules not processed for user `f2ca354082d84ae49b106025d59376cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:05.735982 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c287936a-730f-4626-a99c-c3def673457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:05.806756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1219/2401] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:05.817906 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51d5fe-582e-49b6-96ce-53c768b9b98c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:05.820230 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4c51d5fe-582e-49b6-96ce-53c768b9b98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:05.890102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51d5fe-582e-49b6-96ce-53c768b9b98c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:05.894537 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a8ac2-dcf3-4bab-9455-8bffdeb1ced5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:05.895241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a8ac2-dcf3-4bab-9455-8bffdeb1ced5 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:05.895527 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a8ac2-dcf3-4bab-9455-8bffdeb1ced5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:05.895797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a8ac2-dcf3-4bab-9455-8bffdeb1ced5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:05.906028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a8ac2-dcf3-4bab-9455-8bffdeb1ced5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:05.907426 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a8ac2-dcf3-4bab-9455-8bffdeb1ced5 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:05.918486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1183/2402] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:05 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:56:06.032592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287936a-730f-4626-a99c-c3def673457a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:06.033990 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c287936a-730f-4626-a99c-c3def673457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:06.047711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287936a-730f-4626-a99c-c3def673457a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:06.051376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d764882-a906-423f-a2ff-802efe9ef3e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:06.052051 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d764882-a906-423f-a2ff-802efe9ef3e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:06.052326 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d764882-a906-423f-a2ff-802efe9ef3e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:06.053632 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d764882-a906-423f-a2ff-802efe9ef3e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:06.124923 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d764882-a906-423f-a2ff-802efe9ef3e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:06.126364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d764882-a906-423f-a2ff-802efe9ef3e6 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:06.135628 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1220/2403] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:56:09.409282 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541eb24-6079-453f-8883-dfa5dcf71342 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:09.412658 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541eb24-6079-453f-8883-dfa5dcf71342 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:09.412658 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541eb24-6079-453f-8883-dfa5dcf71342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:09.430978 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d541eb24-6079-453f-8883-dfa5dcf71342 None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:09.435020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d541eb24-6079-453f-8883-dfa5dcf71342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:09.515439 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1184/2404] 10.222.0.81 () {58 vars in 1009 bytes} [Wed May 4 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:09.701094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d764882-a906-423f-a2ff-802efe9ef3e6 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:09.703206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5d764882-a906-423f-a2ff-802efe9ef3e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:09.775848 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d764882-a906-423f-a2ff-802efe9ef3e6 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:09.780933 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01881c-a1b9-45dd-9dc0-5fb628334e37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:09.781609 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01881c-a1b9-45dd-9dc0-5fb628334e37 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:09.781885 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01881c-a1b9-45dd-9dc0-5fb628334e37 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:09.782183 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01881c-a1b9-45dd-9dc0-5fb628334e37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:09.791258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01881c-a1b9-45dd-9dc0-5fb628334e37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:09.792975 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01881c-a1b9-45dd-9dc0-5fb628334e37 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:09.801317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1221/2405] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 17:56:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 17:56:11.396671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541eb24-6079-453f-8883-dfa5dcf71342 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:11.484353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541eb24-6079-453f-8883-dfa5dcf71342 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:11.490207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd634ed-54fa-472d-acd1-1b00ef216535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:11.491243 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd634ed-54fa-472d-acd1-1b00ef216535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:11.491533 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd634ed-54fa-472d-acd1-1b00ef216535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:11.491808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd634ed-54fa-472d-acd1-1b00ef216535 admin admin] PATH_INFO: `/v3/users/e1ac81c1f8f143199dd640d76e231f1c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:11.493163 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd634ed-54fa-472d-acd1-1b00ef216535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ac81c1f8f143199dd640d76e231f1c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:11.495203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd634ed-54fa-472d-acd1-1b00ef216535 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:11.712798 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9bd634ed-54fa-472d-acd1-1b00ef216535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ac81c1f8f143199dd640d76e231f1c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:11.731192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9bd634ed-54fa-472d-acd1-1b00ef216535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ac81c1f8f143199dd640d76e231f1c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:11.934418 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9bd634ed-54fa-472d-acd1-1b00ef216535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ac81c1f8f143199dd640d76e231f1c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:11.944496 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9bd634ed-54fa-472d-acd1-1b00ef216535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ac81c1f8f143199dd640d76e231f1c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:11.945939 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9bd634ed-54fa-472d-acd1-1b00ef216535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ac81c1f8f143199dd640d76e231f1c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:11.953226 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1185/2406] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:56:11 2022] DELETE /identity/v3/users/e1ac81c1f8f143199dd640d76e231f1c => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:11.957921 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9625f8-b966-440b-a96e-bd3b5d34f1ac None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:11.959114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9625f8-b966-440b-a96e-bd3b5d34f1ac None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:11.959397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9625f8-b966-440b-a96e-bd3b5d34f1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:11.982236 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-bc9625f8-b966-440b-a96e-bd3b5d34f1ac None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:11.986896 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bc9625f8-b966-440b-a96e-bd3b5d34f1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:12.113912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1222/2407] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:12.120302 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd634ed-54fa-472d-acd1-1b00ef216535 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:12.122008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9bd634ed-54fa-472d-acd1-1b00ef216535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:12.222497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd634ed-54fa-472d-acd1-1b00ef216535 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:12.230664 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ec33e-a5a9-4def-95bf-60523d0886bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:12.231362 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ec33e-a5a9-4def-95bf-60523d0886bd service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:12.231630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ec33e-a5a9-4def-95bf-60523d0886bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:12.231892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ec33e-a5a9-4def-95bf-60523d0886bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:12.243309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ec33e-a5a9-4def-95bf-60523d0886bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:12.244870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ec33e-a5a9-4def-95bf-60523d0886bd service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:12.259453 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1186/2408] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:56:13.455712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9625f8-b966-440b-a96e-bd3b5d34f1ac None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:13.457159 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bc9625f8-b966-440b-a96e-bd3b5d34f1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:13.470919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9625f8-b966-440b-a96e-bd3b5d34f1ac None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:13.480654 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e57684-b401-4405-b857-c579c72a3ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:13.482149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e57684-b401-4405-b857-c579c72a3ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:13.482592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e57684-b401-4405-b857-c579c72a3ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:13.484422 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e57684-b401-4405-b857-c579c72a3ed2 admin admin] PATH_INFO: `/v3/projects/ee241ec9ea7e4b7799ad2188bb8b6631` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:13.486546 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e57684-b401-4405-b857-c579c72a3ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee241ec9ea7e4b7799ad2188bb8b6631)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:13.493013 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e57684-b401-4405-b857-c579c72a3ed2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:13.638032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-93e57684-b401-4405-b857-c579c72a3ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee241ec9ea7e4b7799ad2188bb8b6631', 'request_id': 'req-93e57684-b401-4405-b857-c579c72a3ed2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:13.643747 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-93e57684-b401-4405-b857-c579c72a3ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee241ec9ea7e4b7799ad2188bb8b6631', 'request_id': 'req-93e57684-b401-4405-b857-c579c72a3ed2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:13.658041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-93e57684-b401-4405-b857-c579c72a3ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee241ec9ea7e4b7799ad2188bb8b6631', 'request_id': 'req-93e57684-b401-4405-b857-c579c72a3ed2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:13.810127 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-93e57684-b401-4405-b857-c579c72a3ed2 admin admin] The token cache is being invalidate because project ee241ec9ea7e4b7799ad2188bb8b6631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:56:13.810712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-93e57684-b401-4405-b857-c579c72a3ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:13.811647 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-93e57684-b401-4405-b857-c579c72a3ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:13.813602 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1223/2409] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:56:13 2022] DELETE /identity/v3/projects/ee241ec9ea7e4b7799ad2188bb8b6631 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:56:13.818675 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ec33e-a5a9-4def-95bf-60523d0886bd service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:13.830473 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ec33e-a5a9-4def-95bf-60523d0886bd service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:13.909840 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c931dc-c6bf-47fd-bdeb-3cf2bb18da5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:13.911007 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c931dc-c6bf-47fd-bdeb-3cf2bb18da5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:13.911277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c931dc-c6bf-47fd-bdeb-3cf2bb18da5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:13.911573 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c931dc-c6bf-47fd-bdeb-3cf2bb18da5c admin admin] PATH_INFO: `/v3/users/f2ca354082d84ae49b106025d59376cc` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:13.913072 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c931dc-c6bf-47fd-bdeb-3cf2bb18da5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ca354082d84ae49b106025d59376cc)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:13.915144 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c931dc-c6bf-47fd-bdeb-3cf2bb18da5c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:14.141002 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-68c931dc-c6bf-47fd-bdeb-3cf2bb18da5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ca354082d84ae49b106025d59376cc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:14.156759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-68c931dc-c6bf-47fd-bdeb-3cf2bb18da5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ca354082d84ae49b106025d59376cc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:14.289681 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-68c931dc-c6bf-47fd-bdeb-3cf2bb18da5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ca354082d84ae49b106025d59376cc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:14.299399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-68c931dc-c6bf-47fd-bdeb-3cf2bb18da5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ca354082d84ae49b106025d59376cc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:14.300283 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-68c931dc-c6bf-47fd-bdeb-3cf2bb18da5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ca354082d84ae49b106025d59376cc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:14.313869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1187/2410] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:56:13 2022] DELETE /identity/v3/users/f2ca354082d84ae49b106025d59376cc => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:14.957166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e57684-b401-4405-b857-c579c72a3ed2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:14.960254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-93e57684-b401-4405-b857-c579c72a3ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:14.990902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e57684-b401-4405-b857-c579c72a3ed2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:15.061551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5ab8d-30eb-4a01-8d3e-8f7a0c0508c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:15.062425 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5ab8d-30eb-4a01-8d3e-8f7a0c0508c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:15.062702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5ab8d-30eb-4a01-8d3e-8f7a0c0508c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:15.062977 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5ab8d-30eb-4a01-8d3e-8f7a0c0508c7 admin admin] PATH_INFO: `/v3/projects/f1c7817612f846f3aea1d2e192fa2721` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:15.064192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5ab8d-30eb-4a01-8d3e-8f7a0c0508c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c7817612f846f3aea1d2e192fa2721)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:15.066386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5ab8d-30eb-4a01-8d3e-8f7a0c0508c7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:15.201718 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bcf5ab8d-30eb-4a01-8d3e-8f7a0c0508c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c7817612f846f3aea1d2e192fa2721', 'request_id': 'req-bcf5ab8d-30eb-4a01-8d3e-8f7a0c0508c7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:15.208360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bcf5ab8d-30eb-4a01-8d3e-8f7a0c0508c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c7817612f846f3aea1d2e192fa2721', 'request_id': 'req-bcf5ab8d-30eb-4a01-8d3e-8f7a0c0508c7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:15.216207 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bcf5ab8d-30eb-4a01-8d3e-8f7a0c0508c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c7817612f846f3aea1d2e192fa2721', 'request_id': 'req-bcf5ab8d-30eb-4a01-8d3e-8f7a0c0508c7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:15.370098 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bcf5ab8d-30eb-4a01-8d3e-8f7a0c0508c7 admin admin] The token cache is being invalidate because project f1c7817612f846f3aea1d2e192fa2721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:56:15.370670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bcf5ab8d-30eb-4a01-8d3e-8f7a0c0508c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:15.371615 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bcf5ab8d-30eb-4a01-8d3e-8f7a0c0508c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:15.378754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1224/2411] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:56:14 2022] DELETE /identity/v3/projects/f1c7817612f846f3aea1d2e192fa2721 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:15.386330 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d7fd2-13ad-4279-8c6e-bf697b423e9a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:15.387813 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d7fd2-13ad-4279-8c6e-bf697b423e9a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:15.388311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d7fd2-13ad-4279-8c6e-bf697b423e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:15.425025 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f67d7fd2-13ad-4279-8c6e-bf697b423e9a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:15.426838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f67d7fd2-13ad-4279-8c6e-bf697b423e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:15.528088 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1188/2412] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:15.529808 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc44ce-49f2-4308-9b4b-f6c7a58ffdc9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:15.530198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc44ce-49f2-4308-9b4b-f6c7a58ffdc9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:15.530477 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc44ce-49f2-4308-9b4b-f6c7a58ffdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:15.551251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e7bc44ce-49f2-4308-9b4b-f6c7a58ffdc9 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:15.552713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e7bc44ce-49f2-4308-9b4b-f6c7a58ffdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:15.561216 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1225/2413] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:56:15.567297 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d7fd2-13ad-4279-8c6e-bf697b423e9a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:15.585431 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d7fd2-13ad-4279-8c6e-bf697b423e9a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:15.591576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e03abe-7aa0-49f9-9b82-51f2dada69c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:15.592603 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e03abe-7aa0-49f9-9b82-51f2dada69c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:15.592907 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e03abe-7aa0-49f9-9b82-51f2dada69c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:15.593286 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e03abe-7aa0-49f9-9b82-51f2dada69c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:15.594143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e03abe-7aa0-49f9-9b82-51f2dada69c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:15.594559 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e03abe-7aa0-49f9-9b82-51f2dada69c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:15.596508 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e03abe-7aa0-49f9-9b82-51f2dada69c3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:15.611782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1189/2414] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:15.616966 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc44ce-49f2-4308-9b4b-f6c7a58ffdc9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:15.626603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc44ce-49f2-4308-9b4b-f6c7a58ffdc9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:15.643755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa49845-b9f3-4bdd-b180-a4a0bedd5e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:15.644573 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa49845-b9f3-4bdd-b180-a4a0bedd5e2f admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:15.650782 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa49845-b9f3-4bdd-b180-a4a0bedd5e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:15.650782 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa49845-b9f3-4bdd-b180-a4a0bedd5e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:15.650782 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa49845-b9f3-4bdd-b180-a4a0bedd5e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:15.650782 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa49845-b9f3-4bdd-b180-a4a0bedd5e2f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:15.752498 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1226/2415] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:56:15 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:15.753319 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e03abe-7aa0-49f9-9b82-51f2dada69c3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:15.766735 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e03abe-7aa0-49f9-9b82-51f2dada69c3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:15.848844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa22bf-7b5f-4d1d-a2f8-43d464dc96d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:15.849634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa22bf-7b5f-4d1d-a2f8-43d464dc96d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:15.850054 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa22bf-7b5f-4d1d-a2f8-43d464dc96d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:15.850333 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa22bf-7b5f-4d1d-a2f8-43d464dc96d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:15.851030 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa22bf-7b5f-4d1d-a2f8-43d464dc96d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:15.853223 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa22bf-7b5f-4d1d-a2f8-43d464dc96d6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:15.933632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1190/2416] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:56:15 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:15.942219 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa49845-b9f3-4bdd-b180-a4a0bedd5e2f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:15.950535 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa49845-b9f3-4bdd-b180-a4a0bedd5e2f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:15.955532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe871d6-5b9d-432d-a365-bc85ef69a724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:15.956375 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe871d6-5b9d-432d-a365-bc85ef69a724 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:15.956864 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe871d6-5b9d-432d-a365-bc85ef69a724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:15.957968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe871d6-5b9d-432d-a365-bc85ef69a724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:15.959295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe871d6-5b9d-432d-a365-bc85ef69a724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:15.961107 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe871d6-5b9d-432d-a365-bc85ef69a724 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:15.975362 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1227/2417] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:56:15.979646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa22bf-7b5f-4d1d-a2f8-43d464dc96d6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:15.994733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa22bf-7b5f-4d1d-a2f8-43d464dc96d6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:15.999757 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d8ec2-158d-4640-b62d-ea0c50c8625f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:16.000426 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d8ec2-158d-4640-b62d-ea0c50c8625f admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:16.000751 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d8ec2-158d-4640-b62d-ea0c50c8625f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:16.001070 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d8ec2-158d-4640-b62d-ea0c50c8625f admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:16.001808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d8ec2-158d-4640-b62d-ea0c50c8625f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:16.003437 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d8ec2-158d-4640-b62d-ea0c50c8625f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:16.020480 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1191/2418] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:56:16.022387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe871d6-5b9d-432d-a365-bc85ef69a724 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:16.035386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe871d6-5b9d-432d-a365-bc85ef69a724 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:16.042506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7dde4d-8059-463b-9ef1-0a1ddb98901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:16.043650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dde4d-8059-463b-9ef1-0a1ddb98901d admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:16.044088 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dde4d-8059-463b-9ef1-0a1ddb98901d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:16.044550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dde4d-8059-463b-9ef1-0a1ddb98901d admin admin] PATH_INFO: `/v3/projects/45e0810241334b8eb181d0bad6cffb06/users/c6b1e0024cc140139d4fc4fb1fd41dfd/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:16.073012 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7dde4d-8059-463b-9ef1-0a1ddb98901d admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e0810241334b8eb181d0bad6cffb06, user_id=c6b1e0024cc140139d4fc4fb1fd41dfd, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:16.076022 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7dde4d-8059-463b-9ef1-0a1ddb98901d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:16.139084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1228/2419] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:56:16 2022] PUT /identity/v3/projects/45e0810241334b8eb181d0bad6cffb06/users/c6b1e0024cc140139d4fc4fb1fd41dfd/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:16.150490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f81990-7ff3-43b0-8ded-3bd681861eed None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:16.151260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f81990-7ff3-43b0-8ded-3bd681861eed None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:16.151758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f81990-7ff3-43b0-8ded-3bd681861eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:16.182347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d7f81990-7ff3-43b0-8ded-3bd681861eed None None] MFA Rules not processed for user `c6b1e0024cc140139d4fc4fb1fd41dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:16.183567 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d7f81990-7ff3-43b0-8ded-3bd681861eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:16.266162 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1192/2420] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:16.271855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7dde4d-8059-463b-9ef1-0a1ddb98901d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:16.350482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7dde4d-8059-463b-9ef1-0a1ddb98901d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:16.355616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185fca9-34f0-4213-8e19-2a19e7ebd465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:16.356311 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185fca9-34f0-4213-8e19-2a19e7ebd465 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:16.356626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185fca9-34f0-4213-8e19-2a19e7ebd465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:16.356908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185fca9-34f0-4213-8e19-2a19e7ebd465 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:16.357721 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185fca9-34f0-4213-8e19-2a19e7ebd465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:16.359699 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185fca9-34f0-4213-8e19-2a19e7ebd465 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:16.589305 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1229/2421] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:56:16 2022] POST /identity/v3/projects => generated 383 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:16.593393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f81990-7ff3-43b0-8ded-3bd681861eed None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:16.606682 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f81990-7ff3-43b0-8ded-3bd681861eed None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:16.664562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5771a-ea2c-47f9-843b-ca826534097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:16.665243 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5771a-ea2c-47f9-843b-ca826534097c admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:16.665528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5771a-ea2c-47f9-843b-ca826534097c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:16.665803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5771a-ea2c-47f9-843b-ca826534097c admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:16.666502 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5771a-ea2c-47f9-843b-ca826534097c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:16.668623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5771a-ea2c-47f9-843b-ca826534097c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:16.952942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1193/2422] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:56:16 2022] POST /identity/v3/users => generated 292 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:16.957802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185fca9-34f0-4213-8e19-2a19e7ebd465 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:16.968220 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185fca9-34f0-4213-8e19-2a19e7ebd465 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:16.974980 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39296593-5d44-4ac1-be28-b1d3f61ddae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:16.980526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39296593-5d44-4ac1-be28-b1d3f61ddae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:16.980526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39296593-5d44-4ac1-be28-b1d3f61ddae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:16.980526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39296593-5d44-4ac1-be28-b1d3f61ddae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:16.980526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39296593-5d44-4ac1-be28-b1d3f61ddae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:16.980526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39296593-5d44-4ac1-be28-b1d3f61ddae2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:16.993721 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1230/2423] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:56:16.997862 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5771a-ea2c-47f9-843b-ca826534097c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:17.008084 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5771a-ea2c-47f9-843b-ca826534097c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:17.012796 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7809df0-e033-4816-aad7-d8d392c831e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:17.013460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7809df0-e033-4816-aad7-d8d392c831e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:17.019873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7809df0-e033-4816-aad7-d8d392c831e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:17.019873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7809df0-e033-4816-aad7-d8d392c831e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:17.019873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7809df0-e033-4816-aad7-d8d392c831e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:17.019873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7809df0-e033-4816-aad7-d8d392c831e2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:17.026930 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1194/2424] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:56:17.031267 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39296593-5d44-4ac1-be28-b1d3f61ddae2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:17.042794 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39296593-5d44-4ac1-be28-b1d3f61ddae2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:17.047284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2ffb2-a354-482f-be17-8a7a259c9f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:17.048150 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2ffb2-a354-482f-be17-8a7a259c9f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:17.048592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2ffb2-a354-482f-be17-8a7a259c9f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:17.048874 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2ffb2-a354-482f-be17-8a7a259c9f1d admin admin] PATH_INFO: `/v3/projects/a67e85c964d64d0f8d0cde427446dcc7/users/930a3097344a4feab91ff91aef027b06/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:17.063916 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2ffb2-a354-482f-be17-8a7a259c9f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a67e85c964d64d0f8d0cde427446dcc7, user_id=930a3097344a4feab91ff91aef027b06, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:17.067423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2ffb2-a354-482f-be17-8a7a259c9f1d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:17.166424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1231/2425] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:56:17 2022] PUT /identity/v3/projects/a67e85c964d64d0f8d0cde427446dcc7/users/930a3097344a4feab91ff91aef027b06/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:17.169759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91727b0-70dc-452e-987c-23e6692b3152 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:17.170052 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91727b0-70dc-452e-987c-23e6692b3152 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:17.170329 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91727b0-70dc-452e-987c-23e6692b3152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:17.220693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c91727b0-70dc-452e-987c-23e6692b3152 None None] MFA Rules not processed for user `930a3097344a4feab91ff91aef027b06`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:17.222104 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c91727b0-70dc-452e-987c-23e6692b3152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:17.328931 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1195/2426] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:17.330427 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2ffb2-a354-482f-be17-8a7a259c9f1d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:17.416409 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2ffb2-a354-482f-be17-8a7a259c9f1d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:17.421406 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e0252-17ca-421e-92ec-13559ba5d221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:17.422277 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e0252-17ca-421e-92ec-13559ba5d221 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:17.422683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e0252-17ca-421e-92ec-13559ba5d221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:17.422963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e0252-17ca-421e-92ec-13559ba5d221 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:17.423650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e0252-17ca-421e-92ec-13559ba5d221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:17.426238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e0252-17ca-421e-92ec-13559ba5d221 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:17.509459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1232/2427] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:56:17 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:17.513485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91727b0-70dc-452e-987c-23e6692b3152 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:17.524997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91727b0-70dc-452e-987c-23e6692b3152 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:17.594387 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3d1b2-ca5e-448f-b179-2740a3b071b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:17.595082 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3d1b2-ca5e-448f-b179-2740a3b071b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:17.595329 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3d1b2-ca5e-448f-b179-2740a3b071b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:17.595611 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3d1b2-ca5e-448f-b179-2740a3b071b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:17.596295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3d1b2-ca5e-448f-b179-2740a3b071b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:17.598946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3d1b2-ca5e-448f-b179-2740a3b071b4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:17.690825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1196/2428] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:56:17 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:17.695026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e0252-17ca-421e-92ec-13559ba5d221 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:17.706924 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e0252-17ca-421e-92ec-13559ba5d221 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:17.712057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274902a-b808-4510-a260-597c50966689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:17.713062 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274902a-b808-4510-a260-597c50966689 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:17.713347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274902a-b808-4510-a260-597c50966689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:17.713631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274902a-b808-4510-a260-597c50966689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:17.714364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274902a-b808-4510-a260-597c50966689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:17.716045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274902a-b808-4510-a260-597c50966689 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:17.728173 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1233/2429] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:56:17.734847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3d1b2-ca5e-448f-b179-2740a3b071b4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:17.746717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3d1b2-ca5e-448f-b179-2740a3b071b4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:17.751808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f0834-c167-446b-bb11-494fc6f42b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:17.752755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f0834-c167-446b-bb11-494fc6f42b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:17.753027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f0834-c167-446b-bb11-494fc6f42b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:17.753301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f0834-c167-446b-bb11-494fc6f42b4e admin admin] PATH_INFO: `/v3/projects/5e7ddde29fc5429a8038e9d2bc9e374c/users/f8336655368d43e098ea1783aae64646/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:17.772877 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f0834-c167-446b-bb11-494fc6f42b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e7ddde29fc5429a8038e9d2bc9e374c, user_id=f8336655368d43e098ea1783aae64646, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:17.775543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f0834-c167-446b-bb11-494fc6f42b4e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:17.856139 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1197/2430] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:56:17 2022] PUT /identity/v3/projects/5e7ddde29fc5429a8038e9d2bc9e374c/users/f8336655368d43e098ea1783aae64646/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:17.857114 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274902a-b808-4510-a260-597c50966689 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:17.870275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274902a-b808-4510-a260-597c50966689 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:17.945007 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282aae-e0c4-4bf1-9faa-f3559bac5690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:17.945688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282aae-e0c4-4bf1-9faa-f3559bac5690 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:17.946044 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282aae-e0c4-4bf1-9faa-f3559bac5690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:17.946386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282aae-e0c4-4bf1-9faa-f3559bac5690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:17.947394 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282aae-e0c4-4bf1-9faa-f3559bac5690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:17.949265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282aae-e0c4-4bf1-9faa-f3559bac5690 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:17.965590 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1234/2431] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:56:17.966793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f0834-c167-446b-bb11-494fc6f42b4e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:17.980412 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f0834-c167-446b-bb11-494fc6f42b4e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:17.983310 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec435fd9-136f-4f9a-a591-6332eb2937e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:17.984318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec435fd9-136f-4f9a-a591-6332eb2937e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:17.984704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec435fd9-136f-4f9a-a591-6332eb2937e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:17.985042 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec435fd9-136f-4f9a-a591-6332eb2937e2 admin admin] PATH_INFO: `/v3/projects/5e7ddde29fc5429a8038e9d2bc9e374c/users/f8336655368d43e098ea1783aae64646/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:17.987160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec435fd9-136f-4f9a-a591-6332eb2937e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e7ddde29fc5429a8038e9d2bc9e374c, user_id=f8336655368d43e098ea1783aae64646, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:17.991580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec435fd9-136f-4f9a-a591-6332eb2937e2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:18.006038 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1198/2432] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:56:17 2022] PUT /identity/v3/projects/5e7ddde29fc5429a8038e9d2bc9e374c/users/f8336655368d43e098ea1783aae64646/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:18.016180 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b4114-43b0-4831-a399-a37189d3ee87 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:18.016696 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b4114-43b0-4831-a399-a37189d3ee87 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:18.016798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b4114-43b0-4831-a399-a37189d3ee87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:18.055581 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-961b4114-43b0-4831-a399-a37189d3ee87 None None] MFA Rules not processed for user `f8336655368d43e098ea1783aae64646`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:18.056773 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-961b4114-43b0-4831-a399-a37189d3ee87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:18.151390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1235/2433] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:18.163335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec435fd9-136f-4f9a-a591-6332eb2937e2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:18.165997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ec435fd9-136f-4f9a-a591-6332eb2937e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:18.250839 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec435fd9-136f-4f9a-a591-6332eb2937e2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:18.255367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96370a-90f5-4d84-bff8-9522260010be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:18.256025 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96370a-90f5-4d84-bff8-9522260010be service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:18.256308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96370a-90f5-4d84-bff8-9522260010be service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:18.256621 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96370a-90f5-4d84-bff8-9522260010be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:18.266380 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96370a-90f5-4d84-bff8-9522260010be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:18.267825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96370a-90f5-4d84-bff8-9522260010be service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:18.280625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1199/2434] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:56:19.585648 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b4114-43b0-4831-a399-a37189d3ee87 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:19.587828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-961b4114-43b0-4831-a399-a37189d3ee87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:19.609864 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b4114-43b0-4831-a399-a37189d3ee87 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:19.614856 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fa6c7-9187-4019-a8f6-bb79368e0c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:19.616919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fa6c7-9187-4019-a8f6-bb79368e0c33 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:19.617453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fa6c7-9187-4019-a8f6-bb79368e0c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:19.617981 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fa6c7-9187-4019-a8f6-bb79368e0c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:19.709016 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fa6c7-9187-4019-a8f6-bb79368e0c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:19.713702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fa6c7-9187-4019-a8f6-bb79368e0c33 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:19.740883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1236/2435] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:56:25.070398 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96370a-90f5-4d84-bff8-9522260010be service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:25.087097 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96370a-90f5-4d84-bff8-9522260010be service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:25.091175 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150a6e2-a0d0-40bb-9fd0-4edb1f6193ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:25.091906 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150a6e2-a0d0-40bb-9fd0-4edb1f6193ba service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:25.092247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150a6e2-a0d0-40bb-9fd0-4edb1f6193ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:25.092644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150a6e2-a0d0-40bb-9fd0-4edb1f6193ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:25.148733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150a6e2-a0d0-40bb-9fd0-4edb1f6193ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:25.150079 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150a6e2-a0d0-40bb-9fd0-4edb1f6193ba service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:25.158985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1200/2436] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:56:29.647808 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cf98c-559b-45c8-bfd8-5ffd2f660b15 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:29.648345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cf98c-559b-45c8-bfd8-5ffd2f660b15 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:29.648613 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cf98c-559b-45c8-bfd8-5ffd2f660b15 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:29.649988 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1237/2437] 10.222.0.81 () {54 vars in 921 bytes} [Wed May 4 17:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:29.655926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486c617-8330-4c86-bf6b-be81553f2ddd None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:29.656370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486c617-8330-4c86-bf6b-be81553f2ddd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:29.656573 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486c617-8330-4c86-bf6b-be81553f2ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:29.675525 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8486c617-8330-4c86-bf6b-be81553f2ddd None None] MFA Rules not processed for user `d4a073d8f47a485cbb22db01530f3b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:29.676808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8486c617-8330-4c86-bf6b-be81553f2ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:29.750010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1201/2438] 10.222.0.81 () {58 vars in 1018 bytes} [Wed May 4 17:56:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:29.763074 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cf98c-559b-45c8-bfd8-5ffd2f660b15 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:29.764983 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ca2cf98c-559b-45c8-bfd8-5ffd2f660b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:29.800099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486c617-8330-4c86-bf6b-be81553f2ddd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:29.828943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cf98c-559b-45c8-bfd8-5ffd2f660b15 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:29.832776 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1900b5-f350-46fb-8c81-5026624f724c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8e2eb70a5d4dd1b3a9bec2bd0a78a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:29.833414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1900b5-f350-46fb-8c81-5026624f724c service glance] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:29.833688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1900b5-f350-46fb-8c81-5026624f724c service glance] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:29.833958 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1900b5-f350-46fb-8c81-5026624f724c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:29.844395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1900b5-f350-46fb-8c81-5026624f724c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:29.849987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1900b5-f350-46fb-8c81-5026624f724c service glance] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:29.861393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486c617-8330-4c86-bf6b-be81553f2ddd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:29.862821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1238/2439] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:56:29.867434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2557c-3b2c-4703-b0e7-a26aa0399c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:29.869751 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2557c-3b2c-4703-b0e7-a26aa0399c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:29.869751 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2557c-3b2c-4703-b0e7-a26aa0399c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:29.869751 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2557c-3b2c-4703-b0e7-a26aa0399c83 admin admin] PATH_INFO: `/v3/users/c6b1e0024cc140139d4fc4fb1fd41dfd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:29.870664 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2557c-3b2c-4703-b0e7-a26aa0399c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b1e0024cc140139d4fc4fb1fd41dfd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:29.872306 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2557c-3b2c-4703-b0e7-a26aa0399c83 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:30.070766 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-91d2557c-3b2c-4703-b0e7-a26aa0399c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b1e0024cc140139d4fc4fb1fd41dfd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:30.082615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-91d2557c-3b2c-4703-b0e7-a26aa0399c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b1e0024cc140139d4fc4fb1fd41dfd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:30.113067 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5b87-bb3c-4023-a475-b186fa0e1d47 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:30.113349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5b87-bb3c-4023-a475-b186fa0e1d47 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:30.113622 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5b87-bb3c-4023-a475-b186fa0e1d47 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:30.115066 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1239/2440] 10.222.0.81 () {54 vars in 921 bytes} [Wed May 4 17:56:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 17:56:30.119463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3d5b8-a1f7-4b92-89fe-36c366900d43 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:30.119792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3d5b8-a1f7-4b92-89fe-36c366900d43 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:30.120126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3d5b8-a1f7-4b92-89fe-36c366900d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:30.138433 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c7d3d5b8-a1f7-4b92-89fe-36c366900d43 None None] MFA Rules not processed for user `96f0feac2b384b509bc9f75b92b4df95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:30.139639 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c7d3d5b8-a1f7-4b92-89fe-36c366900d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:30.150660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-91d2557c-3b2c-4703-b0e7-a26aa0399c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b1e0024cc140139d4fc4fb1fd41dfd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:30.158218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-91d2557c-3b2c-4703-b0e7-a26aa0399c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b1e0024cc140139d4fc4fb1fd41dfd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:30.160042 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-91d2557c-3b2c-4703-b0e7-a26aa0399c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b1e0024cc140139d4fc4fb1fd41dfd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:30.165864 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1202/2441] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:56:29 2022] DELETE /identity/v3/users/c6b1e0024cc140139d4fc4fb1fd41dfd => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:56:30.170206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85be059-824f-43f0-9b7f-2560068f6895 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:30.170504 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85be059-824f-43f0-9b7f-2560068f6895 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:30.170787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85be059-824f-43f0-9b7f-2560068f6895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:30.189264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c85be059-824f-43f0-9b7f-2560068f6895 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:30.190716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c85be059-824f-43f0-9b7f-2560068f6895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:30.191974 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1240/2442] 10.222.0.81 () {58 vars in 1018 bytes} [Wed May 4 17:56:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:56:30.203823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3d5b8-a1f7-4b92-89fe-36c366900d43 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:30.205146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c7d3d5b8-a1f7-4b92-89fe-36c366900d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:30.215241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3d5b8-a1f7-4b92-89fe-36c366900d43 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:30.249076 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1203/2443] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:56:30.258663 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85be059-824f-43f0-9b7f-2560068f6895 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:30.267176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819db729-1224-4b44-9437-92d57a40eed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:30.267823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819db729-1224-4b44-9437-92d57a40eed1 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:30.268681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819db729-1224-4b44-9437-92d57a40eed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:30.268972 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819db729-1224-4b44-9437-92d57a40eed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:30.276031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819db729-1224-4b44-9437-92d57a40eed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:30.277518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819db729-1224-4b44-9437-92d57a40eed1 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:30.286129 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1241/2444] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:56:30.311925 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85be059-824f-43f0-9b7f-2560068f6895 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:30.315781 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb954a-a3fe-42c2-85ad-f8de59cd918f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:30.316425 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb954a-a3fe-42c2-85ad-f8de59cd918f service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:30.316728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb954a-a3fe-42c2-85ad-f8de59cd918f service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:30.317000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb954a-a3fe-42c2-85ad-f8de59cd918f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:30.326133 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb954a-a3fe-42c2-85ad-f8de59cd918f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:30.327569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb954a-a3fe-42c2-85ad-f8de59cd918f service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:30.341476 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1204/2445] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:56:30.370624 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d32325-c8e2-47e4-abb4-51c57ed4c309 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:30.370926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d32325-c8e2-47e4-abb4-51c57ed4c309 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:30.371206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d32325-c8e2-47e4-abb4-51c57ed4c309 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:30.372659 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1242/2446] 10.222.0.81 () {54 vars in 921 bytes} [Wed May 4 17:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 17:56:30.378840 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc5be2-1f98-463f-b441-613cae300469 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:30.379130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc5be2-1f98-463f-b441-613cae300469 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:30.379408 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc5be2-1f98-463f-b441-613cae300469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:30.398259 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a7fc5be2-1f98-463f-b441-613cae300469 None None] MFA Rules not processed for user `d4a073d8f47a485cbb22db01530f3b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:30.399469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a7fc5be2-1f98-463f-b441-613cae300469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:30.467899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1205/2447] 10.222.0.81 () {58 vars in 1018 bytes} [Wed May 4 17:56:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:56:30.479548 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d32325-c8e2-47e4-abb4-51c57ed4c309 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:30.481251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-71d32325-c8e2-47e4-abb4-51c57ed4c309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:30.494845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d32325-c8e2-47e4-abb4-51c57ed4c309 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:30.498437 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f0937-8225-4922-a6b7-d955cf270db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:30.499136 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f0937-8225-4922-a6b7-d955cf270db4 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:30.500383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f0937-8225-4922-a6b7-d955cf270db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:30.500710 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f0937-8225-4922-a6b7-d955cf270db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:30.511530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f0937-8225-4922-a6b7-d955cf270db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:30.513256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f0937-8225-4922-a6b7-d955cf270db4 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:30.524921 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1243/2448] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:56:30.781331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc5be2-1f98-463f-b441-613cae300469 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:30.783246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a7fc5be2-1f98-463f-b441-613cae300469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:30.798566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc5be2-1f98-463f-b441-613cae300469 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:30.816692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f5b71-134c-4f92-b33e-8fa12e586158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:30.816692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f5b71-134c-4f92-b33e-8fa12e586158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:30.816692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f5b71-134c-4f92-b33e-8fa12e586158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:30.816692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f5b71-134c-4f92-b33e-8fa12e586158 admin admin] PATH_INFO: `/v3/projects/45e0810241334b8eb181d0bad6cffb06` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:30.817272 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f5b71-134c-4f92-b33e-8fa12e586158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e0810241334b8eb181d0bad6cffb06)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:30.817272 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f5b71-134c-4f92-b33e-8fa12e586158 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:30.950876 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-344f5b71-134c-4f92-b33e-8fa12e586158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e0810241334b8eb181d0bad6cffb06', 'request_id': 'req-344f5b71-134c-4f92-b33e-8fa12e586158'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:30.956601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-344f5b71-134c-4f92-b33e-8fa12e586158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e0810241334b8eb181d0bad6cffb06', 'request_id': 'req-344f5b71-134c-4f92-b33e-8fa12e586158'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:31.038005 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-344f5b71-134c-4f92-b33e-8fa12e586158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e0810241334b8eb181d0bad6cffb06', 'request_id': 'req-344f5b71-134c-4f92-b33e-8fa12e586158'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:31.046644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-344f5b71-134c-4f92-b33e-8fa12e586158 admin admin] The token cache is being invalidate because project 45e0810241334b8eb181d0bad6cffb06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:56:31.046935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-344f5b71-134c-4f92-b33e-8fa12e586158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:31.047576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-344f5b71-134c-4f92-b33e-8fa12e586158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:31.049786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1206/2449] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:56:30 2022] DELETE /identity/v3/projects/45e0810241334b8eb181d0bad6cffb06 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:31.053912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f0937-8225-4922-a6b7-d955cf270db4 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:31.064291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f0937-8225-4922-a6b7-d955cf270db4 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:31.125714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71402543-dc92-4343-80a7-473472c0e964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:31.126818 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71402543-dc92-4343-80a7-473472c0e964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:31.126968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71402543-dc92-4343-80a7-473472c0e964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:31.127264 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71402543-dc92-4343-80a7-473472c0e964 admin admin] PATH_INFO: `/v3/users/930a3097344a4feab91ff91aef027b06` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:31.129143 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71402543-dc92-4343-80a7-473472c0e964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=930a3097344a4feab91ff91aef027b06)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:31.131063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71402543-dc92-4343-80a7-473472c0e964 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:31.340482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-71402543-dc92-4343-80a7-473472c0e964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '930a3097344a4feab91ff91aef027b06'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:31.451251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-71402543-dc92-4343-80a7-473472c0e964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '930a3097344a4feab91ff91aef027b06'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:31.451892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-71402543-dc92-4343-80a7-473472c0e964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '930a3097344a4feab91ff91aef027b06'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:31.460381 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-71402543-dc92-4343-80a7-473472c0e964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '930a3097344a4feab91ff91aef027b06'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:31.472407 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-71402543-dc92-4343-80a7-473472c0e964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '930a3097344a4feab91ff91aef027b06'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:31.478373 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1244/2450] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:56:31 2022] DELETE /identity/v3/users/930a3097344a4feab91ff91aef027b06 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:31.993343 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f5b71-134c-4f92-b33e-8fa12e586158 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:31.995703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-344f5b71-134c-4f92-b33e-8fa12e586158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:32.027939 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f5b71-134c-4f92-b33e-8fa12e586158 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:32.089644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c322656-9fdf-4904-9265-493b8310f619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:32.091510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c322656-9fdf-4904-9265-493b8310f619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:32.091510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c322656-9fdf-4904-9265-493b8310f619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:32.091510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c322656-9fdf-4904-9265-493b8310f619 admin admin] PATH_INFO: `/v3/projects/a67e85c964d64d0f8d0cde427446dcc7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:32.092408 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c322656-9fdf-4904-9265-493b8310f619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a67e85c964d64d0f8d0cde427446dcc7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:32.094430 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c322656-9fdf-4904-9265-493b8310f619 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:32.211661 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c322656-9fdf-4904-9265-493b8310f619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a67e85c964d64d0f8d0cde427446dcc7', 'request_id': 'req-6c322656-9fdf-4904-9265-493b8310f619'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:32.217873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c322656-9fdf-4904-9265-493b8310f619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a67e85c964d64d0f8d0cde427446dcc7', 'request_id': 'req-6c322656-9fdf-4904-9265-493b8310f619'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:32.321710 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c322656-9fdf-4904-9265-493b8310f619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a67e85c964d64d0f8d0cde427446dcc7', 'request_id': 'req-6c322656-9fdf-4904-9265-493b8310f619'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:32.334927 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c322656-9fdf-4904-9265-493b8310f619 admin admin] The token cache is being invalidate because project a67e85c964d64d0f8d0cde427446dcc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:56:32.335236 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c322656-9fdf-4904-9265-493b8310f619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:32.336041 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c322656-9fdf-4904-9265-493b8310f619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:32.337974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1207/2451] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:56:31 2022] DELETE /identity/v3/projects/a67e85c964d64d0f8d0cde427446dcc7 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:32.341922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71402543-dc92-4343-80a7-473472c0e964 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:32.343439 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-71402543-dc92-4343-80a7-473472c0e964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:32.356573 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71402543-dc92-4343-80a7-473472c0e964 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:32.430294 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7c1ae-68fc-4f84-986c-5f01ff8aa00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:32.431203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7c1ae-68fc-4f84-986c-5f01ff8aa00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:32.431480 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7c1ae-68fc-4f84-986c-5f01ff8aa00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:32.431756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7c1ae-68fc-4f84-986c-5f01ff8aa00b admin admin] PATH_INFO: `/v3/users/f8336655368d43e098ea1783aae64646` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:32.432978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7c1ae-68fc-4f84-986c-5f01ff8aa00b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8336655368d43e098ea1783aae64646)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:32.434934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7c1ae-68fc-4f84-986c-5f01ff8aa00b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:32.650510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-44d7c1ae-68fc-4f84-986c-5f01ff8aa00b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8336655368d43e098ea1783aae64646'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:32.722263 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-44d7c1ae-68fc-4f84-986c-5f01ff8aa00b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8336655368d43e098ea1783aae64646'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:32.723149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-44d7c1ae-68fc-4f84-986c-5f01ff8aa00b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8336655368d43e098ea1783aae64646'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:32.731334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-44d7c1ae-68fc-4f84-986c-5f01ff8aa00b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8336655368d43e098ea1783aae64646'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:32.744323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-44d7c1ae-68fc-4f84-986c-5f01ff8aa00b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8336655368d43e098ea1783aae64646'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:32.750372 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1245/2452] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:56:32 2022] DELETE /identity/v3/users/f8336655368d43e098ea1783aae64646 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:33.357324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c322656-9fdf-4904-9265-493b8310f619 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:33.358905 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6c322656-9fdf-4904-9265-493b8310f619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:33.373243 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c322656-9fdf-4904-9265-493b8310f619 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:33.437005 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527276a0-065f-456d-9b78-ff579e4f3557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:33.437952 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527276a0-065f-456d-9b78-ff579e4f3557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:33.438497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527276a0-065f-456d-9b78-ff579e4f3557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:33.438776 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527276a0-065f-456d-9b78-ff579e4f3557 admin admin] PATH_INFO: `/v3/projects/5e7ddde29fc5429a8038e9d2bc9e374c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:33.441269 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527276a0-065f-456d-9b78-ff579e4f3557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e7ddde29fc5429a8038e9d2bc9e374c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:33.444687 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527276a0-065f-456d-9b78-ff579e4f3557 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:33.569756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-527276a0-065f-456d-9b78-ff579e4f3557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e7ddde29fc5429a8038e9d2bc9e374c', 'request_id': 'req-527276a0-065f-456d-9b78-ff579e4f3557'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:33.575231 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-527276a0-065f-456d-9b78-ff579e4f3557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e7ddde29fc5429a8038e9d2bc9e374c', 'request_id': 'req-527276a0-065f-456d-9b78-ff579e4f3557'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:33.636010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-527276a0-065f-456d-9b78-ff579e4f3557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e7ddde29fc5429a8038e9d2bc9e374c', 'request_id': 'req-527276a0-065f-456d-9b78-ff579e4f3557'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:33.650393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-527276a0-065f-456d-9b78-ff579e4f3557 admin admin] The token cache is being invalidate because project 5e7ddde29fc5429a8038e9d2bc9e374c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:56:33.650687 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-527276a0-065f-456d-9b78-ff579e4f3557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:33.651488 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-527276a0-065f-456d-9b78-ff579e4f3557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:33.653111 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1208/2453] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:56:33 2022] DELETE /identity/v3/projects/5e7ddde29fc5429a8038e9d2bc9e374c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:33.659137 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce4579-fc9d-4b92-b800-2e341caf881a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:33.659622 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce4579-fc9d-4b92-b800-2e341caf881a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:33.659787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce4579-fc9d-4b92-b800-2e341caf881a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:33.693804 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-dfce4579-fc9d-4b92-b800-2e341caf881a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:33.695286 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dfce4579-fc9d-4b92-b800-2e341caf881a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:33.766177 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1246/2454] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:33.776771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e9a93-ebbb-464f-94a7-ff16e47a7f1f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:33.777065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e9a93-ebbb-464f-94a7-ff16e47a7f1f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:33.780880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e9a93-ebbb-464f-94a7-ff16e47a7f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:33.798215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-660e9a93-ebbb-464f-94a7-ff16e47a7f1f None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:33.799668 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-660e9a93-ebbb-464f-94a7-ff16e47a7f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:33.810102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1209/2455] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:33.820338 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce4579-fc9d-4b92-b800-2e341caf881a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:33.837591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce4579-fc9d-4b92-b800-2e341caf881a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:33.844491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf8cbd-126f-45d5-aa5a-aa0412adcfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:33.852614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf8cbd-126f-45d5-aa5a-aa0412adcfaa admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:33.853559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf8cbd-126f-45d5-aa5a-aa0412adcfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:33.853559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf8cbd-126f-45d5-aa5a-aa0412adcfaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:33.854388 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf8cbd-126f-45d5-aa5a-aa0412adcfaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:33.854880 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf8cbd-126f-45d5-aa5a-aa0412adcfaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:33.856614 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf8cbd-126f-45d5-aa5a-aa0412adcfaa admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:33.888555 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e9a93-ebbb-464f-94a7-ff16e47a7f1f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:33.889416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1247/2456] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:33.902565 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e9a93-ebbb-464f-94a7-ff16e47a7f1f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:33.910757 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c249f4-58ab-4465-bd34-e3547cda9d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:33.911668 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c249f4-58ab-4465-bd34-e3547cda9d07 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:33.912282 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c249f4-58ab-4465-bd34-e3547cda9d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:33.912750 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c249f4-58ab-4465-bd34-e3547cda9d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:33.913927 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c249f4-58ab-4465-bd34-e3547cda9d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:33.914930 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1394fd0-aaca-4a93-925b-3a1eba083d5f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:33.915230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1394fd0-aaca-4a93-925b-3a1eba083d5f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:33.915513 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1394fd0-aaca-4a93-925b-3a1eba083d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:33.916602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c249f4-58ab-4465-bd34-e3547cda9d07 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:33.937402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b1394fd0-aaca-4a93-925b-3a1eba083d5f None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:33.938983 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b1394fd0-aaca-4a93-925b-3a1eba083d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:34.015506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1248/2457] 10.222.0.81 () {58 vars in 1009 bytes} [Wed May 4 17:56:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:34.028840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1394fd0-aaca-4a93-925b-3a1eba083d5f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.031963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b1394fd0-aaca-4a93-925b-3a1eba083d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:34.058009 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1210/2458] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:56:33 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:34.063221 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c249f4-58ab-4465-bd34-e3547cda9d07 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.114596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1394fd0-aaca-4a93-925b-3a1eba083d5f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.132105 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c249f4-58ab-4465-bd34-e3547cda9d07 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.137158 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa994ba9-9bde-4227-af5d-9cf3cc7ede3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.137925 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa994ba9-9bde-4227-af5d-9cf3cc7ede3c admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.138278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa994ba9-9bde-4227-af5d-9cf3cc7ede3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.138624 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa994ba9-9bde-4227-af5d-9cf3cc7ede3c admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.139388 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa994ba9-9bde-4227-af5d-9cf3cc7ede3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:34.141519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa994ba9-9bde-4227-af5d-9cf3cc7ede3c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:34.175352 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0108c52-5d3b-48ec-a163-ec5bdab16eab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.176015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0108c52-5d3b-48ec-a163-ec5bdab16eab service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.176316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0108c52-5d3b-48ec-a163-ec5bdab16eab service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.176604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0108c52-5d3b-48ec-a163-ec5bdab16eab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.236780 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0108c52-5d3b-48ec-a163-ec5bdab16eab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:34.238602 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0108c52-5d3b-48ec-a163-ec5bdab16eab service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:34.246866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1249/2459] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 17:56:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 17:56:34.268933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1211/2460] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:56:34 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:34.273069 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0108c52-5d3b-48ec-a163-ec5bdab16eab service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.284426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0108c52-5d3b-48ec-a163-ec5bdab16eab service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.289412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24017e24-daa9-4b48-8fc2-789b36ecb19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.290199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24017e24-daa9-4b48-8fc2-789b36ecb19a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.294176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24017e24-daa9-4b48-8fc2-789b36ecb19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.294176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24017e24-daa9-4b48-8fc2-789b36ecb19a admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.294176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24017e24-daa9-4b48-8fc2-789b36ecb19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:34.294176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24017e24-daa9-4b48-8fc2-789b36ecb19a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:34.303326 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1250/2461] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:56:34.307295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa994ba9-9bde-4227-af5d-9cf3cc7ede3c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.318261 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa994ba9-9bde-4227-af5d-9cf3cc7ede3c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.327602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b920439-606e-46b7-a8bc-5c5ff8d6ff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.328327 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b920439-606e-46b7-a8bc-5c5ff8d6ff01 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.328657 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b920439-606e-46b7-a8bc-5c5ff8d6ff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.328953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b920439-606e-46b7-a8bc-5c5ff8d6ff01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.330334 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b920439-606e-46b7-a8bc-5c5ff8d6ff01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:34.332282 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b920439-606e-46b7-a8bc-5c5ff8d6ff01 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:34.342866 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1212/2462] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:56:34.347819 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24017e24-daa9-4b48-8fc2-789b36ecb19a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.357676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24017e24-daa9-4b48-8fc2-789b36ecb19a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.362496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8691a-73d7-46c5-b9b3-d86330b715f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.363408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8691a-73d7-46c5-b9b3-d86330b715f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.363671 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8691a-73d7-46c5-b9b3-d86330b715f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.363912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8691a-73d7-46c5-b9b3-d86330b715f9 admin admin] PATH_INFO: `/v3/projects/74dd469fdec84af6a577d6c3f2e4c53f/users/8b4f69218f2f4056ae2310d8bbcda967/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.380562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8691a-73d7-46c5-b9b3-d86330b715f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74dd469fdec84af6a577d6c3f2e4c53f, user_id=8b4f69218f2f4056ae2310d8bbcda967, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:34.383477 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8691a-73d7-46c5-b9b3-d86330b715f9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:34.472612 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1251/2463] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:56:34 2022] PUT /identity/v3/projects/74dd469fdec84af6a577d6c3f2e4c53f/users/8b4f69218f2f4056ae2310d8bbcda967/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:34.485489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500983-7c4c-47bc-a478-20530274f04c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.486858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500983-7c4c-47bc-a478-20530274f04c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.487512 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500983-7c4c-47bc-a478-20530274f04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.566692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b1500983-7c4c-47bc-a478-20530274f04c None None] MFA Rules not processed for user `8b4f69218f2f4056ae2310d8bbcda967`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:34.568387 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b1500983-7c4c-47bc-a478-20530274f04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:34.663311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1213/2464] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:34.667644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8691a-73d7-46c5-b9b3-d86330b715f9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.758505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8691a-73d7-46c5-b9b3-d86330b715f9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.764316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27367cf2-7a81-4821-bd3a-d0e0662c3815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.765210 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27367cf2-7a81-4821-bd3a-d0e0662c3815 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.766121 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27367cf2-7a81-4821-bd3a-d0e0662c3815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.766569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27367cf2-7a81-4821-bd3a-d0e0662c3815 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.768043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27367cf2-7a81-4821-bd3a-d0e0662c3815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:34.770305 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27367cf2-7a81-4821-bd3a-d0e0662c3815 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:34.879223 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1252/2465] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:56:34 2022] POST /identity/v3/projects => generated 389 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:56:34.880333 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500983-7c4c-47bc-a478-20530274f04c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:34.893204 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500983-7c4c-47bc-a478-20530274f04c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:34.956771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d04fa-d3f3-437d-909e-5601854e7b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:34.957651 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d04fa-d3f3-437d-909e-5601854e7b4d admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:34.958133 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d04fa-d3f3-437d-909e-5601854e7b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:34.958582 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d04fa-d3f3-437d-909e-5601854e7b4d admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:34.959493 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d04fa-d3f3-437d-909e-5601854e7b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:34.961517 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d04fa-d3f3-437d-909e-5601854e7b4d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:35.068474 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1214/2466] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:56:34 2022] POST /identity/v3/users => generated 301 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:35.072113 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27367cf2-7a81-4821-bd3a-d0e0662c3815 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:35.088142 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27367cf2-7a81-4821-bd3a-d0e0662c3815 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:35.109232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b407484-8165-43c7-8bdd-fe31ac4c2d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:35.109970 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b407484-8165-43c7-8bdd-fe31ac4c2d53 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:35.110250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b407484-8165-43c7-8bdd-fe31ac4c2d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:35.110521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b407484-8165-43c7-8bdd-fe31ac4c2d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:35.111822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b407484-8165-43c7-8bdd-fe31ac4c2d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:35.113484 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b407484-8165-43c7-8bdd-fe31ac4c2d53 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:35.136035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1253/2467] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:56:35.140187 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d04fa-d3f3-437d-909e-5601854e7b4d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:35.151682 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d04fa-d3f3-437d-909e-5601854e7b4d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:35.157260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099ec8d-a065-4e47-8fbf-b3dfee0d39a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:35.158823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099ec8d-a065-4e47-8fbf-b3dfee0d39a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:35.159108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099ec8d-a065-4e47-8fbf-b3dfee0d39a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:35.159384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099ec8d-a065-4e47-8fbf-b3dfee0d39a8 admin admin] PATH_INFO: `/v3/projects/c461b462ff30437c9be17e347658b7cd/users/9063d38074a0459884ef6eba8e853c37/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:35.178476 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099ec8d-a065-4e47-8fbf-b3dfee0d39a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c461b462ff30437c9be17e347658b7cd, user_id=9063d38074a0459884ef6eba8e853c37, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:35.181186 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099ec8d-a065-4e47-8fbf-b3dfee0d39a8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:35.275208 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1215/2468] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:56:35 2022] PUT /identity/v3/projects/c461b462ff30437c9be17e347658b7cd/users/9063d38074a0459884ef6eba8e853c37/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:56:35.275749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b407484-8165-43c7-8bdd-fe31ac4c2d53 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:35.287126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b407484-8165-43c7-8bdd-fe31ac4c2d53 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:35.405063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29636b31-37f5-4790-bd22-eaf1cf4ef817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:35.406650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29636b31-37f5-4790-bd22-eaf1cf4ef817 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:35.406926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29636b31-37f5-4790-bd22-eaf1cf4ef817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:35.408611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29636b31-37f5-4790-bd22-eaf1cf4ef817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:35.412764 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29636b31-37f5-4790-bd22-eaf1cf4ef817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:35.412764 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29636b31-37f5-4790-bd22-eaf1cf4ef817 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:35.425608 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1254/2469] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:56:35.426804 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099ec8d-a065-4e47-8fbf-b3dfee0d39a8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:35.438356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099ec8d-a065-4e47-8fbf-b3dfee0d39a8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:35.444677 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c63c21-1c5d-40fc-bd81-354c01e3f93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:35.445879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c63c21-1c5d-40fc-bd81-354c01e3f93c admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:35.446321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c63c21-1c5d-40fc-bd81-354c01e3f93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:35.457187 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c63c21-1c5d-40fc-bd81-354c01e3f93c admin admin] PATH_INFO: `/v3/projects/c461b462ff30437c9be17e347658b7cd/users/9063d38074a0459884ef6eba8e853c37/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:35.460293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c63c21-1c5d-40fc-bd81-354c01e3f93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c461b462ff30437c9be17e347658b7cd, user_id=9063d38074a0459884ef6eba8e853c37, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:35.463363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c63c21-1c5d-40fc-bd81-354c01e3f93c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:35.482816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1216/2470] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:56:35 2022] PUT /identity/v3/projects/c461b462ff30437c9be17e347658b7cd/users/9063d38074a0459884ef6eba8e853c37/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:56:35.493750 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569150a-4f5b-475f-9ddb-68cfe81b8fdf None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:35.494043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569150a-4f5b-475f-9ddb-68cfe81b8fdf None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:35.494324 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569150a-4f5b-475f-9ddb-68cfe81b8fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:35.533731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4569150a-4f5b-475f-9ddb-68cfe81b8fdf None None] MFA Rules not processed for user `9063d38074a0459884ef6eba8e853c37`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:35.536156 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4569150a-4f5b-475f-9ddb-68cfe81b8fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:35.651132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1255/2471] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:35.668303 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c63c21-1c5d-40fc-bd81-354c01e3f93c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:35.670124 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-33c63c21-1c5d-40fc-bd81-354c01e3f93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:35.768382 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c63c21-1c5d-40fc-bd81-354c01e3f93c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:35.773099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a2e75-5a0b-4476-888f-3fbcc1d9ef91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:35.773783 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a2e75-5a0b-4476-888f-3fbcc1d9ef91 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:35.774069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a2e75-5a0b-4476-888f-3fbcc1d9ef91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:35.777435 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a2e75-5a0b-4476-888f-3fbcc1d9ef91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:35.809015 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a2e75-5a0b-4476-888f-3fbcc1d9ef91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:35.809717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a2e75-5a0b-4476-888f-3fbcc1d9ef91 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:35.844750 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1217/2472] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:56:36.007457 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569150a-4f5b-475f-9ddb-68cfe81b8fdf None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:36.085974 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569150a-4f5b-475f-9ddb-68cfe81b8fdf None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:36.091065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5d3c6-c3d8-454b-9d55-716ad45dab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:36.092145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5d3c6-c3d8-454b-9d55-716ad45dab23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:36.092666 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5d3c6-c3d8-454b-9d55-716ad45dab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:36.093124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5d3c6-c3d8-454b-9d55-716ad45dab23 admin admin] PATH_INFO: `/v3/users/8b4f69218f2f4056ae2310d8bbcda967` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:36.094516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5d3c6-c3d8-454b-9d55-716ad45dab23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b4f69218f2f4056ae2310d8bbcda967)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:36.096834 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5d3c6-c3d8-454b-9d55-716ad45dab23 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:36.354229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e4e5d3c6-c3d8-454b-9d55-716ad45dab23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b4f69218f2f4056ae2310d8bbcda967'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:36.445163 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e4e5d3c6-c3d8-454b-9d55-716ad45dab23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b4f69218f2f4056ae2310d8bbcda967'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:36.445874 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e4e5d3c6-c3d8-454b-9d55-716ad45dab23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b4f69218f2f4056ae2310d8bbcda967'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:36.454140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e4e5d3c6-c3d8-454b-9d55-716ad45dab23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b4f69218f2f4056ae2310d8bbcda967'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:36.477296 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e4e5d3c6-c3d8-454b-9d55-716ad45dab23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b4f69218f2f4056ae2310d8bbcda967'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:36.490246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1256/2473] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:56:36 2022] DELETE /identity/v3/users/8b4f69218f2f4056ae2310d8bbcda967 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:36.495038 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdbe42-7a77-4e2c-98b7-baba69718c0f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:36.495351 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdbe42-7a77-4e2c-98b7-baba69718c0f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:36.495618 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdbe42-7a77-4e2c-98b7-baba69718c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:36.520415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6acdbe42-7a77-4e2c-98b7-baba69718c0f None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:36.521731 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6acdbe42-7a77-4e2c-98b7-baba69718c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:36.636004 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1218/2474] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:36.636656 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5d3c6-c3d8-454b-9d55-716ad45dab23 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:36.636656 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e4e5d3c6-c3d8-454b-9d55-716ad45dab23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:36.705150 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5d3c6-c3d8-454b-9d55-716ad45dab23 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:36.714732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e04c4a-039c-4722-a37c-fe6a2b187d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:36.715552 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e04c4a-039c-4722-a37c-fe6a2b187d0d service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:36.715892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e04c4a-039c-4722-a37c-fe6a2b187d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:36.716411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e04c4a-039c-4722-a37c-fe6a2b187d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:36.728918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e04c4a-039c-4722-a37c-fe6a2b187d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:36.730490 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e04c4a-039c-4722-a37c-fe6a2b187d0d service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:36.745994 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1257/2475] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:56:37.337556 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdbe42-7a77-4e2c-98b7-baba69718c0f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:37.339108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6acdbe42-7a77-4e2c-98b7-baba69718c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:37.357682 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdbe42-7a77-4e2c-98b7-baba69718c0f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:37.364247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484205b-c5e3-4d82-8fe5-269a1d171174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:37.365606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484205b-c5e3-4d82-8fe5-269a1d171174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:37.365934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484205b-c5e3-4d82-8fe5-269a1d171174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:37.366219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484205b-c5e3-4d82-8fe5-269a1d171174 admin admin] PATH_INFO: `/v3/projects/74dd469fdec84af6a577d6c3f2e4c53f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:37.368089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484205b-c5e3-4d82-8fe5-269a1d171174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74dd469fdec84af6a577d6c3f2e4c53f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:37.370100 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484205b-c5e3-4d82-8fe5-269a1d171174 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:37.476746 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9484205b-c5e3-4d82-8fe5-269a1d171174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74dd469fdec84af6a577d6c3f2e4c53f', 'request_id': 'req-9484205b-c5e3-4d82-8fe5-269a1d171174'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:37.482074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9484205b-c5e3-4d82-8fe5-269a1d171174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74dd469fdec84af6a577d6c3f2e4c53f', 'request_id': 'req-9484205b-c5e3-4d82-8fe5-269a1d171174'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:37.582579 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9484205b-c5e3-4d82-8fe5-269a1d171174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74dd469fdec84af6a577d6c3f2e4c53f', 'request_id': 'req-9484205b-c5e3-4d82-8fe5-269a1d171174'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:37.598607 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9484205b-c5e3-4d82-8fe5-269a1d171174 admin admin] The token cache is being invalidate because project 74dd469fdec84af6a577d6c3f2e4c53f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:56:37.599034 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9484205b-c5e3-4d82-8fe5-269a1d171174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:37.600005 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9484205b-c5e3-4d82-8fe5-269a1d171174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:37.604848 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1219/2476] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:56:37 2022] DELETE /identity/v3/projects/74dd469fdec84af6a577d6c3f2e4c53f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:37.605980 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e04c4a-039c-4722-a37c-fe6a2b187d0d service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:37.617827 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e04c4a-039c-4722-a37c-fe6a2b187d0d service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:37.706631 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752aaf0-06cf-43e2-a8a4-6c63c3656e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:37.709898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752aaf0-06cf-43e2-a8a4-6c63c3656e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:37.709898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752aaf0-06cf-43e2-a8a4-6c63c3656e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:37.709898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752aaf0-06cf-43e2-a8a4-6c63c3656e24 admin admin] PATH_INFO: `/v3/users/9063d38074a0459884ef6eba8e853c37` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:37.709898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752aaf0-06cf-43e2-a8a4-6c63c3656e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9063d38074a0459884ef6eba8e853c37)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:37.711543 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752aaf0-06cf-43e2-a8a4-6c63c3656e24 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:37.969519 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c752aaf0-06cf-43e2-a8a4-6c63c3656e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9063d38074a0459884ef6eba8e853c37'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:38.029018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484205b-c5e3-4d82-8fe5-269a1d171174 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:38.030416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9484205b-c5e3-4d82-8fe5-269a1d171174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:38.045763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c752aaf0-06cf-43e2-a8a4-6c63c3656e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9063d38074a0459884ef6eba8e853c37'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:38.046620 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c752aaf0-06cf-43e2-a8a4-6c63c3656e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9063d38074a0459884ef6eba8e853c37'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:38.055811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c752aaf0-06cf-43e2-a8a4-6c63c3656e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9063d38074a0459884ef6eba8e853c37'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:38.071555 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c752aaf0-06cf-43e2-a8a4-6c63c3656e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9063d38074a0459884ef6eba8e853c37'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:38.087360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1258/2477] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:56:37 2022] DELETE /identity/v3/users/9063d38074a0459884ef6eba8e853c37 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:38.125667 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484205b-c5e3-4d82-8fe5-269a1d171174 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:38.192989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0964a9-a73f-4bf2-b6fd-0635615fcd66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:38.193998 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0964a9-a73f-4bf2-b6fd-0635615fcd66 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:38.194332 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0964a9-a73f-4bf2-b6fd-0635615fcd66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:38.194716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0964a9-a73f-4bf2-b6fd-0635615fcd66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:38.196910 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4d0964a9-a73f-4bf2-b6fd-0635615fcd66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:38.268991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0964a9-a73f-4bf2-b6fd-0635615fcd66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:38.272628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0964a9-a73f-4bf2-b6fd-0635615fcd66 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:38.286784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1220/2478] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:56:38.632237 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752aaf0-06cf-43e2-a8a4-6c63c3656e24 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:38.635446 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c752aaf0-06cf-43e2-a8a4-6c63c3656e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:38.726059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752aaf0-06cf-43e2-a8a4-6c63c3656e24 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:38.732117 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305de70-eecf-4cfb-adb4-cc349b055fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:38.733065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305de70-eecf-4cfb-adb4-cc349b055fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:38.733345 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305de70-eecf-4cfb-adb4-cc349b055fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:38.733685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305de70-eecf-4cfb-adb4-cc349b055fef admin admin] PATH_INFO: `/v3/projects/c461b462ff30437c9be17e347658b7cd` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:38.735075 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305de70-eecf-4cfb-adb4-cc349b055fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c461b462ff30437c9be17e347658b7cd)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:38.737096 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305de70-eecf-4cfb-adb4-cc349b055fef admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:38.855633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1305de70-eecf-4cfb-adb4-cc349b055fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c461b462ff30437c9be17e347658b7cd', 'request_id': 'req-1305de70-eecf-4cfb-adb4-cc349b055fef'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:38.861915 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1305de70-eecf-4cfb-adb4-cc349b055fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c461b462ff30437c9be17e347658b7cd', 'request_id': 'req-1305de70-eecf-4cfb-adb4-cc349b055fef'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:38.869409 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1305de70-eecf-4cfb-adb4-cc349b055fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c461b462ff30437c9be17e347658b7cd', 'request_id': 'req-1305de70-eecf-4cfb-adb4-cc349b055fef'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:38.979846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1305de70-eecf-4cfb-adb4-cc349b055fef admin admin] The token cache is being invalidate because project c461b462ff30437c9be17e347658b7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:56:38.979846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1305de70-eecf-4cfb-adb4-cc349b055fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:38.979846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1305de70-eecf-4cfb-adb4-cc349b055fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:38.980524 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1259/2479] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:56:38 2022] DELETE /identity/v3/projects/c461b462ff30437c9be17e347658b7cd => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:38.987679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933fef8-8f28-4ea8-8641-52332f1246ae None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:38.988260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933fef8-8f28-4ea8-8641-52332f1246ae None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:38.988260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933fef8-8f28-4ea8-8641-52332f1246ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:39.020693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7933fef8-8f28-4ea8-8641-52332f1246ae None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:39.022144 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7933fef8-8f28-4ea8-8641-52332f1246ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:39.115563 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1221/2480] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:39.124664 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096584e-0568-4ef0-b76b-45e5be842dd9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:39.125030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096584e-0568-4ef0-b76b-45e5be842dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:39.125313 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096584e-0568-4ef0-b76b-45e5be842dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:39.145775 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d096584e-0568-4ef0-b76b-45e5be842dd9 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:39.147049 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d096584e-0568-4ef0-b76b-45e5be842dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:39.167604 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1260/2481] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:39.172093 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933fef8-8f28-4ea8-8641-52332f1246ae None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:39.184818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933fef8-8f28-4ea8-8641-52332f1246ae None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:39.190811 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f7aba-e047-43d3-b6e7-e185fd5674b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:39.191477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f7aba-e047-43d3-b6e7-e185fd5674b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:39.191757 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f7aba-e047-43d3-b6e7-e185fd5674b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:39.192036 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f7aba-e047-43d3-b6e7-e185fd5674b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:39.192829 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f7aba-e047-43d3-b6e7-e185fd5674b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:39.193136 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f7aba-e047-43d3-b6e7-e185fd5674b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:39.194732 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f7aba-e047-43d3-b6e7-e185fd5674b9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:39.208253 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1222/2482] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:39.212561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096584e-0568-4ef0-b76b-45e5be842dd9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:39.222906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096584e-0568-4ef0-b76b-45e5be842dd9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:39.228179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0dafa-d166-460e-a91a-d14bd6324c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:39.228863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0dafa-d166-460e-a91a-d14bd6324c2d admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:39.229141 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0dafa-d166-460e-a91a-d14bd6324c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:39.229411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0dafa-d166-460e-a91a-d14bd6324c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:39.230102 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0dafa-d166-460e-a91a-d14bd6324c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:39.232000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0dafa-d166-460e-a91a-d14bd6324c2d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:39.419642 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1261/2483] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:56:39 2022] POST /identity/v3/projects => generated 383 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:56:39.421276 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f7aba-e047-43d3-b6e7-e185fd5674b9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:39.434040 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f7aba-e047-43d3-b6e7-e185fd5674b9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:39.506390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d98b59-e6f0-4f7c-b391-f84f2076eb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:39.507163 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d98b59-e6f0-4f7c-b391-f84f2076eb0e admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:39.507520 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d98b59-e6f0-4f7c-b391-f84f2076eb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:39.507870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d98b59-e6f0-4f7c-b391-f84f2076eb0e admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:39.508679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d98b59-e6f0-4f7c-b391-f84f2076eb0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:39.510797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d98b59-e6f0-4f7c-b391-f84f2076eb0e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:39.598637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1223/2484] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:56:39 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:39.603295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0dafa-d166-460e-a91a-d14bd6324c2d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:39.627354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0dafa-d166-460e-a91a-d14bd6324c2d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:39.632337 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ba1a8-94b0-46ea-987e-b19021e5a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:39.633119 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ba1a8-94b0-46ea-987e-b19021e5a059 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:39.633340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ba1a8-94b0-46ea-987e-b19021e5a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:39.633593 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ba1a8-94b0-46ea-987e-b19021e5a059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:39.634353 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ba1a8-94b0-46ea-987e-b19021e5a059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:39.636174 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ba1a8-94b0-46ea-987e-b19021e5a059 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:39.648821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1262/2485] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:56:39.652842 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d98b59-e6f0-4f7c-b391-f84f2076eb0e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:39.664545 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d98b59-e6f0-4f7c-b391-f84f2076eb0e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:39.669768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb697ad-9f38-401c-b123-5e3b3a5c1038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:39.670454 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb697ad-9f38-401c-b123-5e3b3a5c1038 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:39.670740 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb697ad-9f38-401c-b123-5e3b3a5c1038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:39.671017 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb697ad-9f38-401c-b123-5e3b3a5c1038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:39.671757 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb697ad-9f38-401c-b123-5e3b3a5c1038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:39.674061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb697ad-9f38-401c-b123-5e3b3a5c1038 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:39.684807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1224/2486] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:56:39.689120 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ba1a8-94b0-46ea-987e-b19021e5a059 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:39.699488 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ba1a8-94b0-46ea-987e-b19021e5a059 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:39.715946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf663358-75dc-4c2d-97a8-afe235de91d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:39.715946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf663358-75dc-4c2d-97a8-afe235de91d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:39.715946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf663358-75dc-4c2d-97a8-afe235de91d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:39.715946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf663358-75dc-4c2d-97a8-afe235de91d8 admin admin] PATH_INFO: `/v3/projects/1c807b50a83546449bef31969af5ae6e/users/d82ff3726a7d4d7ea4de026bee1e1be7/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:39.724628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fde814-06c7-4559-aea5-7179fa6a2c2e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:39.725014 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fde814-06c7-4559-aea5-7179fa6a2c2e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:39.725335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fde814-06c7-4559-aea5-7179fa6a2c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:39.731853 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf663358-75dc-4c2d-97a8-afe235de91d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c807b50a83546449bef31969af5ae6e, user_id=d82ff3726a7d4d7ea4de026bee1e1be7, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:39.735149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf663358-75dc-4c2d-97a8-afe235de91d8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:39.744708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b9fde814-06c7-4559-aea5-7179fa6a2c2e None None] MFA Rules not processed for user `546c3447688f473fb256f4bc3dd99188`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:39.745933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b9fde814-06c7-4559-aea5-7179fa6a2c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:39.804379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1225/2487] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:56:39.881959 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1263/2488] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:56:39 2022] PUT /identity/v3/projects/1c807b50a83546449bef31969af5ae6e/users/d82ff3726a7d4d7ea4de026bee1e1be7/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:39.899135 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2eacd-8a9d-49f2-9a04-5b722e6c351a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:39.899474 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2eacd-8a9d-49f2-9a04-5b722e6c351a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:39.899760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2eacd-8a9d-49f2-9a04-5b722e6c351a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:39.934812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-08a2eacd-8a9d-49f2-9a04-5b722e6c351a None None] MFA Rules not processed for user `d82ff3726a7d4d7ea4de026bee1e1be7`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:39.936074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-08a2eacd-8a9d-49f2-9a04-5b722e6c351a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:40.012889 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1226/2489] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:40.021589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf663358-75dc-4c2d-97a8-afe235de91d8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:40.023252 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cf663358-75dc-4c2d-97a8-afe235de91d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:40.086130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf663358-75dc-4c2d-97a8-afe235de91d8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:40.090132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75e780-fb26-4dd2-989d-e64ac4eaabb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:40.090872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75e780-fb26-4dd2-989d-e64ac4eaabb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:40.093441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75e780-fb26-4dd2-989d-e64ac4eaabb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:40.093808 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75e780-fb26-4dd2-989d-e64ac4eaabb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:40.105009 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75e780-fb26-4dd2-989d-e64ac4eaabb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:40.106484 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75e780-fb26-4dd2-989d-e64ac4eaabb9 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:40.118340 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1264/2490] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:56:50.530180 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2eacd-8a9d-49f2-9a04-5b722e6c351a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:50.588549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2eacd-8a9d-49f2-9a04-5b722e6c351a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:50.593571 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee7b3a-b08f-4401-815a-b1be95b29c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:50.594500 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee7b3a-b08f-4401-815a-b1be95b29c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:50.594781 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee7b3a-b08f-4401-815a-b1be95b29c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:50.595058 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee7b3a-b08f-4401-815a-b1be95b29c94 admin admin] PATH_INFO: `/v3/users/d82ff3726a7d4d7ea4de026bee1e1be7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:50.596251 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee7b3a-b08f-4401-815a-b1be95b29c94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d82ff3726a7d4d7ea4de026bee1e1be7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:50.598273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee7b3a-b08f-4401-815a-b1be95b29c94 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:50.900390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-17ee7b3a-b08f-4401-815a-b1be95b29c94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd82ff3726a7d4d7ea4de026bee1e1be7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:50.915384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-17ee7b3a-b08f-4401-815a-b1be95b29c94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd82ff3726a7d4d7ea4de026bee1e1be7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:51.032106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-17ee7b3a-b08f-4401-815a-b1be95b29c94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd82ff3726a7d4d7ea4de026bee1e1be7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:51.040764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-17ee7b3a-b08f-4401-815a-b1be95b29c94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd82ff3726a7d4d7ea4de026bee1e1be7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:51.041733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-17ee7b3a-b08f-4401-815a-b1be95b29c94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd82ff3726a7d4d7ea4de026bee1e1be7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:51.052863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1227/2491] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:56:50 2022] DELETE /identity/v3/users/d82ff3726a7d4d7ea4de026bee1e1be7 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:51.054174 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9984d-f410-4953-982b-3d9dacbf34e4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:51.055080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9984d-f410-4953-982b-3d9dacbf34e4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:51.055370 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9984d-f410-4953-982b-3d9dacbf34e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:51.093769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b0c9984d-f410-4953-982b-3d9dacbf34e4 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:51.094999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b0c9984d-f410-4953-982b-3d9dacbf34e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:51.191085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1265/2492] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:56:51.204315 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee7b3a-b08f-4401-815a-b1be95b29c94 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:51.206409 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-17ee7b3a-b08f-4401-815a-b1be95b29c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:51.289382 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee7b3a-b08f-4401-815a-b1be95b29c94 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:51.292909 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e184f-a43b-4ba3-98c6-8c8523cfb1be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:51.293706 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e184f-a43b-4ba3-98c6-8c8523cfb1be service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:51.294128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e184f-a43b-4ba3-98c6-8c8523cfb1be service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:51.294401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e184f-a43b-4ba3-98c6-8c8523cfb1be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:51.306040 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e184f-a43b-4ba3-98c6-8c8523cfb1be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:51.307621 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e184f-a43b-4ba3-98c6-8c8523cfb1be service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:51.324490 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1228/2493] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:56:51.834720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9984d-f410-4953-982b-3d9dacbf34e4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:51.836166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b0c9984d-f410-4953-982b-3d9dacbf34e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:51.855238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9984d-f410-4953-982b-3d9dacbf34e4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:51.865396 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79df915-4c4d-4e5e-ad3b-a20500b1f25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:51.865396 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79df915-4c4d-4e5e-ad3b-a20500b1f25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:51.865396 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79df915-4c4d-4e5e-ad3b-a20500b1f25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:51.865396 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79df915-4c4d-4e5e-ad3b-a20500b1f25a admin admin] PATH_INFO: `/v3/projects/1c807b50a83546449bef31969af5ae6e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:51.866190 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79df915-4c4d-4e5e-ad3b-a20500b1f25a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c807b50a83546449bef31969af5ae6e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:51.866190 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79df915-4c4d-4e5e-ad3b-a20500b1f25a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:51.968881 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a79df915-4c4d-4e5e-ad3b-a20500b1f25a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c807b50a83546449bef31969af5ae6e', 'request_id': 'req-a79df915-4c4d-4e5e-ad3b-a20500b1f25a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:51.974158 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a79df915-4c4d-4e5e-ad3b-a20500b1f25a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c807b50a83546449bef31969af5ae6e', 'request_id': 'req-a79df915-4c4d-4e5e-ad3b-a20500b1f25a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:51.980192 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a79df915-4c4d-4e5e-ad3b-a20500b1f25a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c807b50a83546449bef31969af5ae6e', 'request_id': 'req-a79df915-4c4d-4e5e-ad3b-a20500b1f25a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:52.042397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a79df915-4c4d-4e5e-ad3b-a20500b1f25a admin admin] The token cache is being invalidate because project 1c807b50a83546449bef31969af5ae6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:56:52.042703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a79df915-4c4d-4e5e-ad3b-a20500b1f25a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:52.043316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a79df915-4c4d-4e5e-ad3b-a20500b1f25a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:52.044993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1266/2494] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:56:51 2022] DELETE /identity/v3/projects/1c807b50a83546449bef31969af5ae6e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:52.053292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6ead1-346c-4b61-a4a8-c0d75638c662 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:52.053760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6ead1-346c-4b61-a4a8-c0d75638c662 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:52.053857 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6ead1-346c-4b61-a4a8-c0d75638c662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:52.072219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-86a6ead1-346c-4b61-a4a8-c0d75638c662 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:52.073461 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-86a6ead1-346c-4b61-a4a8-c0d75638c662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:52.133514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1229/2495] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:52.142567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330e4d-873c-4dde-9d38-775d92508d82 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:52.143055 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330e4d-873c-4dde-9d38-775d92508d82 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:52.143205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330e4d-873c-4dde-9d38-775d92508d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:52.163083 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-65330e4d-873c-4dde-9d38-775d92508d82 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:52.164283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-65330e4d-873c-4dde-9d38-775d92508d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:52.173590 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1267/2496] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:52.177853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6ead1-346c-4b61-a4a8-c0d75638c662 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:52.188003 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6ead1-346c-4b61-a4a8-c0d75638c662 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:52.192643 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5721f9-0f7c-40f5-81d8-5fb6107a4b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:52.193302 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5721f9-0f7c-40f5-81d8-5fb6107a4b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:52.193581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5721f9-0f7c-40f5-81d8-5fb6107a4b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:52.193850 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5721f9-0f7c-40f5-81d8-5fb6107a4b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:52.194576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5721f9-0f7c-40f5-81d8-5fb6107a4b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:56:52.194881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5721f9-0f7c-40f5-81d8-5fb6107a4b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:52.196495 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5721f9-0f7c-40f5-81d8-5fb6107a4b89 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:52.208061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1230/2497] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:56:52.212455 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65330e4d-873c-4dde-9d38-775d92508d82 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:52.222355 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65330e4d-873c-4dde-9d38-775d92508d82 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:52.227046 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8eb00-85e8-4ad0-8b5f-c65986acd814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:52.227697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8eb00-85e8-4ad0-8b5f-c65986acd814 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:52.227978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8eb00-85e8-4ad0-8b5f-c65986acd814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:52.228251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8eb00-85e8-4ad0-8b5f-c65986acd814 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:52.228979 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8eb00-85e8-4ad0-8b5f-c65986acd814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:52.230889 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8eb00-85e8-4ad0-8b5f-c65986acd814 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:52.354725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1268/2498] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:56:52 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:56:52.358935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5721f9-0f7c-40f5-81d8-5fb6107a4b89 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:52.369026 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5721f9-0f7c-40f5-81d8-5fb6107a4b89 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:52.426828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22ade7-77d9-4567-b9b7-f0a801a8842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:52.427507 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22ade7-77d9-4567-b9b7-f0a801a8842f admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:52.427792 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22ade7-77d9-4567-b9b7-f0a801a8842f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:52.428068 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22ade7-77d9-4567-b9b7-f0a801a8842f admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:52.428789 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22ade7-77d9-4567-b9b7-f0a801a8842f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:52.430736 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22ade7-77d9-4567-b9b7-f0a801a8842f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:52.520259 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1231/2499] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:56:52 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:56:52.524344 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8eb00-85e8-4ad0-8b5f-c65986acd814 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:52.535360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8eb00-85e8-4ad0-8b5f-c65986acd814 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:52.540520 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8faed-0bd3-4145-b969-cddfe54febdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:52.541256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8faed-0bd3-4145-b969-cddfe54febdb admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:52.541467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8faed-0bd3-4145-b969-cddfe54febdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:52.541738 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8faed-0bd3-4145-b969-cddfe54febdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:52.542467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8faed-0bd3-4145-b969-cddfe54febdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:52.544072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8faed-0bd3-4145-b969-cddfe54febdb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:52.556029 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1269/2500] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:56:52.560362 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22ade7-77d9-4567-b9b7-f0a801a8842f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:52.570854 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22ade7-77d9-4567-b9b7-f0a801a8842f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:52.575534 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fcf49a-3bea-4459-9686-539f97f86444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:52.576201 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcf49a-3bea-4459-9686-539f97f86444 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:52.576540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcf49a-3bea-4459-9686-539f97f86444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:52.577395 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcf49a-3bea-4459-9686-539f97f86444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:52.578131 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fcf49a-3bea-4459-9686-539f97f86444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:52.579720 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fcf49a-3bea-4459-9686-539f97f86444 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:52.592851 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1232/2501] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:56:52.594245 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8faed-0bd3-4145-b969-cddfe54febdb admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:52.604091 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8faed-0bd3-4145-b969-cddfe54febdb admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:52.608872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748bc2e-ceef-472e-94eb-abad3d693ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:52.609755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748bc2e-ceef-472e-94eb-abad3d693ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:52.610033 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748bc2e-ceef-472e-94eb-abad3d693ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:52.610306 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748bc2e-ceef-472e-94eb-abad3d693ce6 admin admin] PATH_INFO: `/v3/projects/626f13c8c0284a57bb12f844a2de0cdc/users/d369686a0544492eb17b4e97575c9913/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:52.625283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748bc2e-ceef-472e-94eb-abad3d693ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=626f13c8c0284a57bb12f844a2de0cdc, user_id=d369686a0544492eb17b4e97575c9913, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:52.627939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748bc2e-ceef-472e-94eb-abad3d693ce6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:52.703017 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1270/2502] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:56:52 2022] PUT /identity/v3/projects/626f13c8c0284a57bb12f844a2de0cdc/users/d369686a0544492eb17b4e97575c9913/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:56:52.765632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43b17e-c550-4cf3-b736-20d4cdf3faa5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:52.765920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43b17e-c550-4cf3-b736-20d4cdf3faa5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:52.766199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43b17e-c550-4cf3-b736-20d4cdf3faa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:52.792410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bf43b17e-c550-4cf3-b736-20d4cdf3faa5 None None] MFA Rules not processed for user `d369686a0544492eb17b4e97575c9913`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:52.793644 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bf43b17e-c550-4cf3-b736-20d4cdf3faa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:52.866405 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1233/2503] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:52.878148 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748bc2e-ceef-472e-94eb-abad3d693ce6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:52.879817 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9748bc2e-ceef-472e-94eb-abad3d693ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:52.938126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748bc2e-ceef-472e-94eb-abad3d693ce6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:52.942420 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba190e5d-b9a1-4785-9480-49cee2b77f34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:52.947067 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba190e5d-b9a1-4785-9480-49cee2b77f34 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:52.947067 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba190e5d-b9a1-4785-9480-49cee2b77f34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:52.947067 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba190e5d-b9a1-4785-9480-49cee2b77f34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:52.953180 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba190e5d-b9a1-4785-9480-49cee2b77f34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:52.954555 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba190e5d-b9a1-4785-9480-49cee2b77f34 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:52.963950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1271/2504] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:56:55.006581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f9009-94e3-4032-947c-fb41025dc066 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:55.007074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f9009-94e3-4032-947c-fb41025dc066 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:55.007153 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f9009-94e3-4032-947c-fb41025dc066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:55.026039 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-522f9009-94e3-4032-947c-fb41025dc066 None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:55.027225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-522f9009-94e3-4032-947c-fb41025dc066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:55.086546 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1234/2505] 10.222.0.81 () {58 vars in 967 bytes} [Wed May 4 17:56:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:55.100562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba190e5d-b9a1-4785-9480-49cee2b77f34 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:55.101992 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ba190e5d-b9a1-4785-9480-49cee2b77f34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:55.190032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba190e5d-b9a1-4785-9480-49cee2b77f34 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:55.195829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afdc7d-d12e-425e-b151-f8290e02c99a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:55.196556 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afdc7d-d12e-425e-b151-f8290e02c99a service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:55.196886 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afdc7d-d12e-425e-b151-f8290e02c99a service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:55.197162 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afdc7d-d12e-425e-b151-f8290e02c99a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:55.206434 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afdc7d-d12e-425e-b151-f8290e02c99a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:55.208011 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afdc7d-d12e-425e-b151-f8290e02c99a service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:55.216140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1272/2506] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 17:56:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 17:56:57.187685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f9009-94e3-4032-947c-fb41025dc066 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:57.254011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f9009-94e3-4032-947c-fb41025dc066 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:57.258554 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959b070-d307-4bb3-beaa-0ef77d9eebc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:57.259419 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959b070-d307-4bb3-beaa-0ef77d9eebc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:57.259699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959b070-d307-4bb3-beaa-0ef77d9eebc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:57.259974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959b070-d307-4bb3-beaa-0ef77d9eebc3 admin admin] PATH_INFO: `/v3/users/d369686a0544492eb17b4e97575c9913` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:57.261203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959b070-d307-4bb3-beaa-0ef77d9eebc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d369686a0544492eb17b4e97575c9913)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:57.263102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959b070-d307-4bb3-beaa-0ef77d9eebc3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:57.474904 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8959b070-d307-4bb3-beaa-0ef77d9eebc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd369686a0544492eb17b4e97575c9913'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:57.488635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8959b070-d307-4bb3-beaa-0ef77d9eebc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd369686a0544492eb17b4e97575c9913'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:57.586762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8959b070-d307-4bb3-beaa-0ef77d9eebc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd369686a0544492eb17b4e97575c9913'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:57.594409 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8959b070-d307-4bb3-beaa-0ef77d9eebc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd369686a0544492eb17b4e97575c9913'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:57.595034 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8959b070-d307-4bb3-beaa-0ef77d9eebc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd369686a0544492eb17b4e97575c9913'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:57.600923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1235/2507] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:56:57 2022] DELETE /identity/v3/users/d369686a0544492eb17b4e97575c9913 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:56:57.605452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d889ed-3c75-4b18-85a1-4dc0bfa00838 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:57.605938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d889ed-3c75-4b18-85a1-4dc0bfa00838 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:57.606045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d889ed-3c75-4b18-85a1-4dc0bfa00838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:57.623714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-27d889ed-3c75-4b18-85a1-4dc0bfa00838 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:56:57.624948 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-27d889ed-3c75-4b18-85a1-4dc0bfa00838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:57.695179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1273/2508] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:56:57.705441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959b070-d307-4bb3-beaa-0ef77d9eebc3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:57.707219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8959b070-d307-4bb3-beaa-0ef77d9eebc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:57.768499 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959b070-d307-4bb3-beaa-0ef77d9eebc3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:57.772034 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581a91c-790c-441c-8057-5540eedce2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:57.772702 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581a91c-790c-441c-8057-5540eedce2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:57.772985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581a91c-790c-441c-8057-5540eedce2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:57.773258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581a91c-790c-441c-8057-5540eedce2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:57.782966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581a91c-790c-441c-8057-5540eedce2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:57.784377 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581a91c-790c-441c-8057-5540eedce2c0 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:57.793653 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1236/2509] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:56:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:56:58.358370 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d889ed-3c75-4b18-85a1-4dc0bfa00838 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:56:58.360104 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-27d889ed-3c75-4b18-85a1-4dc0bfa00838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:56:58.380324 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d889ed-3c75-4b18-85a1-4dc0bfa00838 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:56:58.397073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d409f-154e-4d2b-acb1-1fced44beee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:56:58.398177 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d409f-154e-4d2b-acb1-1fced44beee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:56:58.398462 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d409f-154e-4d2b-acb1-1fced44beee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:56:58.398734 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d409f-154e-4d2b-acb1-1fced44beee3 admin admin] PATH_INFO: `/v3/projects/626f13c8c0284a57bb12f844a2de0cdc` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:56:58.400337 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d409f-154e-4d2b-acb1-1fced44beee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=626f13c8c0284a57bb12f844a2de0cdc)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:56:58.417683 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d409f-154e-4d2b-acb1-1fced44beee3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:56:58.541767 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9d4d409f-154e-4d2b-acb1-1fced44beee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626f13c8c0284a57bb12f844a2de0cdc', 'request_id': 'req-9d4d409f-154e-4d2b-acb1-1fced44beee3'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:58.547850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9d4d409f-154e-4d2b-acb1-1fced44beee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626f13c8c0284a57bb12f844a2de0cdc', 'request_id': 'req-9d4d409f-154e-4d2b-acb1-1fced44beee3'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:58.554155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9d4d409f-154e-4d2b-acb1-1fced44beee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626f13c8c0284a57bb12f844a2de0cdc', 'request_id': 'req-9d4d409f-154e-4d2b-acb1-1fced44beee3'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:58.653066 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9d4d409f-154e-4d2b-acb1-1fced44beee3 admin admin] The token cache is being invalidate because project 626f13c8c0284a57bb12f844a2de0cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:56:58.654952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9d4d409f-154e-4d2b-acb1-1fced44beee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:58.654952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9d4d409f-154e-4d2b-acb1-1fced44beee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:56:58.656349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1274/2510] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:56:58 2022] DELETE /identity/v3/projects/626f13c8c0284a57bb12f844a2de0cdc => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:26.075892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581a91c-790c-441c-8057-5540eedce2c0 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:26.085617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581a91c-790c-441c-8057-5540eedce2c0 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:26.131828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfd569-492e-4215-a436-e977a804c2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:26.132485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfd569-492e-4215-a436-e977a804c2fb service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:26.132765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfd569-492e-4215-a436-e977a804c2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:26.133039 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfd569-492e-4215-a436-e977a804c2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:26.134852 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-55dfd569-492e-4215-a436-e977a804c2fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:26.197473 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfd569-492e-4215-a436-e977a804c2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:26.198933 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfd569-492e-4215-a436-e977a804c2fb service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:26.209183 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1237/2511] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:57:29.978681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d409f-154e-4d2b-acb1-1fced44beee3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:29.980173 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9d4d409f-154e-4d2b-acb1-1fced44beee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:29.993934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d409f-154e-4d2b-acb1-1fced44beee3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:29.998510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23019785-8550-4b5b-a644-5c3433116324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:29.999366 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23019785-8550-4b5b-a644-5c3433116324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:29.999644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23019785-8550-4b5b-a644-5c3433116324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:29.999910 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23019785-8550-4b5b-a644-5c3433116324 admin admin] PATH_INFO: `/v3/users/3b220b08ef304644b329bcd31f0247f7` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.001093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23019785-8550-4b5b-a644-5c3433116324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b220b08ef304644b329bcd31f0247f7)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:30.002997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23019785-8550-4b5b-a644-5c3433116324 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:30.202022 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-23019785-8550-4b5b-a644-5c3433116324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b220b08ef304644b329bcd31f0247f7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:30.256721 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-23019785-8550-4b5b-a644-5c3433116324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b220b08ef304644b329bcd31f0247f7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:30.257342 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-23019785-8550-4b5b-a644-5c3433116324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b220b08ef304644b329bcd31f0247f7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:30.265093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-23019785-8550-4b5b-a644-5c3433116324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b220b08ef304644b329bcd31f0247f7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:30.276931 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-23019785-8550-4b5b-a644-5c3433116324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b220b08ef304644b329bcd31f0247f7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:30.283723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1275/2512] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:57:29 2022] DELETE /identity/v3/users/3b220b08ef304644b329bcd31f0247f7 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:30.519569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfd569-492e-4215-a436-e977a804c2fb service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:30.531231 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfd569-492e-4215-a436-e977a804c2fb service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:30.588365 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2a0d9-9a93-46c4-ae25-be57ecc62cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:30.589244 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2a0d9-9a93-46c4-ae25-be57ecc62cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:30.589525 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2a0d9-9a93-46c4-ae25-be57ecc62cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:30.589794 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2a0d9-9a93-46c4-ae25-be57ecc62cfe admin admin] PATH_INFO: `/v3/projects/65ea04a5ce2f4f75968d7d0204336cf6` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.591013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2a0d9-9a93-46c4-ae25-be57ecc62cfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ea04a5ce2f4f75968d7d0204336cf6)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:30.593020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2a0d9-9a93-46c4-ae25-be57ecc62cfe admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:30.696373 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-20f2a0d9-9a93-46c4-ae25-be57ecc62cfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ea04a5ce2f4f75968d7d0204336cf6', 'request_id': 'req-20f2a0d9-9a93-46c4-ae25-be57ecc62cfe'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:30.702601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-20f2a0d9-9a93-46c4-ae25-be57ecc62cfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ea04a5ce2f4f75968d7d0204336cf6', 'request_id': 'req-20f2a0d9-9a93-46c4-ae25-be57ecc62cfe'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:30.769179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-20f2a0d9-9a93-46c4-ae25-be57ecc62cfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ea04a5ce2f4f75968d7d0204336cf6', 'request_id': 'req-20f2a0d9-9a93-46c4-ae25-be57ecc62cfe'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:30.780788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-20f2a0d9-9a93-46c4-ae25-be57ecc62cfe admin admin] The token cache is being invalidate because project 65ea04a5ce2f4f75968d7d0204336cf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:57:30.783472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-20f2a0d9-9a93-46c4-ae25-be57ecc62cfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:30.783472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-20f2a0d9-9a93-46c4-ae25-be57ecc62cfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:30.783472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1238/2513] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:57:30 2022] DELETE /identity/v3/projects/65ea04a5ce2f4f75968d7d0204336cf6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:30.788145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9bf12-1da5-4c96-a889-eac802a6c291 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:30.788430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9bf12-1da5-4c96-a889-eac802a6c291 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:30.788743 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9bf12-1da5-4c96-a889-eac802a6c291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.805918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-74c9bf12-1da5-4c96-a889-eac802a6c291 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:30.807111 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-74c9bf12-1da5-4c96-a889-eac802a6c291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:30.866656 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1276/2514] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:30.875588 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf153a-28ef-4655-95e2-ebee1a27edbf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:30.875884 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf153a-28ef-4655-95e2-ebee1a27edbf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:30.876167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf153a-28ef-4655-95e2-ebee1a27edbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.894407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9baf153a-28ef-4655-95e2-ebee1a27edbf None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:30.895625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9baf153a-28ef-4655-95e2-ebee1a27edbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:30.903896 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1239/2515] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:30.908099 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9bf12-1da5-4c96-a889-eac802a6c291 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:30.917513 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9bf12-1da5-4c96-a889-eac802a6c291 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:30.922664 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79863501-2b19-490a-8e6b-e937f9f5db50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:30.923295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79863501-2b19-490a-8e6b-e937f9f5db50 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:30.923570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79863501-2b19-490a-8e6b-e937f9f5db50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:30.923843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79863501-2b19-490a-8e6b-e937f9f5db50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.924589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79863501-2b19-490a-8e6b-e937f9f5db50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:30.924892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79863501-2b19-490a-8e6b-e937f9f5db50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:30.926466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79863501-2b19-490a-8e6b-e937f9f5db50 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:30.938127 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1277/2516] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:30.942352 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf153a-28ef-4655-95e2-ebee1a27edbf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:30.951267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf153a-28ef-4655-95e2-ebee1a27edbf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:30.955955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d0b11-ac71-46b0-ae66-6d077cd9c69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:30.956625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d0b11-ac71-46b0-ae66-6d077cd9c69f admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:30.956911 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d0b11-ac71-46b0-ae66-6d077cd9c69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:30.957189 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d0b11-ac71-46b0-ae66-6d077cd9c69f admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:30.957877 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d0b11-ac71-46b0-ae66-6d077cd9c69f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:30.959759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d0b11-ac71-46b0-ae66-6d077cd9c69f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.055942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1240/2517] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:57:30 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:31.060057 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79863501-2b19-490a-8e6b-e937f9f5db50 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.070482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79863501-2b19-490a-8e6b-e937f9f5db50 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.130717 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d96ad-912a-4af7-a12b-48436f3d8530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.131381 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d96ad-912a-4af7-a12b-48436f3d8530 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.131661 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d96ad-912a-4af7-a12b-48436f3d8530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.131936 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d96ad-912a-4af7-a12b-48436f3d8530 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.132665 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d96ad-912a-4af7-a12b-48436f3d8530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.134584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d96ad-912a-4af7-a12b-48436f3d8530 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.209323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1278/2518] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:57:31 2022] POST /identity/v3/users => generated 282 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:31.213447 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d0b11-ac71-46b0-ae66-6d077cd9c69f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.224529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d0b11-ac71-46b0-ae66-6d077cd9c69f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.229190 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcd39c-225e-47bf-be42-3d223af4a2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.229858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcd39c-225e-47bf-be42-3d223af4a2af admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.230125 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcd39c-225e-47bf-be42-3d223af4a2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.230399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcd39c-225e-47bf-be42-3d223af4a2af admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.231150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcd39c-225e-47bf-be42-3d223af4a2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.233610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcd39c-225e-47bf-be42-3d223af4a2af admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.243580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1241/2519] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:31.247518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d96ad-912a-4af7-a12b-48436f3d8530 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.257716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d96ad-912a-4af7-a12b-48436f3d8530 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.262595 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2cee6-17ec-429d-9c24-56cf5c4ac2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.263248 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2cee6-17ec-429d-9c24-56cf5c4ac2cd admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.263559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2cee6-17ec-429d-9c24-56cf5c4ac2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.263822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2cee6-17ec-429d-9c24-56cf5c4ac2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.264572 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2cee6-17ec-429d-9c24-56cf5c4ac2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.266197 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2cee6-17ec-429d-9c24-56cf5c4ac2cd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.276305 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1279/2520] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:31.281361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcd39c-225e-47bf-be42-3d223af4a2af admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.291104 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcd39c-225e-47bf-be42-3d223af4a2af admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.296379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6c6ac-6bcb-4a06-a7f6-7637a0d46a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.297782 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6c6ac-6bcb-4a06-a7f6-7637a0d46a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.298068 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6c6ac-6bcb-4a06-a7f6-7637a0d46a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.298346 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6c6ac-6bcb-4a06-a7f6-7637a0d46a73 admin admin] PATH_INFO: `/v3/projects/827a37adc835498285321c06e50ce847/users/73280e7bfbca4a3da6583696aac0adce/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.312383 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6c6ac-6bcb-4a06-a7f6-7637a0d46a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827a37adc835498285321c06e50ce847, user_id=73280e7bfbca4a3da6583696aac0adce, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.314994 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6c6ac-6bcb-4a06-a7f6-7637a0d46a73 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.417036 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1242/2521] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:57:31 2022] PUT /identity/v3/projects/827a37adc835498285321c06e50ce847/users/73280e7bfbca4a3da6583696aac0adce/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:31.428559 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f5342-fea6-4e6c-92a4-6aa6dcb01824 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.430670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f5342-fea6-4e6c-92a4-6aa6dcb01824 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.430670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f5342-fea6-4e6c-92a4-6aa6dcb01824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.454579 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ad9f5342-fea6-4e6c-92a4-6aa6dcb01824 None None] MFA Rules not processed for user `73280e7bfbca4a3da6583696aac0adce`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:31.455758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ad9f5342-fea6-4e6c-92a4-6aa6dcb01824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:31.517006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1280/2522] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:31.521423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6c6ac-6bcb-4a06-a7f6-7637a0d46a73 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.585771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6c6ac-6bcb-4a06-a7f6-7637a0d46a73 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.590275 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3100bb-9a89-47a3-a259-40bbae862321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.590926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3100bb-9a89-47a3-a259-40bbae862321 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.591206 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3100bb-9a89-47a3-a259-40bbae862321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.591482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3100bb-9a89-47a3-a259-40bbae862321 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.592897 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3100bb-9a89-47a3-a259-40bbae862321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.594773 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3100bb-9a89-47a3-a259-40bbae862321 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.709961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1243/2523] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:57:31 2022] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:31.714167 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f5342-fea6-4e6c-92a4-6aa6dcb01824 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.726418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f5342-fea6-4e6c-92a4-6aa6dcb01824 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.783532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85cc01-e3c1-4432-90a6-b42db8483d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.784196 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85cc01-e3c1-4432-90a6-b42db8483d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.784504 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85cc01-e3c1-4432-90a6-b42db8483d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.784774 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85cc01-e3c1-4432-90a6-b42db8483d38 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.785462 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85cc01-e3c1-4432-90a6-b42db8483d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.787358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85cc01-e3c1-4432-90a6-b42db8483d38 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.901872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1281/2524] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:57:31 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:31.907006 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3100bb-9a89-47a3-a259-40bbae862321 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.917167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3100bb-9a89-47a3-a259-40bbae862321 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.921840 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076943b-692a-47b4-9a3f-26ee03aba024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.922483 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076943b-692a-47b4-9a3f-26ee03aba024 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.922760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076943b-692a-47b4-9a3f-26ee03aba024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.923030 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076943b-692a-47b4-9a3f-26ee03aba024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.923748 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076943b-692a-47b4-9a3f-26ee03aba024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.925350 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076943b-692a-47b4-9a3f-26ee03aba024 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:31.935451 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1244/2525] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:31.940276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85cc01-e3c1-4432-90a6-b42db8483d38 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:31.950153 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85cc01-e3c1-4432-90a6-b42db8483d38 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:31.955574 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a6b86-821a-4c31-b5de-bb716ac25bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:31.956457 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a6b86-821a-4c31-b5de-bb716ac25bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:31.956817 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a6b86-821a-4c31-b5de-bb716ac25bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:31.957091 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a6b86-821a-4c31-b5de-bb716ac25bf7 admin admin] PATH_INFO: `/v3/projects/43953ae75237429bbbd592d75e1976af/users/2524abf83a53400ea25febbbf8c71e41/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:31.971321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a6b86-821a-4c31-b5de-bb716ac25bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43953ae75237429bbbd592d75e1976af, user_id=2524abf83a53400ea25febbbf8c71e41, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:31.974534 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a6b86-821a-4c31-b5de-bb716ac25bf7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:32.042644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1282/2526] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:57:31 2022] PUT /identity/v3/projects/43953ae75237429bbbd592d75e1976af/users/2524abf83a53400ea25febbbf8c71e41/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:32.046943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076943b-692a-47b4-9a3f-26ee03aba024 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:32.056969 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076943b-692a-47b4-9a3f-26ee03aba024 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:32.111138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb7390-e0d9-48a4-a9b4-d9ae95f4d0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:32.111806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb7390-e0d9-48a4-a9b4-d9ae95f4d0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:32.112092 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb7390-e0d9-48a4-a9b4-d9ae95f4d0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:32.112370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb7390-e0d9-48a4-a9b4-d9ae95f4d0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:32.113123 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb7390-e0d9-48a4-a9b4-d9ae95f4d0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:32.114718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb7390-e0d9-48a4-a9b4-d9ae95f4d0e0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:32.124839 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1245/2527] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:32.129064 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a6b86-821a-4c31-b5de-bb716ac25bf7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:32.140094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a6b86-821a-4c31-b5de-bb716ac25bf7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:32.144766 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234312e5-1918-4051-a705-ffe2356e4506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:32.145635 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234312e5-1918-4051-a705-ffe2356e4506 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:32.145912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234312e5-1918-4051-a705-ffe2356e4506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:32.146186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234312e5-1918-4051-a705-ffe2356e4506 admin admin] PATH_INFO: `/v3/projects/43953ae75237429bbbd592d75e1976af/users/2524abf83a53400ea25febbbf8c71e41/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:32.148200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234312e5-1918-4051-a705-ffe2356e4506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43953ae75237429bbbd592d75e1976af, user_id=2524abf83a53400ea25febbbf8c71e41, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:32.150858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234312e5-1918-4051-a705-ffe2356e4506 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:32.161407 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1283/2528] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:57:32 2022] PUT /identity/v3/projects/43953ae75237429bbbd592d75e1976af/users/2524abf83a53400ea25febbbf8c71e41/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:57:32.171542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543786a-bc62-44a2-a7de-26ccc0e0229f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:32.171834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543786a-bc62-44a2-a7de-26ccc0e0229f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:32.172113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543786a-bc62-44a2-a7de-26ccc0e0229f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:32.198278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5543786a-bc62-44a2-a7de-26ccc0e0229f None None] MFA Rules not processed for user `2524abf83a53400ea25febbbf8c71e41`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:32.199556 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5543786a-bc62-44a2-a7de-26ccc0e0229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:32.264943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1246/2529] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:32.279449 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234312e5-1918-4051-a705-ffe2356e4506 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:32.281446 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-234312e5-1918-4051-a705-ffe2356e4506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:32.338915 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234312e5-1918-4051-a705-ffe2356e4506 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:32.342766 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06e9d7-a201-4d69-942a-96a9f51ce322 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:32.343493 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06e9d7-a201-4d69-942a-96a9f51ce322 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:32.343775 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06e9d7-a201-4d69-942a-96a9f51ce322 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:32.344048 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06e9d7-a201-4d69-942a-96a9f51ce322 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:32.353372 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06e9d7-a201-4d69-942a-96a9f51ce322 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:32.354823 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06e9d7-a201-4d69-942a-96a9f51ce322 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:32.364918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1284/2530] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:57:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:57:32.558707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543786a-bc62-44a2-a7de-26ccc0e0229f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:32.569011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543786a-bc62-44a2-a7de-26ccc0e0229f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:32.572586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eebf3-59fe-44c2-98d8-aa63c8d90719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:32.573224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eebf3-59fe-44c2-98d8-aa63c8d90719 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:32.573506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eebf3-59fe-44c2-98d8-aa63c8d90719 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:32.573781 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eebf3-59fe-44c2-98d8-aa63c8d90719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:32.630626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6eebf3-59fe-44c2-98d8-aa63c8d90719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:32.632049 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6eebf3-59fe-44c2-98d8-aa63c8d90719 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:32.640863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1247/2531] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:57:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:57:44.496719 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06e9d7-a201-4d69-942a-96a9f51ce322 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:44.568059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06e9d7-a201-4d69-942a-96a9f51ce322 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:44.568809 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce8212-4717-462f-8fda-db00372d1de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:44.569665 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce8212-4717-462f-8fda-db00372d1de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:44.569944 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce8212-4717-462f-8fda-db00372d1de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:44.570219 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce8212-4717-462f-8fda-db00372d1de6 admin admin] PATH_INFO: `/v3/users/73280e7bfbca4a3da6583696aac0adce` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:44.571423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce8212-4717-462f-8fda-db00372d1de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73280e7bfbca4a3da6583696aac0adce)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:44.573389 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce8212-4717-462f-8fda-db00372d1de6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:44.759881 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2cce8212-4717-462f-8fda-db00372d1de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73280e7bfbca4a3da6583696aac0adce'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:44.826845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2cce8212-4717-462f-8fda-db00372d1de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73280e7bfbca4a3da6583696aac0adce'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:44.827423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2cce8212-4717-462f-8fda-db00372d1de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73280e7bfbca4a3da6583696aac0adce'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:44.834795 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2cce8212-4717-462f-8fda-db00372d1de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73280e7bfbca4a3da6583696aac0adce'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:44.856430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2cce8212-4717-462f-8fda-db00372d1de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73280e7bfbca4a3da6583696aac0adce'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:44.863493 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1285/2532] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:57:44 2022] DELETE /identity/v3/users/73280e7bfbca4a3da6583696aac0adce => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:44.868569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458807f-e066-4c7a-8fad-a4d820280e5e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:44.869106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458807f-e066-4c7a-8fad-a4d820280e5e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:44.869106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458807f-e066-4c7a-8fad-a4d820280e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:44.887524 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b458807f-e066-4c7a-8fad-a4d820280e5e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:44.895150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b458807f-e066-4c7a-8fad-a4d820280e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:44.948859 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1248/2533] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:44.959299 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce8212-4717-462f-8fda-db00372d1de6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:44.960745 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2cce8212-4717-462f-8fda-db00372d1de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:45.017284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce8212-4717-462f-8fda-db00372d1de6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:45.020932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191c20d-2e62-428b-93fe-93866cb9daee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:45.021566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191c20d-2e62-428b-93fe-93866cb9daee service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:45.021844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191c20d-2e62-428b-93fe-93866cb9daee service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:45.022115 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191c20d-2e62-428b-93fe-93866cb9daee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:45.031395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191c20d-2e62-428b-93fe-93866cb9daee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:45.032854 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191c20d-2e62-428b-93fe-93866cb9daee service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:45.042143 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1286/2534] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:57:45.565280 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458807f-e066-4c7a-8fad-a4d820280e5e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:45.567287 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b458807f-e066-4c7a-8fad-a4d820280e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:45.584201 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458807f-e066-4c7a-8fad-a4d820280e5e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:45.589563 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:45.590542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:45.590937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:45.591313 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c admin admin] PATH_INFO: `/v3/projects/827a37adc835498285321c06e50ce847` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:45.592756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=827a37adc835498285321c06e50ce847)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:45.594875 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:45.699968 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '827a37adc835498285321c06e50ce847', 'request_id': 'req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:45.706216 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '827a37adc835498285321c06e50ce847', 'request_id': 'req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:45.791746 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '827a37adc835498285321c06e50ce847', 'request_id': 'req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:45.804159 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c admin admin] The token cache is being invalidate because project 827a37adc835498285321c06e50ce847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:57:45.804470 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:45.805113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:45.806793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1249/2535] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:57:45 2022] DELETE /identity/v3/projects/827a37adc835498285321c06e50ce847 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:45.810820 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191c20d-2e62-428b-93fe-93866cb9daee service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:45.820674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191c20d-2e62-428b-93fe-93866cb9daee service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:45.880723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94c1c7-7456-4b7a-acc0-46a85c86c282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:45.880723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94c1c7-7456-4b7a-acc0-46a85c86c282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:45.880723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94c1c7-7456-4b7a-acc0-46a85c86c282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:45.880723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94c1c7-7456-4b7a-acc0-46a85c86c282 admin admin] PATH_INFO: `/v3/users/2524abf83a53400ea25febbbf8c71e41` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:45.881276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94c1c7-7456-4b7a-acc0-46a85c86c282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2524abf83a53400ea25febbbf8c71e41)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:45.882931 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94c1c7-7456-4b7a-acc0-46a85c86c282 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:46.073167 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7b94c1c7-7456-4b7a-acc0-46a85c86c282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2524abf83a53400ea25febbbf8c71e41'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:46.151695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7b94c1c7-7456-4b7a-acc0-46a85c86c282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2524abf83a53400ea25febbbf8c71e41'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:46.152688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7b94c1c7-7456-4b7a-acc0-46a85c86c282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2524abf83a53400ea25febbbf8c71e41'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:46.160521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7b94c1c7-7456-4b7a-acc0-46a85c86c282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2524abf83a53400ea25febbbf8c71e41'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:46.172868 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7b94c1c7-7456-4b7a-acc0-46a85c86c282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2524abf83a53400ea25febbbf8c71e41'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:46.178731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1287/2536] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:57:45 2022] DELETE /identity/v3/users/2524abf83a53400ea25febbbf8c71e41 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:46.597391 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:46.601479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:46.615482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed904e0-6b01-4004-aa05-5f0c0e939e6c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:46.676205 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bab1b-5134-4fee-92ba-100f95c92471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:46.677092 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bab1b-5134-4fee-92ba-100f95c92471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:46.677375 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bab1b-5134-4fee-92ba-100f95c92471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:46.677650 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bab1b-5134-4fee-92ba-100f95c92471 admin admin] PATH_INFO: `/v3/projects/43953ae75237429bbbd592d75e1976af` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:46.678845 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4bab1b-5134-4fee-92ba-100f95c92471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43953ae75237429bbbd592d75e1976af)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:46.680791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4bab1b-5134-4fee-92ba-100f95c92471 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:46.810780 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9e4bab1b-5134-4fee-92ba-100f95c92471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43953ae75237429bbbd592d75e1976af', 'request_id': 'req-9e4bab1b-5134-4fee-92ba-100f95c92471'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:46.816287 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9e4bab1b-5134-4fee-92ba-100f95c92471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43953ae75237429bbbd592d75e1976af', 'request_id': 'req-9e4bab1b-5134-4fee-92ba-100f95c92471'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:46.928871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9e4bab1b-5134-4fee-92ba-100f95c92471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43953ae75237429bbbd592d75e1976af', 'request_id': 'req-9e4bab1b-5134-4fee-92ba-100f95c92471'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:46.941027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9e4bab1b-5134-4fee-92ba-100f95c92471 admin admin] The token cache is being invalidate because project 43953ae75237429bbbd592d75e1976af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:57:46.941304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9e4bab1b-5134-4fee-92ba-100f95c92471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:46.941935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9e4bab1b-5134-4fee-92ba-100f95c92471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:46.943475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1250/2537] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:57:46 2022] DELETE /identity/v3/projects/43953ae75237429bbbd592d75e1976af => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:46.950331 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30456b6-21eb-4278-bf6d-8ac1533a3146 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:46.950811 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30456b6-21eb-4278-bf6d-8ac1533a3146 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:46.951004 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30456b6-21eb-4278-bf6d-8ac1533a3146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:46.968949 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a30456b6-21eb-4278-bf6d-8ac1533a3146 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:46.970148 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a30456b6-21eb-4278-bf6d-8ac1533a3146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:47.029601 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1288/2538] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:47.037627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dc935-464b-4052-8daa-e2d80c7b147e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:47.037917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dc935-464b-4052-8daa-e2d80c7b147e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:47.038191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dc935-464b-4052-8daa-e2d80c7b147e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:47.056383 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-751dc935-464b-4052-8daa-e2d80c7b147e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:47.057613 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-751dc935-464b-4052-8daa-e2d80c7b147e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:47.066198 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1251/2539] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:47.070432 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30456b6-21eb-4278-bf6d-8ac1533a3146 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:47.080620 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30456b6-21eb-4278-bf6d-8ac1533a3146 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:47.085198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42634cc-0a0a-4fe0-b7a1-3ed245e5b751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:47.085857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42634cc-0a0a-4fe0-b7a1-3ed245e5b751 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:47.086120 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42634cc-0a0a-4fe0-b7a1-3ed245e5b751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:47.086390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42634cc-0a0a-4fe0-b7a1-3ed245e5b751 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:47.087111 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42634cc-0a0a-4fe0-b7a1-3ed245e5b751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:47.087421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42634cc-0a0a-4fe0-b7a1-3ed245e5b751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:47.089066 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42634cc-0a0a-4fe0-b7a1-3ed245e5b751 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:47.104633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1289/2540] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:47.105811 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dc935-464b-4052-8daa-e2d80c7b147e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:47.115892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dc935-464b-4052-8daa-e2d80c7b147e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:47.121075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ea67e-aa30-4aa4-918c-a248d5d06c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:47.121925 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ea67e-aa30-4aa4-918c-a248d5d06c1d admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:47.123368 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ea67e-aa30-4aa4-918c-a248d5d06c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:47.123655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ea67e-aa30-4aa4-918c-a248d5d06c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:47.124629 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ea67e-aa30-4aa4-918c-a248d5d06c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:47.126580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ea67e-aa30-4aa4-918c-a248d5d06c1d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:47.244832 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1252/2541] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:57:47 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:57:47.249046 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42634cc-0a0a-4fe0-b7a1-3ed245e5b751 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:47.258868 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42634cc-0a0a-4fe0-b7a1-3ed245e5b751 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:47.314618 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c78d41-6168-41f4-ade8-ad044fd67dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:47.315271 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c78d41-6168-41f4-ade8-ad044fd67dca admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:47.315551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c78d41-6168-41f4-ade8-ad044fd67dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:47.315856 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c78d41-6168-41f4-ade8-ad044fd67dca admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:47.316580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c78d41-6168-41f4-ade8-ad044fd67dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:47.318486 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c78d41-6168-41f4-ade8-ad044fd67dca admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:47.410790 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1290/2542] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:57:47 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:47.415904 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ea67e-aa30-4aa4-918c-a248d5d06c1d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:47.427688 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ea67e-aa30-4aa4-918c-a248d5d06c1d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:47.432872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d9e9b-6183-4be8-b89c-2fd7e362819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:47.433481 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d9e9b-6183-4be8-b89c-2fd7e362819f admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:47.433763 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d9e9b-6183-4be8-b89c-2fd7e362819f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:47.434041 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d9e9b-6183-4be8-b89c-2fd7e362819f admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:47.434826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d9e9b-6183-4be8-b89c-2fd7e362819f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:47.437224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d9e9b-6183-4be8-b89c-2fd7e362819f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:47.447887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1253/2543] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:47.451885 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c78d41-6168-41f4-ade8-ad044fd67dca admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:47.461776 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c78d41-6168-41f4-ade8-ad044fd67dca admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:47.466746 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f4eff-07f3-48ed-bb30-1f756b6b6822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:47.467509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f4eff-07f3-48ed-bb30-1f756b6b6822 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:47.467887 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f4eff-07f3-48ed-bb30-1f756b6b6822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:47.468258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f4eff-07f3-48ed-bb30-1f756b6b6822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:47.469120 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f4eff-07f3-48ed-bb30-1f756b6b6822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:47.471310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f4eff-07f3-48ed-bb30-1f756b6b6822 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:47.482986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1291/2544] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:47.487456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d9e9b-6183-4be8-b89c-2fd7e362819f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:47.497771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d9e9b-6183-4be8-b89c-2fd7e362819f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:47.503702 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026388fa-3e4f-40d0-b78d-899907bf4325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:47.504637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026388fa-3e4f-40d0-b78d-899907bf4325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:47.504918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026388fa-3e4f-40d0-b78d-899907bf4325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:47.505190 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026388fa-3e4f-40d0-b78d-899907bf4325 admin admin] PATH_INFO: `/v3/projects/d6a6273a2fae4d23979e4be322e6dda1/users/34cedf594d034dbc977519637cd02bf1/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:47.520478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026388fa-3e4f-40d0-b78d-899907bf4325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a6273a2fae4d23979e4be322e6dda1, user_id=34cedf594d034dbc977519637cd02bf1, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:47.523414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026388fa-3e4f-40d0-b78d-899907bf4325 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:47.618566 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1254/2545] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:57:47 2022] PUT /identity/v3/projects/d6a6273a2fae4d23979e4be322e6dda1/users/34cedf594d034dbc977519637cd02bf1/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:47.629954 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b85120-364e-45e8-84e8-d236b97f5efa None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:47.630235 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b85120-364e-45e8-84e8-d236b97f5efa None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:47.630508 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b85120-364e-45e8-84e8-d236b97f5efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:47.657111 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-13b85120-364e-45e8-84e8-d236b97f5efa None None] MFA Rules not processed for user `34cedf594d034dbc977519637cd02bf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:47.658291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-13b85120-364e-45e8-84e8-d236b97f5efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:47.733873 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1292/2546] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:57:47.748289 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026388fa-3e4f-40d0-b78d-899907bf4325 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:47.750390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-026388fa-3e4f-40d0-b78d-899907bf4325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:47.807791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026388fa-3e4f-40d0-b78d-899907bf4325 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:47.812575 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6283c-0fbc-4ce5-b6b1-eb2f768baefd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:47.813222 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6283c-0fbc-4ce5-b6b1-eb2f768baefd service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:47.813529 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6283c-0fbc-4ce5-b6b1-eb2f768baefd service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:47.813811 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6283c-0fbc-4ce5-b6b1-eb2f768baefd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:47.822138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6283c-0fbc-4ce5-b6b1-eb2f768baefd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:47.823596 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6283c-0fbc-4ce5-b6b1-eb2f768baefd service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:47.833136 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1255/2547] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:57:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:57:47.852202 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b85120-364e-45e8-84e8-d236b97f5efa None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:47.918769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b85120-364e-45e8-84e8-d236b97f5efa None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:47.923686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182702d-1ef9-4b76-b4e5-ed288315563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:47.924645 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182702d-1ef9-4b76-b4e5-ed288315563f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:47.924923 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182702d-1ef9-4b76-b4e5-ed288315563f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:47.925216 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182702d-1ef9-4b76-b4e5-ed288315563f admin admin] PATH_INFO: `/v3/users/34cedf594d034dbc977519637cd02bf1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:47.926398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182702d-1ef9-4b76-b4e5-ed288315563f admin admin] RBAC: Authorizing `identity:delete_user(user_id=34cedf594d034dbc977519637cd02bf1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:47.928359 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182702d-1ef9-4b76-b4e5-ed288315563f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:48.135986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7182702d-1ef9-4b76-b4e5-ed288315563f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34cedf594d034dbc977519637cd02bf1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:48.203313 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7182702d-1ef9-4b76-b4e5-ed288315563f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34cedf594d034dbc977519637cd02bf1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:48.203941 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7182702d-1ef9-4b76-b4e5-ed288315563f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34cedf594d034dbc977519637cd02bf1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:48.213292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7182702d-1ef9-4b76-b4e5-ed288315563f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34cedf594d034dbc977519637cd02bf1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:48.224265 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7182702d-1ef9-4b76-b4e5-ed288315563f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34cedf594d034dbc977519637cd02bf1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:48.230322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1293/2548] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:57:47 2022] DELETE /identity/v3/users/34cedf594d034dbc977519637cd02bf1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:57:48.235592 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d6c99-77c9-4f5d-a362-cc13cb8a69c1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:48.242007 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d6c99-77c9-4f5d-a362-cc13cb8a69c1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:48.242007 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d6c99-77c9-4f5d-a362-cc13cb8a69c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:48.255116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a21d6c99-77c9-4f5d-a362-cc13cb8a69c1 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:48.256339 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a21d6c99-77c9-4f5d-a362-cc13cb8a69c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:48.315642 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1256/2549] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:48.325382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182702d-1ef9-4b76-b4e5-ed288315563f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:48.326880 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7182702d-1ef9-4b76-b4e5-ed288315563f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:48.384378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182702d-1ef9-4b76-b4e5-ed288315563f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:48.388334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbd313-42bf-4c76-979f-bde5604ca23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:48.389043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbd313-42bf-4c76-979f-bde5604ca23b service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:48.389325 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbd313-42bf-4c76-979f-bde5604ca23b service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:48.389599 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbd313-42bf-4c76-979f-bde5604ca23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:48.398931 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbd313-42bf-4c76-979f-bde5604ca23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:48.400370 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbd313-42bf-4c76-979f-bde5604ca23b service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:48.411488 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1294/2550] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:57:48.793387 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d6c99-77c9-4f5d-a362-cc13cb8a69c1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:48.798412 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a21d6c99-77c9-4f5d-a362-cc13cb8a69c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:48.815355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d6c99-77c9-4f5d-a362-cc13cb8a69c1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:48.821733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc691c5a-abd5-46be-a868-854e2b88a167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:48.822668 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc691c5a-abd5-46be-a868-854e2b88a167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:48.822934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc691c5a-abd5-46be-a868-854e2b88a167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:48.823276 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc691c5a-abd5-46be-a868-854e2b88a167 admin admin] PATH_INFO: `/v3/projects/d6a6273a2fae4d23979e4be322e6dda1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:48.824814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc691c5a-abd5-46be-a868-854e2b88a167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a6273a2fae4d23979e4be322e6dda1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:48.827479 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc691c5a-abd5-46be-a868-854e2b88a167 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:48.841210 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbd313-42bf-4c76-979f-bde5604ca23b service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:48.843294 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9abbd313-42bf-4c76-979f-bde5604ca23b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:48.858529 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbd313-42bf-4c76-979f-bde5604ca23b service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:48.862571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502680c-362e-4da2-9033-842078b43437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:48.864506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502680c-362e-4da2-9033-842078b43437 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:48.864506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502680c-362e-4da2-9033-842078b43437 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:48.864506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502680c-362e-4da2-9033-842078b43437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:48.865925 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7502680c-362e-4da2-9033-842078b43437 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:48.880495 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502680c-362e-4da2-9033-842078b43437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:48.882217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502680c-362e-4da2-9033-842078b43437 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:48.893603 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1295/2551] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:57:48.958953 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cc691c5a-abd5-46be-a868-854e2b88a167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a6273a2fae4d23979e4be322e6dda1', 'request_id': 'req-cc691c5a-abd5-46be-a868-854e2b88a167'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:48.964407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cc691c5a-abd5-46be-a868-854e2b88a167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a6273a2fae4d23979e4be322e6dda1', 'request_id': 'req-cc691c5a-abd5-46be-a868-854e2b88a167'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:49.031763 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cc691c5a-abd5-46be-a868-854e2b88a167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a6273a2fae4d23979e4be322e6dda1', 'request_id': 'req-cc691c5a-abd5-46be-a868-854e2b88a167'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:49.044977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cc691c5a-abd5-46be-a868-854e2b88a167 admin admin] The token cache is being invalidate because project d6a6273a2fae4d23979e4be322e6dda1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:57:49.045264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cc691c5a-abd5-46be-a868-854e2b88a167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:49.045913 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cc691c5a-abd5-46be-a868-854e2b88a167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:49.048061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1257/2552] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:57:48 2022] DELETE /identity/v3/projects/d6a6273a2fae4d23979e4be322e6dda1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:49.052744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89cb0e-8ab2-4d26-a448-24e0ec9dc247 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:49.053899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89cb0e-8ab2-4d26-a448-24e0ec9dc247 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:49.053899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89cb0e-8ab2-4d26-a448-24e0ec9dc247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:49.073230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-dd89cb0e-8ab2-4d26-a448-24e0ec9dc247 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:49.074643 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dd89cb0e-8ab2-4d26-a448-24e0ec9dc247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:49.140590 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1296/2553] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:57:49.148078 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c2cfc-db73-4f3d-8816-64fbe2eb8edd None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:49.148456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c2cfc-db73-4f3d-8816-64fbe2eb8edd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:49.148880 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c2cfc-db73-4f3d-8816-64fbe2eb8edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:49.167972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-232c2cfc-db73-4f3d-8816-64fbe2eb8edd None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:49.169142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-232c2cfc-db73-4f3d-8816-64fbe2eb8edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:49.177234 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1258/2554] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:49.181490 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89cb0e-8ab2-4d26-a448-24e0ec9dc247 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:49.191981 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89cb0e-8ab2-4d26-a448-24e0ec9dc247 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:49.196841 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da85b34-6cc0-4114-a348-c372509861fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:49.197537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da85b34-6cc0-4114-a348-c372509861fc admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:49.197822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da85b34-6cc0-4114-a348-c372509861fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:49.198099 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da85b34-6cc0-4114-a348-c372509861fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:49.198832 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da85b34-6cc0-4114-a348-c372509861fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:49.199137 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da85b34-6cc0-4114-a348-c372509861fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:49.201482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da85b34-6cc0-4114-a348-c372509861fc admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:49.212926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1297/2555] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:49.217684 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c2cfc-db73-4f3d-8816-64fbe2eb8edd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:49.226630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c2cfc-db73-4f3d-8816-64fbe2eb8edd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:49.231265 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed917d2e-3c4b-41f8-8ba8-be6699e8fef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:49.231997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed917d2e-3c4b-41f8-8ba8-be6699e8fef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:49.232285 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed917d2e-3c4b-41f8-8ba8-be6699e8fef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:49.232591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed917d2e-3c4b-41f8-8ba8-be6699e8fef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:49.233322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed917d2e-3c4b-41f8-8ba8-be6699e8fef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:49.235207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed917d2e-3c4b-41f8-8ba8-be6699e8fef0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:49.379316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1259/2556] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:57:49 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:57:49.380555 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da85b34-6cc0-4114-a348-c372509861fc admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:49.391616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da85b34-6cc0-4114-a348-c372509861fc admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:49.448765 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a06286-e95c-4b4e-aafc-b981a816ce66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:49.449436 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06286-e95c-4b4e-aafc-b981a816ce66 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:49.449767 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06286-e95c-4b4e-aafc-b981a816ce66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:49.450037 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06286-e95c-4b4e-aafc-b981a816ce66 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:49.451376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a06286-e95c-4b4e-aafc-b981a816ce66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:49.454043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a06286-e95c-4b4e-aafc-b981a816ce66 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:49.556040 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1298/2557] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:57:49 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:57:49.557375 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed917d2e-3c4b-41f8-8ba8-be6699e8fef0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:49.568549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed917d2e-3c4b-41f8-8ba8-be6699e8fef0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:49.573378 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91993c6-e398-473f-9f63-be0d71840efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:49.574049 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91993c6-e398-473f-9f63-be0d71840efe admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:49.574335 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91993c6-e398-473f-9f63-be0d71840efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:49.574611 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91993c6-e398-473f-9f63-be0d71840efe admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:49.575487 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91993c6-e398-473f-9f63-be0d71840efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:49.577325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91993c6-e398-473f-9f63-be0d71840efe admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:49.588158 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1260/2558] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:49.592365 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a06286-e95c-4b4e-aafc-b981a816ce66 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:49.602633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a06286-e95c-4b4e-aafc-b981a816ce66 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:49.608727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f56b7-0b23-4300-a03e-409cec8f7133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:49.609451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f56b7-0b23-4300-a03e-409cec8f7133 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:49.610142 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f56b7-0b23-4300-a03e-409cec8f7133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:49.610142 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f56b7-0b23-4300-a03e-409cec8f7133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:49.610948 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f56b7-0b23-4300-a03e-409cec8f7133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:49.612322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f56b7-0b23-4300-a03e-409cec8f7133 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:49.624932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1299/2559] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:57:49.630159 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91993c6-e398-473f-9f63-be0d71840efe admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:49.640482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91993c6-e398-473f-9f63-be0d71840efe admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:49.645562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727813f4-1c26-4505-98ea-5355758df4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:49.646612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727813f4-1c26-4505-98ea-5355758df4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:49.646983 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727813f4-1c26-4505-98ea-5355758df4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:49.648771 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727813f4-1c26-4505-98ea-5355758df4f8 admin admin] PATH_INFO: `/v3/projects/eab8783a18814baabc51716e3973ceb1/users/13049934293d41599fcab97bfd8507ca/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:49.664896 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727813f4-1c26-4505-98ea-5355758df4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab8783a18814baabc51716e3973ceb1, user_id=13049934293d41599fcab97bfd8507ca, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:49.667588 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727813f4-1c26-4505-98ea-5355758df4f8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:49.739283 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1261/2560] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:57:49 2022] PUT /identity/v3/projects/eab8783a18814baabc51716e3973ceb1/users/13049934293d41599fcab97bfd8507ca/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:57:49.754069 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d61a4-e2c7-4733-84f2-855d62d93c12 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:49.754069 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d61a4-e2c7-4733-84f2-855d62d93c12 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:49.754069 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d61a4-e2c7-4733-84f2-855d62d93c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:49.789470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b58d61a4-e2c7-4733-84f2-855d62d93c12 None None] MFA Rules not processed for user `13049934293d41599fcab97bfd8507ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:49.790684 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b58d61a4-e2c7-4733-84f2-855d62d93c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:49.862030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1300/2561] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:49.874066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727813f4-1c26-4505-98ea-5355758df4f8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:49.875813 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-727813f4-1c26-4505-98ea-5355758df4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:49.943170 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727813f4-1c26-4505-98ea-5355758df4f8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:49.947337 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b1975-b553-49fd-9aee-33fe47bda847 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:49.948075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b1975-b553-49fd-9aee-33fe47bda847 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:49.948491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b1975-b553-49fd-9aee-33fe47bda847 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:49.948869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b1975-b553-49fd-9aee-33fe47bda847 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:49.959681 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b1975-b553-49fd-9aee-33fe47bda847 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:49.961381 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b1975-b553-49fd-9aee-33fe47bda847 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:49.974322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1262/2562] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:57:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:57:49.993382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d61a4-e2c7-4733-84f2-855d62d93c12 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:50.062949 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d61a4-e2c7-4733-84f2-855d62d93c12 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:50.067805 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6059e09-fcf2-41af-ae80-31738821b774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:50.068701 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6059e09-fcf2-41af-ae80-31738821b774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:50.068999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6059e09-fcf2-41af-ae80-31738821b774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:50.073544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6059e09-fcf2-41af-ae80-31738821b774 admin admin] PATH_INFO: `/v3/users/13049934293d41599fcab97bfd8507ca` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:50.073544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6059e09-fcf2-41af-ae80-31738821b774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13049934293d41599fcab97bfd8507ca)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:50.073544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6059e09-fcf2-41af-ae80-31738821b774 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:50.276554 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f6059e09-fcf2-41af-ae80-31738821b774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13049934293d41599fcab97bfd8507ca'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:50.367101 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f6059e09-fcf2-41af-ae80-31738821b774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13049934293d41599fcab97bfd8507ca'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:50.370432 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f6059e09-fcf2-41af-ae80-31738821b774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13049934293d41599fcab97bfd8507ca'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:50.380259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f6059e09-fcf2-41af-ae80-31738821b774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13049934293d41599fcab97bfd8507ca'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:50.397334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f6059e09-fcf2-41af-ae80-31738821b774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13049934293d41599fcab97bfd8507ca'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:50.408402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1301/2563] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:57:49 2022] DELETE /identity/v3/users/13049934293d41599fcab97bfd8507ca => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:57:50.410452 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4250f8a-4019-4e98-a101-2662d7ff3c60 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:50.411035 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4250f8a-4019-4e98-a101-2662d7ff3c60 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:50.411356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4250f8a-4019-4e98-a101-2662d7ff3c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:50.433696 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c4250f8a-4019-4e98-a101-2662d7ff3c60 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:50.436199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c4250f8a-4019-4e98-a101-2662d7ff3c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:50.497132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1263/2564] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:50.510322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6059e09-fcf2-41af-ae80-31738821b774 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:50.512544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f6059e09-fcf2-41af-ae80-31738821b774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:50.572168 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6059e09-fcf2-41af-ae80-31738821b774 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:50.575915 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa85fd-3afb-4d5e-bd24-d49a414babfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:50.576592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa85fd-3afb-4d5e-bd24-d49a414babfd service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:50.576869 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa85fd-3afb-4d5e-bd24-d49a414babfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:50.577146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa85fd-3afb-4d5e-bd24-d49a414babfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:50.586641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa85fd-3afb-4d5e-bd24-d49a414babfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:50.588272 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa85fd-3afb-4d5e-bd24-d49a414babfd service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:50.598506 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1302/2565] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:57:51.142823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4250f8a-4019-4e98-a101-2662d7ff3c60 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:51.144370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c4250f8a-4019-4e98-a101-2662d7ff3c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:51.157708 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4250f8a-4019-4e98-a101-2662d7ff3c60 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:51.162545 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91ed85-64bf-4714-8e19-ef289238fd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:51.163443 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91ed85-64bf-4714-8e19-ef289238fd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.163923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91ed85-64bf-4714-8e19-ef289238fd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.164934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91ed85-64bf-4714-8e19-ef289238fd46 admin admin] PATH_INFO: `/v3/projects/eab8783a18814baabc51716e3973ceb1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.170759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91ed85-64bf-4714-8e19-ef289238fd46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab8783a18814baabc51716e3973ceb1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:51.170759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91ed85-64bf-4714-8e19-ef289238fd46 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:51.287154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-de91ed85-64bf-4714-8e19-ef289238fd46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab8783a18814baabc51716e3973ceb1', 'request_id': 'req-de91ed85-64bf-4714-8e19-ef289238fd46'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:51.292956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-de91ed85-64bf-4714-8e19-ef289238fd46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab8783a18814baabc51716e3973ceb1', 'request_id': 'req-de91ed85-64bf-4714-8e19-ef289238fd46'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:51.355535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-de91ed85-64bf-4714-8e19-ef289238fd46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab8783a18814baabc51716e3973ceb1', 'request_id': 'req-de91ed85-64bf-4714-8e19-ef289238fd46'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:51.371561 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-de91ed85-64bf-4714-8e19-ef289238fd46 admin admin] The token cache is being invalidate because project eab8783a18814baabc51716e3973ceb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:57:51.371853 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-de91ed85-64bf-4714-8e19-ef289238fd46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:51.373473 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-de91ed85-64bf-4714-8e19-ef289238fd46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:51.375473 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1264/2566] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:57:51 2022] DELETE /identity/v3/projects/eab8783a18814baabc51716e3973ceb1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:51.380152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdec292-502c-443d-8ab3-328e7bb5080a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.380704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdec292-502c-443d-8ab3-328e7bb5080a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.380805 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdec292-502c-443d-8ab3-328e7bb5080a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.399044 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3fdec292-502c-443d-8ab3-328e7bb5080a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:51.404533 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3fdec292-502c-443d-8ab3-328e7bb5080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:51.466537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1303/2567] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:51.475871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65c619-804b-4071-af32-8dedd14fd014 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.476107 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65c619-804b-4071-af32-8dedd14fd014 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.476375 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65c619-804b-4071-af32-8dedd14fd014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.497069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6c65c619-804b-4071-af32-8dedd14fd014 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:51.498269 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6c65c619-804b-4071-af32-8dedd14fd014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:51.506751 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1265/2568] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:51.511073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdec292-502c-443d-8ab3-328e7bb5080a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:51.520984 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdec292-502c-443d-8ab3-328e7bb5080a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:51.526523 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066eb42-7568-41bb-ac62-d2a217cf0794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:51.527433 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066eb42-7568-41bb-ac62-d2a217cf0794 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.527711 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066eb42-7568-41bb-ac62-d2a217cf0794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.527982 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066eb42-7568-41bb-ac62-d2a217cf0794 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.529276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066eb42-7568-41bb-ac62-d2a217cf0794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:51.529579 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066eb42-7568-41bb-ac62-d2a217cf0794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:51.531186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066eb42-7568-41bb-ac62-d2a217cf0794 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:51.543008 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1304/2569] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:51.548367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65c619-804b-4071-af32-8dedd14fd014 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:51.557421 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65c619-804b-4071-af32-8dedd14fd014 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:51.562334 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45cc76-bba8-424d-869e-a6a4229f9b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:51.562982 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45cc76-bba8-424d-869e-a6a4229f9b30 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.563261 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45cc76-bba8-424d-869e-a6a4229f9b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.563531 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45cc76-bba8-424d-869e-a6a4229f9b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.564223 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45cc76-bba8-424d-869e-a6a4229f9b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:51.566167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45cc76-bba8-424d-869e-a6a4229f9b30 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:51.663753 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1266/2570] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:57:51 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:51.664992 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066eb42-7568-41bb-ac62-d2a217cf0794 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:51.676244 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066eb42-7568-41bb-ac62-d2a217cf0794 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:51.736700 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a339333-3332-470e-a541-790580994700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:51.737364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a339333-3332-470e-a541-790580994700 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.737639 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a339333-3332-470e-a541-790580994700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.737904 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a339333-3332-470e-a541-790580994700 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.738635 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a339333-3332-470e-a541-790580994700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:51.740538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a339333-3332-470e-a541-790580994700 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:51.855398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1305/2571] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:57:51 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:51.862229 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45cc76-bba8-424d-869e-a6a4229f9b30 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:51.877159 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45cc76-bba8-424d-869e-a6a4229f9b30 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:51.882209 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb129982-ed3c-4459-959b-de401cd83a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:51.882940 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb129982-ed3c-4459-959b-de401cd83a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.883224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb129982-ed3c-4459-959b-de401cd83a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.883493 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb129982-ed3c-4459-959b-de401cd83a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.884225 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb129982-ed3c-4459-959b-de401cd83a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:51.885992 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb129982-ed3c-4459-959b-de401cd83a79 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:51.900847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1267/2572] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:51.905263 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a339333-3332-470e-a541-790580994700 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:51.916070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a339333-3332-470e-a541-790580994700 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:51.921203 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b4831-2897-4032-9e06-7e53028c2181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:51.921879 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b4831-2897-4032-9e06-7e53028c2181 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.922161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b4831-2897-4032-9e06-7e53028c2181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.922437 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b4831-2897-4032-9e06-7e53028c2181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.923161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b4831-2897-4032-9e06-7e53028c2181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:51.924930 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b4831-2897-4032-9e06-7e53028c2181 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:51.936420 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1306/2573] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:57:51.940577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb129982-ed3c-4459-959b-de401cd83a79 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:51.961982 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb129982-ed3c-4459-959b-de401cd83a79 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:51.969246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414feab2-9829-4eba-91b3-5e69efbcd5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:51.970167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414feab2-9829-4eba-91b3-5e69efbcd5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:51.970456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414feab2-9829-4eba-91b3-5e69efbcd5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:51.970737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414feab2-9829-4eba-91b3-5e69efbcd5bb admin admin] PATH_INFO: `/v3/projects/24563f17714845519a383ce1a39e2586/users/0c9df7ff39ee475da05d3bb7d36da13f/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:51.990228 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414feab2-9829-4eba-91b3-5e69efbcd5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=24563f17714845519a383ce1a39e2586, user_id=0c9df7ff39ee475da05d3bb7d36da13f, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:51.993095 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414feab2-9829-4eba-91b3-5e69efbcd5bb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:52.115410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1268/2574] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:57:51 2022] PUT /identity/v3/projects/24563f17714845519a383ce1a39e2586/users/0c9df7ff39ee475da05d3bb7d36da13f/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:57:52.128094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c431b9-7294-4fba-82b3-f69c9c4c7b3c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:52.128390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c431b9-7294-4fba-82b3-f69c9c4c7b3c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:52.136715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c431b9-7294-4fba-82b3-f69c9c4c7b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:52.167859 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-08c431b9-7294-4fba-82b3-f69c9c4c7b3c None None] MFA Rules not processed for user `0c9df7ff39ee475da05d3bb7d36da13f`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:52.168794 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-08c431b9-7294-4fba-82b3-f69c9c4c7b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:52.239082 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1307/2575] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:52.250809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414feab2-9829-4eba-91b3-5e69efbcd5bb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:52.252678 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-414feab2-9829-4eba-91b3-5e69efbcd5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:52.310250 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414feab2-9829-4eba-91b3-5e69efbcd5bb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:52.313352 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d547a03-9aff-444d-b1f3-07d40482411b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8e2eb70a5d4dd1b3a9bec2bd0a78a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:52.313999 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d547a03-9aff-444d-b1f3-07d40482411b service glance] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:52.314287 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d547a03-9aff-444d-b1f3-07d40482411b service glance] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:52.314563 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d547a03-9aff-444d-b1f3-07d40482411b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:52.335314 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d547a03-9aff-444d-b1f3-07d40482411b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:52.335314 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d547a03-9aff-444d-b1f3-07d40482411b service glance] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:52.345469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1269/2576] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:57:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:57:53.053513 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c431b9-7294-4fba-82b3-f69c9c4c7b3c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:53.054969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-08c431b9-7294-4fba-82b3-f69c9c4c7b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:53.121783 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c431b9-7294-4fba-82b3-f69c9c4c7b3c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:53.126597 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50568f-eac0-4548-adf0-c9013731c519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:53.127446 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50568f-eac0-4548-adf0-c9013731c519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:53.127715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50568f-eac0-4548-adf0-c9013731c519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:53.127979 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50568f-eac0-4548-adf0-c9013731c519 admin admin] PATH_INFO: `/v3/users/0bf039be83b54817ac2f340cf9dfad63` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:53.129172 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50568f-eac0-4548-adf0-c9013731c519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf039be83b54817ac2f340cf9dfad63)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:53.131073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50568f-eac0-4548-adf0-c9013731c519 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:53.342510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ad50568f-eac0-4548-adf0-c9013731c519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf039be83b54817ac2f340cf9dfad63'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:53.465173 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ad50568f-eac0-4548-adf0-c9013731c519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf039be83b54817ac2f340cf9dfad63'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:53.465926 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ad50568f-eac0-4548-adf0-c9013731c519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf039be83b54817ac2f340cf9dfad63'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:53.474130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ad50568f-eac0-4548-adf0-c9013731c519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf039be83b54817ac2f340cf9dfad63'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:53.487193 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ad50568f-eac0-4548-adf0-c9013731c519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf039be83b54817ac2f340cf9dfad63'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:53.493195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1308/2577] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:57:53 2022] DELETE /identity/v3/users/0bf039be83b54817ac2f340cf9dfad63 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:53.735652 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d547a03-9aff-444d-b1f3-07d40482411b service glance] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:53.750303 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d547a03-9aff-444d-b1f3-07d40482411b service glance] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:53.820376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c16c9-4999-4f57-b795-f08d5731ff67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:53.821301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c16c9-4999-4f57-b795-f08d5731ff67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:53.821608 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c16c9-4999-4f57-b795-f08d5731ff67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:53.821881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c16c9-4999-4f57-b795-f08d5731ff67 admin admin] PATH_INFO: `/v3/projects/6061fedb7a6f46398811de3ae8aa091b` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:53.823444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c16c9-4999-4f57-b795-f08d5731ff67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6061fedb7a6f46398811de3ae8aa091b)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:53.825459 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c16c9-4999-4f57-b795-f08d5731ff67 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:53.952472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b66c16c9-4999-4f57-b795-f08d5731ff67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6061fedb7a6f46398811de3ae8aa091b', 'request_id': 'req-b66c16c9-4999-4f57-b795-f08d5731ff67'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:53.957621 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b66c16c9-4999-4f57-b795-f08d5731ff67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6061fedb7a6f46398811de3ae8aa091b', 'request_id': 'req-b66c16c9-4999-4f57-b795-f08d5731ff67'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:54.036931 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b66c16c9-4999-4f57-b795-f08d5731ff67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6061fedb7a6f46398811de3ae8aa091b', 'request_id': 'req-b66c16c9-4999-4f57-b795-f08d5731ff67'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:54.049010 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b66c16c9-4999-4f57-b795-f08d5731ff67 admin admin] The token cache is being invalidate because project 6061fedb7a6f46398811de3ae8aa091b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:57:54.049299 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b66c16c9-4999-4f57-b795-f08d5731ff67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:54.050045 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b66c16c9-4999-4f57-b795-f08d5731ff67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:57:54.051678 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1270/2578] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:57:53 2022] DELETE /identity/v3/projects/6061fedb7a6f46398811de3ae8aa091b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:54.056627 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5128d2b-f999-4a05-af54-0033b71e6d40 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.057097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5128d2b-f999-4a05-af54-0033b71e6d40 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.057193 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5128d2b-f999-4a05-af54-0033b71e6d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.074388 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c5128d2b-f999-4a05-af54-0033b71e6d40 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:54.076208 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c5128d2b-f999-4a05-af54-0033b71e6d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:54.136588 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1309/2579] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:54.145185 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9ba1e-2d1c-4ac9-8aeb-e82ad03ba255 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.145484 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9ba1e-2d1c-4ac9-8aeb-e82ad03ba255 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.146005 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9ba1e-2d1c-4ac9-8aeb-e82ad03ba255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.165168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-73a9ba1e-2d1c-4ac9-8aeb-e82ad03ba255 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:54.166415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-73a9ba1e-2d1c-4ac9-8aeb-e82ad03ba255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:54.174583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1271/2580] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:54.181081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5128d2b-f999-4a05-af54-0033b71e6d40 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:54.191398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5128d2b-f999-4a05-af54-0033b71e6d40 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:54.199321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc305b-2309-438b-b8af-435ee09d8213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:54.200608 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc305b-2309-438b-b8af-435ee09d8213 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.200894 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc305b-2309-438b-b8af-435ee09d8213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.201232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc305b-2309-438b-b8af-435ee09d8213 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.201940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc305b-2309-438b-b8af-435ee09d8213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:57:54.202215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc305b-2309-438b-b8af-435ee09d8213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:54.221925 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc305b-2309-438b-b8af-435ee09d8213 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:54.221925 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1310/2581] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:57:54.223456 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9ba1e-2d1c-4ac9-8aeb-e82ad03ba255 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:54.232481 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9ba1e-2d1c-4ac9-8aeb-e82ad03ba255 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:54.237828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb64f7-e0fc-431d-96c7-bedd6043ab48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:54.238774 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb64f7-e0fc-431d-96c7-bedd6043ab48 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.239062 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb64f7-e0fc-431d-96c7-bedd6043ab48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.239333 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb64f7-e0fc-431d-96c7-bedd6043ab48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.240027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb64f7-e0fc-431d-96c7-bedd6043ab48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:54.241939 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb64f7-e0fc-431d-96c7-bedd6043ab48 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:54.341825 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1272/2582] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:57:54 2022] POST /identity/v3/projects => generated 409 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:54.345995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc305b-2309-438b-b8af-435ee09d8213 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:54.356065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc305b-2309-438b-b8af-435ee09d8213 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:54.414191 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e23d-09c6-4dd3-848c-bbde48167b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:54.414844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e23d-09c6-4dd3-848c-bbde48167b89 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.415127 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e23d-09c6-4dd3-848c-bbde48167b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.415402 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e23d-09c6-4dd3-848c-bbde48167b89 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.416087 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6e23d-09c6-4dd3-848c-bbde48167b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:54.418035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6e23d-09c6-4dd3-848c-bbde48167b89 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:54.484039 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1311/2583] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:57:54 2022] POST /identity/v3/users => generated 305 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:57:54.488720 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb64f7-e0fc-431d-96c7-bedd6043ab48 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:54.499219 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb64f7-e0fc-431d-96c7-bedd6043ab48 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:54.504128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09da73c-e5a3-44de-bc66-e98447972e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:54.504834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09da73c-e5a3-44de-bc66-e98447972e5f admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.505113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09da73c-e5a3-44de-bc66-e98447972e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.505383 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09da73c-e5a3-44de-bc66-e98447972e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.506110 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09da73c-e5a3-44de-bc66-e98447972e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:54.507704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09da73c-e5a3-44de-bc66-e98447972e5f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:54.518468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1273/2584] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:54.522753 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e23d-09c6-4dd3-848c-bbde48167b89 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:54.533238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e23d-09c6-4dd3-848c-bbde48167b89 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:54.537742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93285296-6777-4564-8043-40ea4bf13f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:54.538400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93285296-6777-4564-8043-40ea4bf13f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.538676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93285296-6777-4564-8043-40ea4bf13f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.538947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93285296-6777-4564-8043-40ea4bf13f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.539658 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93285296-6777-4564-8043-40ea4bf13f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:54.541270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93285296-6777-4564-8043-40ea4bf13f94 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:54.551837 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1312/2585] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:54.556099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09da73c-e5a3-44de-bc66-e98447972e5f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:54.565701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09da73c-e5a3-44de-bc66-e98447972e5f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:54.570258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca744e-a20b-450b-a627-dc8319cbd37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:54.571122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca744e-a20b-450b-a627-dc8319cbd37c admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.571401 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca744e-a20b-450b-a627-dc8319cbd37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.571674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca744e-a20b-450b-a627-dc8319cbd37c admin admin] PATH_INFO: `/v3/projects/35c52a89b07f4a6faa0cfc85024fc331/users/2effa3b650e046cf84b88d77a2e02b8c/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.585539 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca744e-a20b-450b-a627-dc8319cbd37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c52a89b07f4a6faa0cfc85024fc331, user_id=2effa3b650e046cf84b88d77a2e02b8c, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:54.588160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca744e-a20b-450b-a627-dc8319cbd37c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:54.688716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1274/2586] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:57:54 2022] PUT /identity/v3/projects/35c52a89b07f4a6faa0cfc85024fc331/users/2effa3b650e046cf84b88d77a2e02b8c/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:54.699564 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b79402-95ee-4e45-a8e4-2ffd6c48e7c8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.699862 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b79402-95ee-4e45-a8e4-2ffd6c48e7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.700170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b79402-95ee-4e45-a8e4-2ffd6c48e7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.729962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-34b79402-95ee-4e45-a8e4-2ffd6c48e7c8 None None] MFA Rules not processed for user `2effa3b650e046cf84b88d77a2e02b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:54.731768 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-34b79402-95ee-4e45-a8e4-2ffd6c48e7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:54.796053 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1313/2587] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:54 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:57:54.800542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca744e-a20b-450b-a627-dc8319cbd37c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:54.866333 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca744e-a20b-450b-a627-dc8319cbd37c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:54.871098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ce3c6-489f-4e66-8a44-346522c74f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:54.872530 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ce3c6-489f-4e66-8a44-346522c74f4b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:54.872827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ce3c6-489f-4e66-8a44-346522c74f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:54.873108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ce3c6-489f-4e66-8a44-346522c74f4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:54.873803 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ce3c6-489f-4e66-8a44-346522c74f4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:54.875715 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ce3c6-489f-4e66-8a44-346522c74f4b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:54.979239 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1275/2588] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:57:54 2022] POST /identity/v3/projects => generated 409 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:54.983940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b79402-95ee-4e45-a8e4-2ffd6c48e7c8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:54.994731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b79402-95ee-4e45-a8e4-2ffd6c48e7c8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:55.050555 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a1e5f-eee5-46b4-8d26-a29f168daed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:55.051151 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a1e5f-eee5-46b4-8d26-a29f168daed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:55.051431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a1e5f-eee5-46b4-8d26-a29f168daed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:55.051706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a1e5f-eee5-46b4-8d26-a29f168daed4 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:55.052428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a1e5f-eee5-46b4-8d26-a29f168daed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:55.054423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a1e5f-eee5-46b4-8d26-a29f168daed4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:55.139707 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1314/2589] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:57:54 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:57:55.143793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ce3c6-489f-4e66-8a44-346522c74f4b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:55.154832 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ce3c6-489f-4e66-8a44-346522c74f4b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:55.160297 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f2080-8927-4b61-b805-c3a61e47db2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:55.160297 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f2080-8927-4b61-b805-c3a61e47db2c admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:55.160542 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f2080-8927-4b61-b805-c3a61e47db2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:55.160634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f2080-8927-4b61-b805-c3a61e47db2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:55.161356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f2080-8927-4b61-b805-c3a61e47db2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:55.162941 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f2080-8927-4b61-b805-c3a61e47db2c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:55.174147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1276/2590] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:55.178685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a1e5f-eee5-46b4-8d26-a29f168daed4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:55.189134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a1e5f-eee5-46b4-8d26-a29f168daed4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:55.195112 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d65fb-e332-457b-9a8f-5c9ef1817f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:55.196041 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d65fb-e332-457b-9a8f-5c9ef1817f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:55.196341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d65fb-e332-457b-9a8f-5c9ef1817f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:55.196885 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d65fb-e332-457b-9a8f-5c9ef1817f74 admin admin] PATH_INFO: `/v3/projects/3fff82f5b2bb4a4d9927d82cc705d069/users/497c3b59d44341bd83bab0745e64e983/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:55.213001 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d65fb-e332-457b-9a8f-5c9ef1817f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fff82f5b2bb4a4d9927d82cc705d069, user_id=497c3b59d44341bd83bab0745e64e983, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:55.216228 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d65fb-e332-457b-9a8f-5c9ef1817f74 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:55.286401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1315/2591] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:57:55 2022] PUT /identity/v3/projects/3fff82f5b2bb4a4d9927d82cc705d069/users/497c3b59d44341bd83bab0745e64e983/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:55.288178 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f2080-8927-4b61-b805-c3a61e47db2c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:55.300863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f2080-8927-4b61-b805-c3a61e47db2c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:55.376631 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688fa94-decb-40c9-8380-97308fb65cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:55.377308 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688fa94-decb-40c9-8380-97308fb65cdf admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:55.377594 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688fa94-decb-40c9-8380-97308fb65cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:55.377878 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688fa94-decb-40c9-8380-97308fb65cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:55.378610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688fa94-decb-40c9-8380-97308fb65cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:55.380243 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688fa94-decb-40c9-8380-97308fb65cdf admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:55.391087 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1277/2592] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:57:55.395408 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d65fb-e332-457b-9a8f-5c9ef1817f74 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:55.406274 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d65fb-e332-457b-9a8f-5c9ef1817f74 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:55.411294 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14431ee-72d4-4c69-916c-5284a172b04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:55.412170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14431ee-72d4-4c69-916c-5284a172b04c admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:55.412536 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14431ee-72d4-4c69-916c-5284a172b04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:55.412755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14431ee-72d4-4c69-916c-5284a172b04c admin admin] PATH_INFO: `/v3/projects/3fff82f5b2bb4a4d9927d82cc705d069/users/497c3b59d44341bd83bab0745e64e983/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:55.414722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14431ee-72d4-4c69-916c-5284a172b04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fff82f5b2bb4a4d9927d82cc705d069, user_id=497c3b59d44341bd83bab0745e64e983, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:55.417393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14431ee-72d4-4c69-916c-5284a172b04c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:55.427806 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1316/2593] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:57:55 2022] PUT /identity/v3/projects/3fff82f5b2bb4a4d9927d82cc705d069/users/497c3b59d44341bd83bab0745e64e983/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:57:55.438969 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598de96-905f-4300-a3de-e2f944785655 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:55.439276 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598de96-905f-4300-a3de-e2f944785655 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:55.439556 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598de96-905f-4300-a3de-e2f944785655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:55.466318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1598de96-905f-4300-a3de-e2f944785655 None None] MFA Rules not processed for user `497c3b59d44341bd83bab0745e64e983`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:57:55.467528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1598de96-905f-4300-a3de-e2f944785655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:55.537651 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1278/2594] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:57:55 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:57:55.549195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14431ee-72d4-4c69-916c-5284a172b04c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:55.551161 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d14431ee-72d4-4c69-916c-5284a172b04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:57:55.610404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14431ee-72d4-4c69-916c-5284a172b04c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:55.614148 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba293a-07f2-4c2d-9c88-668ee3b484bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:55.614781 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba293a-07f2-4c2d-9c88-668ee3b484bd service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:55.615055 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba293a-07f2-4c2d-9c88-668ee3b484bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:55.615321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba293a-07f2-4c2d-9c88-668ee3b484bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:55.625039 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba293a-07f2-4c2d-9c88-668ee3b484bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:55.626445 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba293a-07f2-4c2d-9c88-668ee3b484bd service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:55.635575 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1317/2595] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:57:55 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:57:56.080717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598de96-905f-4300-a3de-e2f944785655 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:57:56.091115 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598de96-905f-4300-a3de-e2f944785655 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:57:56.094931 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cfd0b-d291-447f-9c0e-5d0da6ecce6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:57:56.097355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cfd0b-d291-447f-9c0e-5d0da6ecce6e service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:57:56.097355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cfd0b-d291-447f-9c0e-5d0da6ecce6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:57:56.097355 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cfd0b-d291-447f-9c0e-5d0da6ecce6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:57:56.159123 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cfd0b-d291-447f-9c0e-5d0da6ecce6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:57:56.160609 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cfd0b-d291-447f-9c0e-5d0da6ecce6e service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:57:56.170103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1279/2596] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:57:56 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:06.139717 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba293a-07f2-4c2d-9c88-668ee3b484bd service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:06.200217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba293a-07f2-4c2d-9c88-668ee3b484bd service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:06.204748 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82ef24-83f7-4dc2-a00a-d09708b1d3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:06.205598 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82ef24-83f7-4dc2-a00a-d09708b1d3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:06.205878 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82ef24-83f7-4dc2-a00a-d09708b1d3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:06.206149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82ef24-83f7-4dc2-a00a-d09708b1d3d2 admin admin] PATH_INFO: `/v3/users/2effa3b650e046cf84b88d77a2e02b8c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:06.207330 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82ef24-83f7-4dc2-a00a-d09708b1d3d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2effa3b650e046cf84b88d77a2e02b8c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:06.209284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82ef24-83f7-4dc2-a00a-d09708b1d3d2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:06.410145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9a82ef24-83f7-4dc2-a00a-d09708b1d3d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2effa3b650e046cf84b88d77a2e02b8c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:06.527065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9a82ef24-83f7-4dc2-a00a-d09708b1d3d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2effa3b650e046cf84b88d77a2e02b8c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:06.527748 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9a82ef24-83f7-4dc2-a00a-d09708b1d3d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2effa3b650e046cf84b88d77a2e02b8c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:06.535486 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9a82ef24-83f7-4dc2-a00a-d09708b1d3d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2effa3b650e046cf84b88d77a2e02b8c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:06.548374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9a82ef24-83f7-4dc2-a00a-d09708b1d3d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2effa3b650e046cf84b88d77a2e02b8c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:06.554776 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1318/2597] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:06 2022] DELETE /identity/v3/users/2effa3b650e046cf84b88d77a2e02b8c => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:06.559780 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549ab1a-b5ca-43bc-8bfd-a99df3c8b77d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:06.560285 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549ab1a-b5ca-43bc-8bfd-a99df3c8b77d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:06.560515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549ab1a-b5ca-43bc-8bfd-a99df3c8b77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:06.580191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f549ab1a-b5ca-43bc-8bfd-a99df3c8b77d None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:06.581549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f549ab1a-b5ca-43bc-8bfd-a99df3c8b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:06.640765 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1280/2598] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:06.650644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82ef24-83f7-4dc2-a00a-d09708b1d3d2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:06.652662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9a82ef24-83f7-4dc2-a00a-d09708b1d3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:06.721317 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82ef24-83f7-4dc2-a00a-d09708b1d3d2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:06.725112 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b3ccb-5de9-4a49-b7c0-bbe2428a4ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:06.725758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b3ccb-5de9-4a49-b7c0-bbe2428a4ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:06.726348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b3ccb-5de9-4a49-b7c0-bbe2428a4ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:06.726623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b3ccb-5de9-4a49-b7c0-bbe2428a4ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:06.736833 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b3ccb-5de9-4a49-b7c0-bbe2428a4ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:06.738285 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b3ccb-5de9-4a49-b7c0-bbe2428a4ce4 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:06.748520 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1319/2599] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:58:07.038346 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549ab1a-b5ca-43bc-8bfd-a99df3c8b77d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:07.039775 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f549ab1a-b5ca-43bc-8bfd-a99df3c8b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:07.097418 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549ab1a-b5ca-43bc-8bfd-a99df3c8b77d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:07.104624 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1557dd-a506-4b92-a539-7753b58f1440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:07.105052 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1557dd-a506-4b92-a539-7753b58f1440 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:07.105467 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1557dd-a506-4b92-a539-7753b58f1440 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:07.106338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1557dd-a506-4b92-a539-7753b58f1440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:07.107995 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8a1557dd-a506-4b92-a539-7753b58f1440 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:07.172600 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1557dd-a506-4b92-a539-7753b58f1440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:07.174047 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1557dd-a506-4b92-a539-7753b58f1440 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:07.183991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1281/2600] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:58:07.332403 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b3ccb-5de9-4a49-b7c0-bbe2428a4ce4 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:07.337478 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e81b3ccb-5de9-4a49-b7c0-bbe2428a4ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:07.351358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b3ccb-5de9-4a49-b7c0-bbe2428a4ce4 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:07.357638 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42b108-9942-4818-9d26-55b489549959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:07.361712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42b108-9942-4818-9d26-55b489549959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:07.361712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42b108-9942-4818-9d26-55b489549959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:07.361712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42b108-9942-4818-9d26-55b489549959 admin admin] PATH_INFO: `/v3/projects/35c52a89b07f4a6faa0cfc85024fc331` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:07.361712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42b108-9942-4818-9d26-55b489549959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35c52a89b07f4a6faa0cfc85024fc331)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:07.362997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42b108-9942-4818-9d26-55b489549959 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:07.474706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fd42b108-9942-4818-9d26-55b489549959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c52a89b07f4a6faa0cfc85024fc331', 'request_id': 'req-fd42b108-9942-4818-9d26-55b489549959'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:07.480209 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fd42b108-9942-4818-9d26-55b489549959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c52a89b07f4a6faa0cfc85024fc331', 'request_id': 'req-fd42b108-9942-4818-9d26-55b489549959'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:07.486789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fd42b108-9942-4818-9d26-55b489549959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c52a89b07f4a6faa0cfc85024fc331', 'request_id': 'req-fd42b108-9942-4818-9d26-55b489549959'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:07.566122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fd42b108-9942-4818-9d26-55b489549959 admin admin] The token cache is being invalidate because project 35c52a89b07f4a6faa0cfc85024fc331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:07.566412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fd42b108-9942-4818-9d26-55b489549959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:07.567063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fd42b108-9942-4818-9d26-55b489549959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:07.569005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1320/2601] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:07 2022] DELETE /identity/v3/projects/35c52a89b07f4a6faa0cfc85024fc331 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:07.572807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1557dd-a506-4b92-a539-7753b58f1440 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:07.590076 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1557dd-a506-4b92-a539-7753b58f1440 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:07.649883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193be984-eb2e-4a47-998a-867f3ed1a02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:07.651164 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193be984-eb2e-4a47-998a-867f3ed1a02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:07.651483 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193be984-eb2e-4a47-998a-867f3ed1a02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:07.651793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193be984-eb2e-4a47-998a-867f3ed1a02c admin admin] PATH_INFO: `/v3/users/497c3b59d44341bd83bab0745e64e983` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:07.653020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193be984-eb2e-4a47-998a-867f3ed1a02c admin admin] RBAC: Authorizing `identity:delete_user(user_id=497c3b59d44341bd83bab0745e64e983)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:07.654956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193be984-eb2e-4a47-998a-867f3ed1a02c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:07.823622 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-193be984-eb2e-4a47-998a-867f3ed1a02c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '497c3b59d44341bd83bab0745e64e983'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:07.835354 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-193be984-eb2e-4a47-998a-867f3ed1a02c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '497c3b59d44341bd83bab0745e64e983'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:07.919506 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-193be984-eb2e-4a47-998a-867f3ed1a02c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '497c3b59d44341bd83bab0745e64e983'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:07.926996 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-193be984-eb2e-4a47-998a-867f3ed1a02c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '497c3b59d44341bd83bab0745e64e983'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:07.928511 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-193be984-eb2e-4a47-998a-867f3ed1a02c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '497c3b59d44341bd83bab0745e64e983'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:07.935790 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1282/2602] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:07 2022] DELETE /identity/v3/users/497c3b59d44341bd83bab0745e64e983 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:08.419940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42b108-9942-4818-9d26-55b489549959 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:08.421530 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fd42b108-9942-4818-9d26-55b489549959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:08.440021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42b108-9942-4818-9d26-55b489549959 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:08.495916 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000d4e2-0d3f-4c39-ae65-9ed9a754658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:08.502527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000d4e2-0d3f-4c39-ae65-9ed9a754658e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:08.502527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000d4e2-0d3f-4c39-ae65-9ed9a754658e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:08.502527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000d4e2-0d3f-4c39-ae65-9ed9a754658e admin admin] PATH_INFO: `/v3/projects/3fff82f5b2bb4a4d9927d82cc705d069` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:08.502527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000d4e2-0d3f-4c39-ae65-9ed9a754658e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fff82f5b2bb4a4d9927d82cc705d069)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:08.502527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000d4e2-0d3f-4c39-ae65-9ed9a754658e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:08.587487 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1000d4e2-0d3f-4c39-ae65-9ed9a754658e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fff82f5b2bb4a4d9927d82cc705d069', 'request_id': 'req-1000d4e2-0d3f-4c39-ae65-9ed9a754658e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:08.595233 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1000d4e2-0d3f-4c39-ae65-9ed9a754658e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fff82f5b2bb4a4d9927d82cc705d069', 'request_id': 'req-1000d4e2-0d3f-4c39-ae65-9ed9a754658e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:08.601893 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1000d4e2-0d3f-4c39-ae65-9ed9a754658e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fff82f5b2bb4a4d9927d82cc705d069', 'request_id': 'req-1000d4e2-0d3f-4c39-ae65-9ed9a754658e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:08.694376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1000d4e2-0d3f-4c39-ae65-9ed9a754658e admin admin] The token cache is being invalidate because project 3fff82f5b2bb4a4d9927d82cc705d069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:08.694376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1000d4e2-0d3f-4c39-ae65-9ed9a754658e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:08.694376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1000d4e2-0d3f-4c39-ae65-9ed9a754658e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:08.694376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1321/2603] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:08 2022] DELETE /identity/v3/projects/3fff82f5b2bb4a4d9927d82cc705d069 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:08.698077 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e61dfd-46c1-4496-99e0-4bbed0a97da1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:08.699240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e61dfd-46c1-4496-99e0-4bbed0a97da1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:08.699240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e61dfd-46c1-4496-99e0-4bbed0a97da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:08.716964 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-39e61dfd-46c1-4496-99e0-4bbed0a97da1 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:08.718164 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-39e61dfd-46c1-4496-99e0-4bbed0a97da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:08.778601 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1283/2604] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:58:08.787680 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbc189-3a21-48a2-8663-ebaf71a139ad None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:08.787988 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbc189-3a21-48a2-8663-ebaf71a139ad None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:08.791906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbc189-3a21-48a2-8663-ebaf71a139ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:08.806483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c9dbc189-3a21-48a2-8663-ebaf71a139ad None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:08.808214 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c9dbc189-3a21-48a2-8663-ebaf71a139ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:08.816220 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1322/2605] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:08.820418 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e61dfd-46c1-4496-99e0-4bbed0a97da1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:08.830867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e61dfd-46c1-4496-99e0-4bbed0a97da1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:08.835570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292f676-baec-4c76-9c0f-2609d00c24c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:08.836223 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292f676-baec-4c76-9c0f-2609d00c24c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:08.836550 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292f676-baec-4c76-9c0f-2609d00c24c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:08.836827 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292f676-baec-4c76-9c0f-2609d00c24c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:08.837602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292f676-baec-4c76-9c0f-2609d00c24c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:08.837914 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292f676-baec-4c76-9c0f-2609d00c24c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:08.839975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292f676-baec-4c76-9c0f-2609d00c24c2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:08.851823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1284/2606] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:08.856382 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbc189-3a21-48a2-8663-ebaf71a139ad None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:08.866068 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbc189-3a21-48a2-8663-ebaf71a139ad None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:08.872612 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f548f-5de9-4011-8500-102f72acb943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:08.873166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f548f-5de9-4011-8500-102f72acb943 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:08.873454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f548f-5de9-4011-8500-102f72acb943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:08.874045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f548f-5de9-4011-8500-102f72acb943 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:08.874654 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f548f-5de9-4011-8500-102f72acb943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:08.876885 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f548f-5de9-4011-8500-102f72acb943 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:08.972351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1323/2607] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:58:08 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:08.976499 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292f676-baec-4c76-9c0f-2609d00c24c2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:08.986442 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292f676-baec-4c76-9c0f-2609d00c24c2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:09.042477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f96c1-9512-4277-aff6-68cf86893ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:09.043224 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f96c1-9512-4277-aff6-68cf86893ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:09.043511 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f96c1-9512-4277-aff6-68cf86893ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:09.043791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f96c1-9512-4277-aff6-68cf86893ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:09.044508 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f96c1-9512-4277-aff6-68cf86893ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:09.046427 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f96c1-9512-4277-aff6-68cf86893ce9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:09.121734 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1285/2608] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:58:08 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:09.125916 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f548f-5de9-4011-8500-102f72acb943 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:09.136156 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f548f-5de9-4011-8500-102f72acb943 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:09.140770 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d415ae-6a2a-4eea-983d-95c03a5262a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:09.141375 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d415ae-6a2a-4eea-983d-95c03a5262a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:09.147547 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d415ae-6a2a-4eea-983d-95c03a5262a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:09.147547 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d415ae-6a2a-4eea-983d-95c03a5262a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:09.147547 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d415ae-6a2a-4eea-983d-95c03a5262a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:09.147547 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d415ae-6a2a-4eea-983d-95c03a5262a6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:09.154751 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1324/2609] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:09.158733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f96c1-9512-4277-aff6-68cf86893ce9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:09.169089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f96c1-9512-4277-aff6-68cf86893ce9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:09.173712 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4eba0-8cf1-444b-928e-cc472a9e9fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:09.174363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4eba0-8cf1-444b-928e-cc472a9e9fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:09.174640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4eba0-8cf1-444b-928e-cc472a9e9fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:09.174910 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4eba0-8cf1-444b-928e-cc472a9e9fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:09.175633 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4eba0-8cf1-444b-928e-cc472a9e9fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:09.177232 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4eba0-8cf1-444b-928e-cc472a9e9fe5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:09.188017 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1286/2610] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:09.192305 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d415ae-6a2a-4eea-983d-95c03a5262a6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:09.202258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d415ae-6a2a-4eea-983d-95c03a5262a6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:09.206830 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f0e73-af95-4c9b-81c6-5bbc709c25ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:09.207687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f0e73-af95-4c9b-81c6-5bbc709c25ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:09.207961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f0e73-af95-4c9b-81c6-5bbc709c25ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:09.208229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f0e73-af95-4c9b-81c6-5bbc709c25ab admin admin] PATH_INFO: `/v3/projects/cfd00682b0d64804a96631127887751f/users/ba611405b50649bba3625e8d0b89f9da/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:09.222121 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f0e73-af95-4c9b-81c6-5bbc709c25ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd00682b0d64804a96631127887751f, user_id=ba611405b50649bba3625e8d0b89f9da, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:09.224906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f0e73-af95-4c9b-81c6-5bbc709c25ab admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:09.315790 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1325/2611] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:09 2022] PUT /identity/v3/projects/cfd00682b0d64804a96631127887751f/users/ba611405b50649bba3625e8d0b89f9da/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:09.327097 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9cbcf-a572-4597-b21c-5335c24d2864 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:09.327480 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9cbcf-a572-4597-b21c-5335c24d2864 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:09.327762 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9cbcf-a572-4597-b21c-5335c24d2864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:09.353968 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1cb9cbcf-a572-4597-b21c-5335c24d2864 None None] MFA Rules not processed for user `ba611405b50649bba3625e8d0b89f9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:09.355749 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1cb9cbcf-a572-4597-b21c-5335c24d2864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:09.417805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1287/2612] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:09.422281 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f0e73-af95-4c9b-81c6-5bbc709c25ab admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:09.483058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f0e73-af95-4c9b-81c6-5bbc709c25ab admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:09.487617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d06ddf-5e27-4083-a59c-92aaa9da5a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:09.488273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d06ddf-5e27-4083-a59c-92aaa9da5a9b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:09.488586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d06ddf-5e27-4083-a59c-92aaa9da5a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:09.488865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d06ddf-5e27-4083-a59c-92aaa9da5a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:09.489564 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d06ddf-5e27-4083-a59c-92aaa9da5a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:09.491459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d06ddf-5e27-4083-a59c-92aaa9da5a9b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:09.574080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1326/2613] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:58:09 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:09.578138 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9cbcf-a572-4597-b21c-5335c24d2864 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:09.590513 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9cbcf-a572-4597-b21c-5335c24d2864 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:09.646687 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d59371-f677-4893-855b-d2c26e2f3bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:09.647356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59371-f677-4893-855b-d2c26e2f3bef admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:09.647641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59371-f677-4893-855b-d2c26e2f3bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:09.647916 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59371-f677-4893-855b-d2c26e2f3bef admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:09.648645 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d59371-f677-4893-855b-d2c26e2f3bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:09.650855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d59371-f677-4893-855b-d2c26e2f3bef admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:09.721470 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1288/2614] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:58:09 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:09.725430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d06ddf-5e27-4083-a59c-92aaa9da5a9b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:09.736650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d06ddf-5e27-4083-a59c-92aaa9da5a9b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:09.741428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746cd8f-a56d-4eba-a285-f4d3c3a79c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:09.742081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746cd8f-a56d-4eba-a285-f4d3c3a79c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:09.742351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746cd8f-a56d-4eba-a285-f4d3c3a79c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:09.742652 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746cd8f-a56d-4eba-a285-f4d3c3a79c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:09.743373 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746cd8f-a56d-4eba-a285-f4d3c3a79c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:09.745038 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746cd8f-a56d-4eba-a285-f4d3c3a79c48 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:09.755687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1327/2615] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:09.760652 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d59371-f677-4893-855b-d2c26e2f3bef admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:09.770495 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d59371-f677-4893-855b-d2c26e2f3bef admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:09.775399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9625295-d643-4fe9-982a-f4b7670a8fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:09.776820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9625295-d643-4fe9-982a-f4b7670a8fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:09.777100 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9625295-d643-4fe9-982a-f4b7670a8fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:09.777514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9625295-d643-4fe9-982a-f4b7670a8fd9 admin admin] PATH_INFO: `/v3/projects/1289b6dcb0d446c6b8c60d1fded38156/users/3ab5db774d01470ea1c4613300b3c33d/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:09.792433 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9625295-d643-4fe9-982a-f4b7670a8fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1289b6dcb0d446c6b8c60d1fded38156, user_id=3ab5db774d01470ea1c4613300b3c33d, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:09.795249 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9625295-d643-4fe9-982a-f4b7670a8fd9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:09.867070 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1289/2616] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:09 2022] PUT /identity/v3/projects/1289b6dcb0d446c6b8c60d1fded38156/users/3ab5db774d01470ea1c4613300b3c33d/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:09.871006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746cd8f-a56d-4eba-a285-f4d3c3a79c48 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:09.880919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746cd8f-a56d-4eba-a285-f4d3c3a79c48 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:09.940135 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fb8a5-3963-4ffd-bd21-b3689dcff294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:09.940821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fb8a5-3963-4ffd-bd21-b3689dcff294 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:09.941102 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fb8a5-3963-4ffd-bd21-b3689dcff294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:09.941377 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fb8a5-3963-4ffd-bd21-b3689dcff294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:09.942096 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fb8a5-3963-4ffd-bd21-b3689dcff294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:09.943904 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fb8a5-3963-4ffd-bd21-b3689dcff294 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:09.959584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1328/2617] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:09.969188 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9625295-d643-4fe9-982a-f4b7670a8fd9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:09.979980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9625295-d643-4fe9-982a-f4b7670a8fd9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:09.984733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b518bc4-0d75-4c2f-a708-796779d70d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:09.985623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b518bc4-0d75-4c2f-a708-796779d70d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:09.985906 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b518bc4-0d75-4c2f-a708-796779d70d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:09.986301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b518bc4-0d75-4c2f-a708-796779d70d92 admin admin] PATH_INFO: `/v3/projects/1289b6dcb0d446c6b8c60d1fded38156/users/3ab5db774d01470ea1c4613300b3c33d/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:09.988366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b518bc4-0d75-4c2f-a708-796779d70d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1289b6dcb0d446c6b8c60d1fded38156, user_id=3ab5db774d01470ea1c4613300b3c33d, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:09.990955 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b518bc4-0d75-4c2f-a708-796779d70d92 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:10.001273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1290/2618] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:09 2022] PUT /identity/v3/projects/1289b6dcb0d446c6b8c60d1fded38156/users/3ab5db774d01470ea1c4613300b3c33d/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:10.011890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbbcc3-baf3-4501-abe5-212383c3a7d7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:10.012176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbbcc3-baf3-4501-abe5-212383c3a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:10.012466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbbcc3-baf3-4501-abe5-212383c3a7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:10.039201 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-bdcbbcc3-baf3-4501-abe5-212383c3a7d7 None None] MFA Rules not processed for user `3ab5db774d01470ea1c4613300b3c33d`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:10.040415 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bdcbbcc3-baf3-4501-abe5-212383c3a7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:10.106865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1329/2619] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:10.117327 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b518bc4-0d75-4c2f-a708-796779d70d92 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:10.119067 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5b518bc4-0d75-4c2f-a708-796779d70d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:10.174196 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b518bc4-0d75-4c2f-a708-796779d70d92 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:10.177815 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116cd3f-438e-4e1a-91b9-090e971ee8ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:10.178446 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116cd3f-438e-4e1a-91b9-090e971ee8ef service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:10.178728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116cd3f-438e-4e1a-91b9-090e971ee8ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:10.178998 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116cd3f-438e-4e1a-91b9-090e971ee8ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:10.188292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116cd3f-438e-4e1a-91b9-090e971ee8ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:10.189727 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116cd3f-438e-4e1a-91b9-090e971ee8ef service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:10.199419 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1291/2620] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:10.719572 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbbcc3-baf3-4501-abe5-212383c3a7d7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:10.780166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbbcc3-baf3-4501-abe5-212383c3a7d7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:10.784780 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38498c1-a3cf-457e-afbb-3701e007643a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:10.785640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38498c1-a3cf-457e-afbb-3701e007643a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:10.785930 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38498c1-a3cf-457e-afbb-3701e007643a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:10.786190 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38498c1-a3cf-457e-afbb-3701e007643a admin admin] PATH_INFO: `/v3/users/ba611405b50649bba3625e8d0b89f9da` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:10.787367 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38498c1-a3cf-457e-afbb-3701e007643a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba611405b50649bba3625e8d0b89f9da)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:10.789335 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38498c1-a3cf-457e-afbb-3701e007643a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:10.951637 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c38498c1-a3cf-457e-afbb-3701e007643a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba611405b50649bba3625e8d0b89f9da'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:11.023584 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c38498c1-a3cf-457e-afbb-3701e007643a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba611405b50649bba3625e8d0b89f9da'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:11.024201 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c38498c1-a3cf-457e-afbb-3701e007643a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba611405b50649bba3625e8d0b89f9da'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:11.031790 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c38498c1-a3cf-457e-afbb-3701e007643a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba611405b50649bba3625e8d0b89f9da'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:11.044785 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c38498c1-a3cf-457e-afbb-3701e007643a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba611405b50649bba3625e8d0b89f9da'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:11.050582 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1330/2621] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:10 2022] DELETE /identity/v3/users/ba611405b50649bba3625e8d0b89f9da => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:11.055208 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1bc52-ab8f-4553-8672-ff0d1f7568b0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:11.055665 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1bc52-ab8f-4553-8672-ff0d1f7568b0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:11.055759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1bc52-ab8f-4553-8672-ff0d1f7568b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:11.074642 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6df1bc52-ab8f-4553-8672-ff0d1f7568b0 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:11.076143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6df1bc52-ab8f-4553-8672-ff0d1f7568b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:11.136749 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1292/2622] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:11.146259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38498c1-a3cf-457e-afbb-3701e007643a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:11.147633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c38498c1-a3cf-457e-afbb-3701e007643a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:11.204140 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38498c1-a3cf-457e-afbb-3701e007643a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:11.207703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278de52-3234-494e-9240-2e35239c132d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:11.208398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278de52-3234-494e-9240-2e35239c132d service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:11.208718 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278de52-3234-494e-9240-2e35239c132d service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:11.208996 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278de52-3234-494e-9240-2e35239c132d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:11.218254 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278de52-3234-494e-9240-2e35239c132d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:11.219686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278de52-3234-494e-9240-2e35239c132d service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:11.229264 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1331/2623] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:11.614235 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1bc52-ab8f-4553-8672-ff0d1f7568b0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:11.615425 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6df1bc52-ab8f-4553-8672-ff0d1f7568b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:11.629826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1bc52-ab8f-4553-8672-ff0d1f7568b0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:11.634581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9531e5-51cb-4c3a-afa2-6962bb149415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:11.635477 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9531e5-51cb-4c3a-afa2-6962bb149415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:11.635927 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9531e5-51cb-4c3a-afa2-6962bb149415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:11.636383 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9531e5-51cb-4c3a-afa2-6962bb149415 admin admin] PATH_INFO: `/v3/projects/cfd00682b0d64804a96631127887751f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:11.637719 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9531e5-51cb-4c3a-afa2-6962bb149415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd00682b0d64804a96631127887751f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:11.639755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9531e5-51cb-4c3a-afa2-6962bb149415 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:11.778687 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-df9531e5-51cb-4c3a-afa2-6962bb149415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd00682b0d64804a96631127887751f', 'request_id': 'req-df9531e5-51cb-4c3a-afa2-6962bb149415'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:11.787944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-df9531e5-51cb-4c3a-afa2-6962bb149415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd00682b0d64804a96631127887751f', 'request_id': 'req-df9531e5-51cb-4c3a-afa2-6962bb149415'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:11.886546 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-df9531e5-51cb-4c3a-afa2-6962bb149415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd00682b0d64804a96631127887751f', 'request_id': 'req-df9531e5-51cb-4c3a-afa2-6962bb149415'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:11.898510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-df9531e5-51cb-4c3a-afa2-6962bb149415 admin admin] The token cache is being invalidate because project cfd00682b0d64804a96631127887751f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:11.898797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-df9531e5-51cb-4c3a-afa2-6962bb149415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:11.899462 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-df9531e5-51cb-4c3a-afa2-6962bb149415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:11.901948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1293/2624] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:11 2022] DELETE /identity/v3/projects/cfd00682b0d64804a96631127887751f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:11.906056 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278de52-3234-494e-9240-2e35239c132d service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:11.915660 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278de52-3234-494e-9240-2e35239c132d service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:11.971109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf947b4-2371-4cfc-8033-8ef01f96da23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:11.971971 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf947b4-2371-4cfc-8033-8ef01f96da23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:11.972247 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf947b4-2371-4cfc-8033-8ef01f96da23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:11.972546 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf947b4-2371-4cfc-8033-8ef01f96da23 admin admin] PATH_INFO: `/v3/users/3ab5db774d01470ea1c4613300b3c33d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:11.973758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf947b4-2371-4cfc-8033-8ef01f96da23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab5db774d01470ea1c4613300b3c33d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:11.978431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf947b4-2371-4cfc-8033-8ef01f96da23 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:12.191036 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-aaf947b4-2371-4cfc-8033-8ef01f96da23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab5db774d01470ea1c4613300b3c33d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:12.302485 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-aaf947b4-2371-4cfc-8033-8ef01f96da23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab5db774d01470ea1c4613300b3c33d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:12.303228 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-aaf947b4-2371-4cfc-8033-8ef01f96da23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab5db774d01470ea1c4613300b3c33d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:12.310964 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-aaf947b4-2371-4cfc-8033-8ef01f96da23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab5db774d01470ea1c4613300b3c33d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:12.322412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-aaf947b4-2371-4cfc-8033-8ef01f96da23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab5db774d01470ea1c4613300b3c33d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:12.329127 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1332/2625] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:11 2022] DELETE /identity/v3/users/3ab5db774d01470ea1c4613300b3c33d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:12.796559 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9531e5-51cb-4c3a-afa2-6962bb149415 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:12.799652 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-df9531e5-51cb-4c3a-afa2-6962bb149415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:12.813298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9531e5-51cb-4c3a-afa2-6962bb149415 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:12.870643 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8c179-7f59-4ec3-99fe-b6f43394f679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:12.871519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8c179-7f59-4ec3-99fe-b6f43394f679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:12.871809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8c179-7f59-4ec3-99fe-b6f43394f679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:12.872090 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8c179-7f59-4ec3-99fe-b6f43394f679 admin admin] PATH_INFO: `/v3/projects/1289b6dcb0d446c6b8c60d1fded38156` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:12.873449 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8c179-7f59-4ec3-99fe-b6f43394f679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1289b6dcb0d446c6b8c60d1fded38156)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:12.875424 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8c179-7f59-4ec3-99fe-b6f43394f679 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:13.017791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-34e8c179-7f59-4ec3-99fe-b6f43394f679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1289b6dcb0d446c6b8c60d1fded38156', 'request_id': 'req-34e8c179-7f59-4ec3-99fe-b6f43394f679'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:13.023890 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-34e8c179-7f59-4ec3-99fe-b6f43394f679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1289b6dcb0d446c6b8c60d1fded38156', 'request_id': 'req-34e8c179-7f59-4ec3-99fe-b6f43394f679'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:13.109080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-34e8c179-7f59-4ec3-99fe-b6f43394f679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1289b6dcb0d446c6b8c60d1fded38156', 'request_id': 'req-34e8c179-7f59-4ec3-99fe-b6f43394f679'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:13.120680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-34e8c179-7f59-4ec3-99fe-b6f43394f679 admin admin] The token cache is being invalidate because project 1289b6dcb0d446c6b8c60d1fded38156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:13.120973 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-34e8c179-7f59-4ec3-99fe-b6f43394f679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:13.121612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-34e8c179-7f59-4ec3-99fe-b6f43394f679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:13.123168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1294/2626] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:12 2022] DELETE /identity/v3/projects/1289b6dcb0d446c6b8c60d1fded38156 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:13.128209 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1b6b9-b513-4a7c-968d-c4057c3074c3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:13.128742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1b6b9-b513-4a7c-968d-c4057c3074c3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:13.128854 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1b6b9-b513-4a7c-968d-c4057c3074c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:13.147052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7ba1b6b9-b513-4a7c-968d-c4057c3074c3 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:13.148246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7ba1b6b9-b513-4a7c-968d-c4057c3074c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:13.208027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1333/2627] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:13.216380 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dac16-bbe3-4fb2-accd-a3b8677a1eed None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:13.216784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dac16-bbe3-4fb2-accd-a3b8677a1eed None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:13.217132 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dac16-bbe3-4fb2-accd-a3b8677a1eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:13.235961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-be9dac16-bbe3-4fb2-accd-a3b8677a1eed None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:13.237230 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-be9dac16-bbe3-4fb2-accd-a3b8677a1eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:13.245692 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1295/2628] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:13.250310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1b6b9-b513-4a7c-968d-c4057c3074c3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:13.260766 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1b6b9-b513-4a7c-968d-c4057c3074c3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:13.265605 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca313692-0051-47ba-bd40-8c916cf42727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:13.266255 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca313692-0051-47ba-bd40-8c916cf42727 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:13.266567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca313692-0051-47ba-bd40-8c916cf42727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:13.266841 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca313692-0051-47ba-bd40-8c916cf42727 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:13.267562 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca313692-0051-47ba-bd40-8c916cf42727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:13.267870 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca313692-0051-47ba-bd40-8c916cf42727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:13.269488 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca313692-0051-47ba-bd40-8c916cf42727 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:13.281861 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1334/2629] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:13.286051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dac16-bbe3-4fb2-accd-a3b8677a1eed None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:13.295230 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dac16-bbe3-4fb2-accd-a3b8677a1eed None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:13.299812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fc944-ff42-4de3-a7be-42921401970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:13.300489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fc944-ff42-4de3-a7be-42921401970b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:13.300778 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fc944-ff42-4de3-a7be-42921401970b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:13.301051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fc944-ff42-4de3-a7be-42921401970b admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:13.301907 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fc944-ff42-4de3-a7be-42921401970b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:13.303629 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fc944-ff42-4de3-a7be-42921401970b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:13.454411 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1296/2630] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:58:13 2022] POST /identity/v3/projects => generated 359 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:13.463538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca313692-0051-47ba-bd40-8c916cf42727 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:13.474499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca313692-0051-47ba-bd40-8c916cf42727 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:13.534189 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a25919-5214-4b88-8d0a-7699919eae58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:13.534854 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a25919-5214-4b88-8d0a-7699919eae58 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:13.535137 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a25919-5214-4b88-8d0a-7699919eae58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:13.535414 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a25919-5214-4b88-8d0a-7699919eae58 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:13.536091 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a25919-5214-4b88-8d0a-7699919eae58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:13.538031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a25919-5214-4b88-8d0a-7699919eae58 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:13.638021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1335/2631] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:58:13 2022] POST /identity/v3/users => generated 280 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:13.640421 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fc944-ff42-4de3-a7be-42921401970b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:13.647035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a25919-5214-4b88-8d0a-7699919eae58 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:13.648866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-79a25919-5214-4b88-8d0a-7699919eae58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:13.652635 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fc944-ff42-4de3-a7be-42921401970b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:13.660824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c14ec-dcf7-45e6-8e70-25413722958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:13.661486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c14ec-dcf7-45e6-8e70-25413722958b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:13.661767 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c14ec-dcf7-45e6-8e70-25413722958b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:13.662039 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c14ec-dcf7-45e6-8e70-25413722958b admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:13.662800 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c14ec-dcf7-45e6-8e70-25413722958b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:13.664394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c14ec-dcf7-45e6-8e70-25413722958b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:13.677194 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1297/2632] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:13.681041 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c14ec-dcf7-45e6-8e70-25413722958b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:13.691909 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c14ec-dcf7-45e6-8e70-25413722958b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:13.696626 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19a399-4a44-4026-9a15-aceff2ccb49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:13.697278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19a399-4a44-4026-9a15-aceff2ccb49f admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:13.698137 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19a399-4a44-4026-9a15-aceff2ccb49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:13.698440 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19a399-4a44-4026-9a15-aceff2ccb49f admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:13.699218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19a399-4a44-4026-9a15-aceff2ccb49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:13.700796 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19a399-4a44-4026-9a15-aceff2ccb49f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:13.712483 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1298/2633] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:58:13.712645 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a25919-5214-4b88-8d0a-7699919eae58 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:13.715333 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19a399-4a44-4026-9a15-aceff2ccb49f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:13.717015 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455da53e-15f1-4704-9403-11ca4e8fc77a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:13.717722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455da53e-15f1-4704-9403-11ca4e8fc77a service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:13.718069 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455da53e-15f1-4704-9403-11ca4e8fc77a service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:13.718412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455da53e-15f1-4704-9403-11ca4e8fc77a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:13.720225 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-455da53e-15f1-4704-9403-11ca4e8fc77a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:13.725066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19a399-4a44-4026-9a15-aceff2ccb49f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:13.729970 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b4f65-ae32-4b72-969e-aca8bdee35fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:13.730844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b4f65-ae32-4b72-969e-aca8bdee35fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:13.731128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b4f65-ae32-4b72-969e-aca8bdee35fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:13.731413 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b4f65-ae32-4b72-969e-aca8bdee35fc admin admin] PATH_INFO: `/v3/projects/40a5f5c0e96f4c5683bcd3a39461077b/users/581e501783ba47bdbeb203758fd2d06d/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:13.732505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455da53e-15f1-4704-9403-11ca4e8fc77a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:13.733932 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455da53e-15f1-4704-9403-11ca4e8fc77a service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:13.743557 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1336/2634] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:58:13.745876 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b4f65-ae32-4b72-969e-aca8bdee35fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a5f5c0e96f4c5683bcd3a39461077b, user_id=581e501783ba47bdbeb203758fd2d06d, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:13.748552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b4f65-ae32-4b72-969e-aca8bdee35fc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:13.887379 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1299/2635] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:13 2022] PUT /identity/v3/projects/40a5f5c0e96f4c5683bcd3a39461077b/users/581e501783ba47bdbeb203758fd2d06d/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:13.898017 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aec6e-4485-4e2d-87ed-1fdc85f5f0b8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:13.898305 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aec6e-4485-4e2d-87ed-1fdc85f5f0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:13.898580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aec6e-4485-4e2d-87ed-1fdc85f5f0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:13.929993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ac9aec6e-4485-4e2d-87ed-1fdc85f5f0b8 None None] MFA Rules not processed for user `581e501783ba47bdbeb203758fd2d06d`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:13.931349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ac9aec6e-4485-4e2d-87ed-1fdc85f5f0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:14.007266 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1337/2636] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:13 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:14.039267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b4f65-ae32-4b72-969e-aca8bdee35fc admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:14.041293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f56b4f65-ae32-4b72-969e-aca8bdee35fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:14.098380 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b4f65-ae32-4b72-969e-aca8bdee35fc admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:14.102145 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a04858-3f49-4e8c-88c7-105f4def7bd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:14.103277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a04858-3f49-4e8c-88c7-105f4def7bd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:14.103277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a04858-3f49-4e8c-88c7-105f4def7bd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:14.103489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a04858-3f49-4e8c-88c7-105f4def7bd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:14.112129 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a04858-3f49-4e8c-88c7-105f4def7bd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:14.113573 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a04858-3f49-4e8c-88c7-105f4def7bd1 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:14.122927 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1300/2637] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:14 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:14.138781 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aec6e-4485-4e2d-87ed-1fdc85f5f0b8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:14.203310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aec6e-4485-4e2d-87ed-1fdc85f5f0b8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:14.207973 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730804b5-01ff-4997-b8c7-0eb8910d3c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:14.209084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730804b5-01ff-4997-b8c7-0eb8910d3c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:14.209212 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730804b5-01ff-4997-b8c7-0eb8910d3c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:14.209433 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730804b5-01ff-4997-b8c7-0eb8910d3c31 admin admin] PATH_INFO: `/v3/users/581e501783ba47bdbeb203758fd2d06d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:14.210662 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730804b5-01ff-4997-b8c7-0eb8910d3c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=581e501783ba47bdbeb203758fd2d06d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:14.212623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730804b5-01ff-4997-b8c7-0eb8910d3c31 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:14.408796 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-730804b5-01ff-4997-b8c7-0eb8910d3c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581e501783ba47bdbeb203758fd2d06d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:14.496736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-730804b5-01ff-4997-b8c7-0eb8910d3c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581e501783ba47bdbeb203758fd2d06d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:14.497395 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-730804b5-01ff-4997-b8c7-0eb8910d3c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581e501783ba47bdbeb203758fd2d06d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:14.504533 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-730804b5-01ff-4997-b8c7-0eb8910d3c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581e501783ba47bdbeb203758fd2d06d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:14.518666 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-730804b5-01ff-4997-b8c7-0eb8910d3c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581e501783ba47bdbeb203758fd2d06d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:14.525116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1338/2638] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:14 2022] DELETE /identity/v3/users/581e501783ba47bdbeb203758fd2d06d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:14.529777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89835434-2890-422e-b8a2-2ed8a8be98d8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:14.530115 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89835434-2890-422e-b8a2-2ed8a8be98d8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:14.530322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89835434-2890-422e-b8a2-2ed8a8be98d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:14.551065 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-89835434-2890-422e-b8a2-2ed8a8be98d8 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:14.552393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-89835434-2890-422e-b8a2-2ed8a8be98d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:14.611767 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1301/2639] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:14.622577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730804b5-01ff-4997-b8c7-0eb8910d3c31 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:14.623989 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-730804b5-01ff-4997-b8c7-0eb8910d3c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:14.681609 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730804b5-01ff-4997-b8c7-0eb8910d3c31 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:14.686611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273d0aa-d942-4864-8bd7-f4d63d2ebbd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:14.687248 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273d0aa-d942-4864-8bd7-f4d63d2ebbd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:14.687529 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273d0aa-d942-4864-8bd7-f4d63d2ebbd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:14.687798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273d0aa-d942-4864-8bd7-f4d63d2ebbd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:14.697038 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273d0aa-d942-4864-8bd7-f4d63d2ebbd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:14.699699 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273d0aa-d942-4864-8bd7-f4d63d2ebbd8 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:14.709899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1339/2640] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:15.003997 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89835434-2890-422e-b8a2-2ed8a8be98d8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:15.006543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-89835434-2890-422e-b8a2-2ed8a8be98d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:15.022733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89835434-2890-422e-b8a2-2ed8a8be98d8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:15.033314 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c81ed-c2c3-44ab-aa7e-a57c05afe3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:15.034462 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c81ed-c2c3-44ab-aa7e-a57c05afe3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:15.034949 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c81ed-c2c3-44ab-aa7e-a57c05afe3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:15.035540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c81ed-c2c3-44ab-aa7e-a57c05afe3ac admin admin] PATH_INFO: `/v3/users/0c9df7ff39ee475da05d3bb7d36da13f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:15.037620 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c81ed-c2c3-44ab-aa7e-a57c05afe3ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c9df7ff39ee475da05d3bb7d36da13f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:15.039890 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c81ed-c2c3-44ab-aa7e-a57c05afe3ac admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:15.170347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273d0aa-d942-4864-8bd7-f4d63d2ebbd8 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:15.172200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f273d0aa-d942-4864-8bd7-f4d63d2ebbd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:15.189575 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273d0aa-d942-4864-8bd7-f4d63d2ebbd8 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:15.195804 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c32bf-e6d0-437a-9871-af5ea035f7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:15.199084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c32bf-e6d0-437a-9871-af5ea035f7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:15.199084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c32bf-e6d0-437a-9871-af5ea035f7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:15.199084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c32bf-e6d0-437a-9871-af5ea035f7d0 admin admin] PATH_INFO: `/v3/projects/40a5f5c0e96f4c5683bcd3a39461077b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:15.200248 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c32bf-e6d0-437a-9871-af5ea035f7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40a5f5c0e96f4c5683bcd3a39461077b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:15.202134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c32bf-e6d0-437a-9871-af5ea035f7d0 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:15.260090 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ea4c81ed-c2c3-44ab-aa7e-a57c05afe3ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c9df7ff39ee475da05d3bb7d36da13f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:15.272947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ea4c81ed-c2c3-44ab-aa7e-a57c05afe3ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c9df7ff39ee475da05d3bb7d36da13f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:15.319344 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4f4c32bf-e6d0-437a-9871-af5ea035f7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40a5f5c0e96f4c5683bcd3a39461077b', 'request_id': 'req-4f4c32bf-e6d0-437a-9871-af5ea035f7d0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:15.325509 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4f4c32bf-e6d0-437a-9871-af5ea035f7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40a5f5c0e96f4c5683bcd3a39461077b', 'request_id': 'req-4f4c32bf-e6d0-437a-9871-af5ea035f7d0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:15.334036 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4f4c32bf-e6d0-437a-9871-af5ea035f7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40a5f5c0e96f4c5683bcd3a39461077b', 'request_id': 'req-4f4c32bf-e6d0-437a-9871-af5ea035f7d0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:15.360088 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ea4c81ed-c2c3-44ab-aa7e-a57c05afe3ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c9df7ff39ee475da05d3bb7d36da13f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:15.367589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ea4c81ed-c2c3-44ab-aa7e-a57c05afe3ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c9df7ff39ee475da05d3bb7d36da13f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:15.368297 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ea4c81ed-c2c3-44ab-aa7e-a57c05afe3ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c9df7ff39ee475da05d3bb7d36da13f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:15.377640 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1302/2641] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:15 2022] DELETE /identity/v3/users/0c9df7ff39ee475da05d3bb7d36da13f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:15.379523 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad1e6a-67a4-4821-acb5-1f1c512f7fcf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:15.379809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad1e6a-67a4-4821-acb5-1f1c512f7fcf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:15.380097 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad1e6a-67a4-4821-acb5-1f1c512f7fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:15.398150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-16ad1e6a-67a4-4821-acb5-1f1c512f7fcf None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:15.399371 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-16ad1e6a-67a4-4821-acb5-1f1c512f7fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:15.442390 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4f4c32bf-e6d0-437a-9871-af5ea035f7d0 admin admin] The token cache is being invalidate because project 40a5f5c0e96f4c5683bcd3a39461077b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:15.443965 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4f4c32bf-e6d0-437a-9871-af5ea035f7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:15.444404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4f4c32bf-e6d0-437a-9871-af5ea035f7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:15.446670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1340/2642] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:15 2022] DELETE /identity/v3/projects/40a5f5c0e96f4c5683bcd3a39461077b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:15.453821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b6bc7-05dd-4627-a84a-30fb02bfadf8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:15.454256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b6bc7-05dd-4627-a84a-30fb02bfadf8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:15.454387 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b6bc7-05dd-4627-a84a-30fb02bfadf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:15.465969 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1303/2643] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:58:15.471978 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad1e6a-67a4-4821-acb5-1f1c512f7fcf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:15.473478 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-16ad1e6a-67a4-4821-acb5-1f1c512f7fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:15.480678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1c2b6bc7-05dd-4627-a84a-30fb02bfadf8 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:15.481925 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1c2b6bc7-05dd-4627-a84a-30fb02bfadf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:15.498060 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1341/2644] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:58:15.499978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f21ae-21c3-42c4-a7b9-7e445b364960 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:15.501000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f21ae-21c3-42c4-a7b9-7e445b364960 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:15.501326 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f21ae-21c3-42c4-a7b9-7e445b364960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:15.546200 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad1e6a-67a4-4821-acb5-1f1c512f7fcf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:15.553268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469b8fa-149a-4a04-b46a-dc470f7e1340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:15.553948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469b8fa-149a-4a04-b46a-dc470f7e1340 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:15.554235 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469b8fa-149a-4a04-b46a-dc470f7e1340 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:15.554511 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469b8fa-149a-4a04-b46a-dc470f7e1340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:15.558336 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c34f21ae-21c3-42c4-a7b9-7e445b364960 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:15.561626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c34f21ae-21c3-42c4-a7b9-7e445b364960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:15.570349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469b8fa-149a-4a04-b46a-dc470f7e1340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:15.572324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469b8fa-149a-4a04-b46a-dc470f7e1340 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:15.582986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1342/2645] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:15.587654 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1304/2646] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:58:15.592119 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f21ae-21c3-42c4-a7b9-7e445b364960 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:15.601290 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f21ae-21c3-42c4-a7b9-7e445b364960 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:15.616022 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ac125-3cd9-4448-a51a-1338b231f65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:15.616022 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ac125-3cd9-4448-a51a-1338b231f65e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:15.616022 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ac125-3cd9-4448-a51a-1338b231f65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:15.616022 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ac125-3cd9-4448-a51a-1338b231f65e admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:15.616722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ac125-3cd9-4448-a51a-1338b231f65e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:15.616722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ac125-3cd9-4448-a51a-1338b231f65e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:15.616722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ac125-3cd9-4448-a51a-1338b231f65e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:15.643483 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1343/2647] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:15.648102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469b8fa-149a-4a04-b46a-dc470f7e1340 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:15.662436 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469b8fa-149a-4a04-b46a-dc470f7e1340 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:15.671361 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803ff98-2d69-48f2-b21c-ef93848a09a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:15.671849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803ff98-2d69-48f2-b21c-ef93848a09a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:15.672027 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803ff98-2d69-48f2-b21c-ef93848a09a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:15.672385 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803ff98-2d69-48f2-b21c-ef93848a09a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:15.673576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803ff98-2d69-48f2-b21c-ef93848a09a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:15.676062 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803ff98-2d69-48f2-b21c-ef93848a09a3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:15.703469 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e47800-dca4-4cff-9557-eac87126d5ba None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:15.704063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e47800-dca4-4cff-9557-eac87126d5ba None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:15.704463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e47800-dca4-4cff-9557-eac87126d5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:15.726901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-50e47800-dca4-4cff-9557-eac87126d5ba None None] MFA Rules not processed for user `d653275573ef4485ad38892d703f2159`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:15.728330 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-50e47800-dca4-4cff-9557-eac87126d5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:15.773356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1305/2648] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:58:15 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:58:15.778621 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803ff98-2d69-48f2-b21c-ef93848a09a3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:15.792521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1344/2649] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:15.889980 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803ff98-2d69-48f2-b21c-ef93848a09a3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:15.895899 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bd2b7-1362-46bb-96be-886a37ece4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:15.896624 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bd2b7-1362-46bb-96be-886a37ece4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:15.896964 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bd2b7-1362-46bb-96be-886a37ece4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:15.897234 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bd2b7-1362-46bb-96be-886a37ece4c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:15.897969 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bd2b7-1362-46bb-96be-886a37ece4c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:15.902952 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bd2b7-1362-46bb-96be-886a37ece4c6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:15.993864 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1306/2650] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:58:15 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:58:15.998667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e47800-dca4-4cff-9557-eac87126d5ba None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:16.018188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e47800-dca4-4cff-9557-eac87126d5ba None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:16.028198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0089ff-83e8-4389-83be-928fa497a149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:16.029599 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0089ff-83e8-4389-83be-928fa497a149 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:16.030059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0089ff-83e8-4389-83be-928fa497a149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:16.030627 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0089ff-83e8-4389-83be-928fa497a149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:16.031974 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0089ff-83e8-4389-83be-928fa497a149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:16.035404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0089ff-83e8-4389-83be-928fa497a149 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:16.058786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1345/2651] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:16.060329 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bd2b7-1362-46bb-96be-886a37ece4c6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:16.076043 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bd2b7-1362-46bb-96be-886a37ece4c6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:16.082057 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387adb75-ea9e-40c5-83f0-c5c929816a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:16.082874 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387adb75-ea9e-40c5-83f0-c5c929816a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:16.083161 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387adb75-ea9e-40c5-83f0-c5c929816a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:16.083435 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387adb75-ea9e-40c5-83f0-c5c929816a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:16.084179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387adb75-ea9e-40c5-83f0-c5c929816a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:16.085905 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387adb75-ea9e-40c5-83f0-c5c929816a33 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:16.098258 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1307/2652] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:16.102985 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0089ff-83e8-4389-83be-928fa497a149 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:16.118794 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0089ff-83e8-4389-83be-928fa497a149 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:16.129453 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f894476-803d-43fb-8055-f8e14a5ae55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:16.130654 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f894476-803d-43fb-8055-f8e14a5ae55c admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:16.131538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f894476-803d-43fb-8055-f8e14a5ae55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:16.131538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f894476-803d-43fb-8055-f8e14a5ae55c admin admin] PATH_INFO: `/v3/projects/e7fcf76ef9c94a03b2c4385f5a2f35f5/users/9258a5d5f3e046cc968e1644e6432cd7/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:16.153187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f894476-803d-43fb-8055-f8e14a5ae55c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fcf76ef9c94a03b2c4385f5a2f35f5, user_id=9258a5d5f3e046cc968e1644e6432cd7, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:16.155927 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f894476-803d-43fb-8055-f8e14a5ae55c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:16.371059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1346/2653] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:16 2022] PUT /identity/v3/projects/e7fcf76ef9c94a03b2c4385f5a2f35f5/users/9258a5d5f3e046cc968e1644e6432cd7/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:16.371796 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f687ba9-9985-41ae-b263-ff8d6af8a54b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:16.372260 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f687ba9-9985-41ae-b263-ff8d6af8a54b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:16.372634 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f687ba9-9985-41ae-b263-ff8d6af8a54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:16.411559 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0f687ba9-9985-41ae-b263-ff8d6af8a54b None None] MFA Rules not processed for user `9258a5d5f3e046cc968e1644e6432cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:16.413218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0f687ba9-9985-41ae-b263-ff8d6af8a54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:16.482598 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f894476-803d-43fb-8055-f8e14a5ae55c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:16.489518 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3f894476-803d-43fb-8055-f8e14a5ae55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:16.529213 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1308/2654] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:16.545011 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f687ba9-9985-41ae-b263-ff8d6af8a54b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:16.553181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0f687ba9-9985-41ae-b263-ff8d6af8a54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:16.620357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f894476-803d-43fb-8055-f8e14a5ae55c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:16.630153 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4da5a-3338-40f8-a9c7-dc1d56aad69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:16.630618 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4da5a-3338-40f8-a9c7-dc1d56aad69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:16.630890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4da5a-3338-40f8-a9c7-dc1d56aad69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:16.631233 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4da5a-3338-40f8-a9c7-dc1d56aad69a admin admin] PATH_INFO: `/v3/projects/24563f17714845519a383ce1a39e2586` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:16.633758 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4da5a-3338-40f8-a9c7-dc1d56aad69a admin admin] RBAC: Authorizing `identity:delete_project(project_id=24563f17714845519a383ce1a39e2586)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:16.638205 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4da5a-3338-40f8-a9c7-dc1d56aad69a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:16.687643 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f687ba9-9985-41ae-b263-ff8d6af8a54b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:16.694510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fb92a-1b4f-4785-9814-6c07f5f91dab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:16.696674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fb92a-1b4f-4785-9814-6c07f5f91dab service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:16.701325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fb92a-1b4f-4785-9814-6c07f5f91dab service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:16.701325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fb92a-1b4f-4785-9814-6c07f5f91dab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:16.709284 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fb92a-1b4f-4785-9814-6c07f5f91dab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:16.710828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fb92a-1b4f-4785-9814-6c07f5f91dab service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:16.722748 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1309/2655] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:58:16.762962 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fb92a-1b4f-4785-9814-6c07f5f91dab service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:16.773527 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6bd4da5a-3338-40f8-a9c7-dc1d56aad69a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24563f17714845519a383ce1a39e2586', 'request_id': 'req-6bd4da5a-3338-40f8-a9c7-dc1d56aad69a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:16.792882 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fb92a-1b4f-4785-9814-6c07f5f91dab service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:16.792990 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6bd4da5a-3338-40f8-a9c7-dc1d56aad69a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24563f17714845519a383ce1a39e2586', 'request_id': 'req-6bd4da5a-3338-40f8-a9c7-dc1d56aad69a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:16.795839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6bd4da5a-3338-40f8-a9c7-dc1d56aad69a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24563f17714845519a383ce1a39e2586', 'request_id': 'req-6bd4da5a-3338-40f8-a9c7-dc1d56aad69a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:16.848935 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a103a-df3d-4579-a670-153d8ef8c059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:16.849820 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a103a-df3d-4579-a670-153d8ef8c059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:16.850098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a103a-df3d-4579-a670-153d8ef8c059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:16.850370 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a103a-df3d-4579-a670-153d8ef8c059 admin admin] PATH_INFO: `/v3/users/9258a5d5f3e046cc968e1644e6432cd7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:16.851594 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a103a-df3d-4579-a670-153d8ef8c059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9258a5d5f3e046cc968e1644e6432cd7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:16.853623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a103a-df3d-4579-a670-153d8ef8c059 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:16.879031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6bd4da5a-3338-40f8-a9c7-dc1d56aad69a admin admin] The token cache is being invalidate because project 24563f17714845519a383ce1a39e2586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:16.882667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6bd4da5a-3338-40f8-a9c7-dc1d56aad69a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:16.882667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6bd4da5a-3338-40f8-a9c7-dc1d56aad69a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:16.883607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1347/2656] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:16 2022] DELETE /identity/v3/projects/24563f17714845519a383ce1a39e2586 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:16.889666 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae45b3-569a-402f-80bd-6feb148ecbf7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:16.889947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae45b3-569a-402f-80bd-6feb148ecbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:16.890246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae45b3-569a-402f-80bd-6feb148ecbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:16.913786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0fae45b3-569a-402f-80bd-6feb148ecbf7 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:16.915025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0fae45b3-569a-402f-80bd-6feb148ecbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:16.925137 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1348/2657] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:16.935006 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e102794-1c72-4c2e-8519-53e6ff8e0f22 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:16.940186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e102794-1c72-4c2e-8519-53e6ff8e0f22 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:16.940186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e102794-1c72-4c2e-8519-53e6ff8e0f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:16.963723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6e102794-1c72-4c2e-8519-53e6ff8e0f22 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:16.965436 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6e102794-1c72-4c2e-8519-53e6ff8e0f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:16.975587 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1349/2658] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:16.980741 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e102794-1c72-4c2e-8519-53e6ff8e0f22 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:16.990342 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e102794-1c72-4c2e-8519-53e6ff8e0f22 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:16.995826 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a541ff-8a25-49fb-b6e3-1fabb3f2a0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:16.996550 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a541ff-8a25-49fb-b6e3-1fabb3f2a0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:16.996983 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a541ff-8a25-49fb-b6e3-1fabb3f2a0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:16.997494 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a541ff-8a25-49fb-b6e3-1fabb3f2a0b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:16.998009 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a541ff-8a25-49fb-b6e3-1fabb3f2a0b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:16.998294 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a541ff-8a25-49fb-b6e3-1fabb3f2a0b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:16.999955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a541ff-8a25-49fb-b6e3-1fabb3f2a0b4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:17.015517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1350/2659] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:17.020152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a541ff-8a25-49fb-b6e3-1fabb3f2a0b4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:17.032532 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a541ff-8a25-49fb-b6e3-1fabb3f2a0b4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:17.037418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afcfc7-2496-40d1-be7d-695c1064a512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:17.038073 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afcfc7-2496-40d1-be7d-695c1064a512 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:17.038379 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afcfc7-2496-40d1-be7d-695c1064a512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:17.038655 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afcfc7-2496-40d1-be7d-695c1064a512 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:17.039348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afcfc7-2496-40d1-be7d-695c1064a512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:17.042535 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afcfc7-2496-40d1-be7d-695c1064a512 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:17.099082 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e14a103a-df3d-4579-a670-153d8ef8c059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9258a5d5f3e046cc968e1644e6432cd7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:17.113323 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e14a103a-df3d-4579-a670-153d8ef8c059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9258a5d5f3e046cc968e1644e6432cd7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:17.177178 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1351/2660] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:58:17 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:58:17.181327 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afcfc7-2496-40d1-be7d-695c1064a512 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:17.198838 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e14a103a-df3d-4579-a670-153d8ef8c059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9258a5d5f3e046cc968e1644e6432cd7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:17.206277 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e14a103a-df3d-4579-a670-153d8ef8c059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9258a5d5f3e046cc968e1644e6432cd7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:17.211720 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e14a103a-df3d-4579-a670-153d8ef8c059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9258a5d5f3e046cc968e1644e6432cd7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:17.214180 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1310/2661] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:16 2022] DELETE /identity/v3/users/9258a5d5f3e046cc968e1644e6432cd7 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:17.218576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde05bb2-b621-42e7-a854-5accbac71eeb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:17.218936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde05bb2-b621-42e7-a854-5accbac71eeb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:17.219287 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde05bb2-b621-42e7-a854-5accbac71eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:17.236936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-dde05bb2-b621-42e7-a854-5accbac71eeb None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:17.238207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dde05bb2-b621-42e7-a854-5accbac71eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:17.246357 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afcfc7-2496-40d1-be7d-695c1064a512 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:17.308890 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1311/2662] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:58:17.319407 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde05bb2-b621-42e7-a854-5accbac71eeb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:17.326036 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dde05bb2-b621-42e7-a854-5accbac71eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:17.351598 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761e594-7bef-4b5e-9477-85e713c69216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:17.355486 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761e594-7bef-4b5e-9477-85e713c69216 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:17.355803 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761e594-7bef-4b5e-9477-85e713c69216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:17.356084 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761e594-7bef-4b5e-9477-85e713c69216 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:17.356825 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761e594-7bef-4b5e-9477-85e713c69216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:17.359872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761e594-7bef-4b5e-9477-85e713c69216 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:17.405039 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde05bb2-b621-42e7-a854-5accbac71eeb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:17.423723 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e35152-d856-4c40-ac84-a778651dab6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:17.423723 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e35152-d856-4c40-ac84-a778651dab6c service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:17.423723 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e35152-d856-4c40-ac84-a778651dab6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:17.423723 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e35152-d856-4c40-ac84-a778651dab6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:17.429569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e35152-d856-4c40-ac84-a778651dab6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:17.431122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e35152-d856-4c40-ac84-a778651dab6c service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:17.444074 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1312/2663] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:58:17.458962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1352/2664] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:58:17 2022] POST /identity/v3/users => generated 288 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:58:17.459399 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e35152-d856-4c40-ac84-a778651dab6c service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:17.460564 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-46e35152-d856-4c40-ac84-a778651dab6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:17.480326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e35152-d856-4c40-ac84-a778651dab6c service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:17.500759 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f655347-fb59-4659-9cdc-d4586a2a7fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:17.503373 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f655347-fb59-4659-9cdc-d4586a2a7fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:17.503754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f655347-fb59-4659-9cdc-d4586a2a7fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:17.509106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f655347-fb59-4659-9cdc-d4586a2a7fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:17.509106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f655347-fb59-4659-9cdc-d4586a2a7fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:17.509106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f655347-fb59-4659-9cdc-d4586a2a7fb0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:17.525316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1313/2665] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:17.526731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761e594-7bef-4b5e-9477-85e713c69216 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:17.542938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761e594-7bef-4b5e-9477-85e713c69216 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:17.549423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448990f1-a5d4-4062-8c2c-a7d54eca37ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:17.550316 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448990f1-a5d4-4062-8c2c-a7d54eca37ef admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:17.550695 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448990f1-a5d4-4062-8c2c-a7d54eca37ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:17.551654 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448990f1-a5d4-4062-8c2c-a7d54eca37ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:17.552528 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448990f1-a5d4-4062-8c2c-a7d54eca37ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:17.554689 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448990f1-a5d4-4062-8c2c-a7d54eca37ef admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:17.567398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1353/2666] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:17.571942 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f655347-fb59-4659-9cdc-d4586a2a7fb0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:17.582729 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f655347-fb59-4659-9cdc-d4586a2a7fb0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:17.587734 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be6299-178b-4ae9-82e4-6923986c037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:17.588795 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be6299-178b-4ae9-82e4-6923986c037a admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:17.589145 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be6299-178b-4ae9-82e4-6923986c037a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:17.589491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be6299-178b-4ae9-82e4-6923986c037a admin admin] PATH_INFO: `/v3/projects/d66074a63ebf47809b0ffd13a2164f85/users/86f65bba12b84802bad645437212f1be/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:17.607679 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be6299-178b-4ae9-82e4-6923986c037a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66074a63ebf47809b0ffd13a2164f85, user_id=86f65bba12b84802bad645437212f1be, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:17.610569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be6299-178b-4ae9-82e4-6923986c037a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:17.699658 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1314/2667] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:17 2022] PUT /identity/v3/projects/d66074a63ebf47809b0ffd13a2164f85/users/86f65bba12b84802bad645437212f1be/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:17.711917 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73318145-4029-406e-9dad-672ec6269465 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:17.715744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73318145-4029-406e-9dad-672ec6269465 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:17.716237 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73318145-4029-406e-9dad-672ec6269465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:17.766702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-73318145-4029-406e-9dad-672ec6269465 None None] MFA Rules not processed for user `86f65bba12b84802bad645437212f1be`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:17.768967 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-73318145-4029-406e-9dad-672ec6269465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:17.910910 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1354/2668] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:17.922263 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be6299-178b-4ae9-82e4-6923986c037a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:17.926454 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-47be6299-178b-4ae9-82e4-6923986c037a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:17.992176 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73318145-4029-406e-9dad-672ec6269465 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:17.996067 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-73318145-4029-406e-9dad-672ec6269465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:18.026770 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be6299-178b-4ae9-82e4-6923986c037a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:18.031761 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de146ea5-0eea-45ac-83e6-9249efd83f72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:18.033509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de146ea5-0eea-45ac-83e6-9249efd83f72 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:18.033913 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de146ea5-0eea-45ac-83e6-9249efd83f72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:18.034576 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de146ea5-0eea-45ac-83e6-9249efd83f72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:18.047252 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de146ea5-0eea-45ac-83e6-9249efd83f72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:18.049777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de146ea5-0eea-45ac-83e6-9249efd83f72 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:18.066364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1315/2669] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:18.102216 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73318145-4029-406e-9dad-672ec6269465 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:18.110144 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea591d-ca8f-4e95-aed5-889b260f59cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:18.111728 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea591d-ca8f-4e95-aed5-889b260f59cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:18.112314 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea591d-ca8f-4e95-aed5-889b260f59cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:18.122353 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea591d-ca8f-4e95-aed5-889b260f59cd admin admin] PATH_INFO: `/v3/projects/e7fcf76ef9c94a03b2c4385f5a2f35f5` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:18.122353 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea591d-ca8f-4e95-aed5-889b260f59cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7fcf76ef9c94a03b2c4385f5a2f35f5)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:18.122353 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea591d-ca8f-4e95-aed5-889b260f59cd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:18.251687 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-53ea591d-ca8f-4e95-aed5-889b260f59cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7fcf76ef9c94a03b2c4385f5a2f35f5', 'request_id': 'req-53ea591d-ca8f-4e95-aed5-889b260f59cd'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:18.257177 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-53ea591d-ca8f-4e95-aed5-889b260f59cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7fcf76ef9c94a03b2c4385f5a2f35f5', 'request_id': 'req-53ea591d-ca8f-4e95-aed5-889b260f59cd'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:18.267122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-53ea591d-ca8f-4e95-aed5-889b260f59cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7fcf76ef9c94a03b2c4385f5a2f35f5', 'request_id': 'req-53ea591d-ca8f-4e95-aed5-889b260f59cd'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:18.399859 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-53ea591d-ca8f-4e95-aed5-889b260f59cd admin admin] The token cache is being invalidate because project e7fcf76ef9c94a03b2c4385f5a2f35f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:18.400836 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-53ea591d-ca8f-4e95-aed5-889b260f59cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:18.401582 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-53ea591d-ca8f-4e95-aed5-889b260f59cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:18.403201 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1355/2670] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:17 2022] DELETE /identity/v3/projects/e7fcf76ef9c94a03b2c4385f5a2f35f5 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:18.408135 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ade8c-8d52-462c-97b3-f3d433b2a328 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:18.410220 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ade8c-8d52-462c-97b3-f3d433b2a328 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:18.410220 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ade8c-8d52-462c-97b3-f3d433b2a328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:18.430212 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b07ade8c-8d52-462c-97b3-f3d433b2a328 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:18.431438 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b07ade8c-8d52-462c-97b3-f3d433b2a328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:18.529166 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1316/2671] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:58:18.537011 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c2b72-a1c9-4317-9fdf-21e3c32cb4d3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:18.537547 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c2b72-a1c9-4317-9fdf-21e3c32cb4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:18.537547 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c2b72-a1c9-4317-9fdf-21e3c32cb4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:18.556610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9f2c2b72-a1c9-4317-9fdf-21e3c32cb4d3 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:18.557813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9f2c2b72-a1c9-4317-9fdf-21e3c32cb4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:18.567295 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1356/2672] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:18.576619 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ade8c-8d52-462c-97b3-f3d433b2a328 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:18.582960 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c2b72-a1c9-4317-9fdf-21e3c32cb4d3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:18.584580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9f2c2b72-a1c9-4317-9fdf-21e3c32cb4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:18.589839 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ade8c-8d52-462c-97b3-f3d433b2a328 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:18.596183 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6f05f-a6f6-409f-b368-0a14c4f37703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:18.597541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6f05f-a6f6-409f-b368-0a14c4f37703 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:18.597826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6f05f-a6f6-409f-b368-0a14c4f37703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:18.598099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6f05f-a6f6-409f-b368-0a14c4f37703 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:18.598979 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6f05f-a6f6-409f-b368-0a14c4f37703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:18.599292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6f05f-a6f6-409f-b368-0a14c4f37703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:18.601026 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6f05f-a6f6-409f-b368-0a14c4f37703 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:18.605819 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c2b72-a1c9-4317-9fdf-21e3c32cb4d3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:18.610813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7c0d8-86ea-44c5-8923-76c3cc2d8bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:18.611686 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7c0d8-86ea-44c5-8923-76c3cc2d8bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:18.612013 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7c0d8-86ea-44c5-8923-76c3cc2d8bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:18.612326 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7c0d8-86ea-44c5-8923-76c3cc2d8bba admin admin] PATH_INFO: `/v3/users/546c3447688f473fb256f4bc3dd99188` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:18.613546 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7c0d8-86ea-44c5-8923-76c3cc2d8bba admin admin] RBAC: Authorizing `identity:delete_user(user_id=546c3447688f473fb256f4bc3dd99188)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:18.614551 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1317/2673] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:18.617541 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7c0d8-86ea-44c5-8923-76c3cc2d8bba admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:18.619398 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6f05f-a6f6-409f-b368-0a14c4f37703 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:18.629305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6f05f-a6f6-409f-b368-0a14c4f37703 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:18.634216 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365f1aa-c998-42cc-a96f-ed2e4dd4caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:18.635151 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365f1aa-c998-42cc-a96f-ed2e4dd4caae admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:18.635543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365f1aa-c998-42cc-a96f-ed2e4dd4caae admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:18.635828 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365f1aa-c998-42cc-a96f-ed2e4dd4caae admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:18.636563 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365f1aa-c998-42cc-a96f-ed2e4dd4caae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:18.638508 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365f1aa-c998-42cc-a96f-ed2e4dd4caae admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:18.757363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1318/2674] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:58:18 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:58:18.757363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365f1aa-c998-42cc-a96f-ed2e4dd4caae admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:18.760672 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c365f1aa-c998-42cc-a96f-ed2e4dd4caae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:18.809491 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-87c7c0d8-86ea-44c5-8923-76c3cc2d8bba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546c3447688f473fb256f4bc3dd99188'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:18.840849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365f1aa-c998-42cc-a96f-ed2e4dd4caae admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:18.849089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3cd35-6ef2-493d-a514-51c924ae8387 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ff8c001247c43ccbc4ccb26daa17201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:18.849089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3cd35-6ef2-493d-a514-51c924ae8387 service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:18.849089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3cd35-6ef2-493d-a514-51c924ae8387 service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:18.849089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3cd35-6ef2-493d-a514-51c924ae8387 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:18.849464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bed3cd35-6ef2-493d-a514-51c924ae8387 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:18.861645 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3cd35-6ef2-493d-a514-51c924ae8387 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:18.863374 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3cd35-6ef2-493d-a514-51c924ae8387 service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:18.873961 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1319/2675] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:18.874869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3cd35-6ef2-493d-a514-51c924ae8387 service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:18.896793 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-87c7c0d8-86ea-44c5-8923-76c3cc2d8bba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546c3447688f473fb256f4bc3dd99188'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:18.897429 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-87c7c0d8-86ea-44c5-8923-76c3cc2d8bba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546c3447688f473fb256f4bc3dd99188'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:18.906010 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-87c7c0d8-86ea-44c5-8923-76c3cc2d8bba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546c3447688f473fb256f4bc3dd99188'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:18.919543 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-87c7c0d8-86ea-44c5-8923-76c3cc2d8bba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546c3447688f473fb256f4bc3dd99188'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:18.925806 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1357/2676] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:18 2022] DELETE /identity/v3/users/546c3447688f473fb256f4bc3dd99188 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:18.950515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3cd35-6ef2-493d-a514-51c924ae8387 service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:19.006794 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ca0fe-63b8-4b2e-bbe7-f4ef8e717ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:19.007465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ca0fe-63b8-4b2e-bbe7-f4ef8e717ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.007754 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ca0fe-63b8-4b2e-bbe7-f4ef8e717ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.008036 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ca0fe-63b8-4b2e-bbe7-f4ef8e717ed3 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.008760 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ca0fe-63b8-4b2e-bbe7-f4ef8e717ed3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:19.011397 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ca0fe-63b8-4b2e-bbe7-f4ef8e717ed3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:19.107345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1320/2677] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:58:18 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:19.111663 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7c0d8-86ea-44c5-8923-76c3cc2d8bba admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:19.113194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-87c7c0d8-86ea-44c5-8923-76c3cc2d8bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:19.126250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7c0d8-86ea-44c5-8923-76c3cc2d8bba admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:19.130870 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89023e-c102-458f-9dd4-a603231ce583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:19.131516 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89023e-c102-458f-9dd4-a603231ce583 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.131793 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89023e-c102-458f-9dd4-a603231ce583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.132088 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89023e-c102-458f-9dd4-a603231ce583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.132845 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89023e-c102-458f-9dd4-a603231ce583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:19.134933 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89023e-c102-458f-9dd4-a603231ce583 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:19.144970 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1358/2678] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:19.148965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ca0fe-63b8-4b2e-bbe7-f4ef8e717ed3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:19.160033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ca0fe-63b8-4b2e-bbe7-f4ef8e717ed3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:19.164661 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5d7e6-684a-4b7c-9d55-03f260ce1dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:19.165318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5d7e6-684a-4b7c-9d55-03f260ce1dde admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.165629 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5d7e6-684a-4b7c-9d55-03f260ce1dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.165913 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5d7e6-684a-4b7c-9d55-03f260ce1dde admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.166657 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5d7e6-684a-4b7c-9d55-03f260ce1dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:19.168231 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5d7e6-684a-4b7c-9d55-03f260ce1dde admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:19.178304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1321/2679] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:19.185424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89023e-c102-458f-9dd4-a603231ce583 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:19.186052 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5d7e6-684a-4b7c-9d55-03f260ce1dde admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:19.192363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4cf5d7e6-684a-4b7c-9d55-03f260ce1dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:19.200726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89023e-c102-458f-9dd4-a603231ce583 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:19.206521 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5d7e6-684a-4b7c-9d55-03f260ce1dde admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:19.208628 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6143b2-756d-4e2f-93a5-2efd86c4a1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:19.209978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6143b2-756d-4e2f-93a5-2efd86c4a1e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.210415 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6143b2-756d-4e2f-93a5-2efd86c4a1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.211438 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6143b2-756d-4e2f-93a5-2efd86c4a1e1 admin admin] PATH_INFO: `/v3/projects/3582f692d07d4a959f4033ced79df226/users/b15bcfb68e8048979f45a8c6ac4b6d13/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.214494 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a06f01-add5-4fec-ad65-490f3d52d76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:19.215497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a06f01-add5-4fec-ad65-490f3d52d76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.215744 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a06f01-add5-4fec-ad65-490f3d52d76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.216146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a06f01-add5-4fec-ad65-490f3d52d76e admin admin] PATH_INFO: `/v3/projects/4fb5955a770341b28fa73947bd6346ed` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.221650 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a06f01-add5-4fec-ad65-490f3d52d76e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fb5955a770341b28fa73947bd6346ed)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:19.221650 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a06f01-add5-4fec-ad65-490f3d52d76e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:19.230940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6143b2-756d-4e2f-93a5-2efd86c4a1e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3582f692d07d4a959f4033ced79df226, user_id=b15bcfb68e8048979f45a8c6ac4b6d13, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:19.233616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6143b2-756d-4e2f-93a5-2efd86c4a1e1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:19.303002 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1359/2680] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:19 2022] PUT /identity/v3/projects/3582f692d07d4a959f4033ced79df226/users/b15bcfb68e8048979f45a8c6ac4b6d13/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:19.312839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44503c2-7b8f-4986-8584-5313b459b05b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.312839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44503c2-7b8f-4986-8584-5313b459b05b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.312839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44503c2-7b8f-4986-8584-5313b459b05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.326150 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e44503c2-7b8f-4986-8584-5313b459b05b None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:19.327263 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e44503c2-7b8f-4986-8584-5313b459b05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:19.349218 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e9a06f01-add5-4fec-ad65-490f3d52d76e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fb5955a770341b28fa73947bd6346ed', 'request_id': 'req-e9a06f01-add5-4fec-ad65-490f3d52d76e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:19.355544 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e9a06f01-add5-4fec-ad65-490f3d52d76e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fb5955a770341b28fa73947bd6346ed', 'request_id': 'req-e9a06f01-add5-4fec-ad65-490f3d52d76e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:19.389124 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1360/2681] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:58:19.398605 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44503c2-7b8f-4986-8584-5313b459b05b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:19.400497 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e44503c2-7b8f-4986-8584-5313b459b05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:19.451349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e9a06f01-add5-4fec-ad65-490f3d52d76e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fb5955a770341b28fa73947bd6346ed', 'request_id': 'req-e9a06f01-add5-4fec-ad65-490f3d52d76e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:19.455058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44503c2-7b8f-4986-8584-5313b459b05b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:19.463544 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e9a06f01-add5-4fec-ad65-490f3d52d76e admin admin] The token cache is being invalidate because project 4fb5955a770341b28fa73947bd6346ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:19.463836 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e9a06f01-add5-4fec-ad65-490f3d52d76e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:19.464539 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e9a06f01-add5-4fec-ad65-490f3d52d76e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:19.466126 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1322/2682] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:19 2022] DELETE /identity/v3/projects/4fb5955a770341b28fa73947bd6346ed => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:19.470901 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a0d29-d7cf-44ce-b7a6-91b46feaadeb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.471192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a0d29-d7cf-44ce-b7a6-91b46feaadeb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.471472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a0d29-d7cf-44ce-b7a6-91b46feaadeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.489005 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1e3a0d29-d7cf-44ce-b7a6-91b46feaadeb None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:19.490279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1e3a0d29-d7cf-44ce-b7a6-91b46feaadeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:19.504494 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7328af-c5fd-4459-aca2-162b46b44464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:19.505138 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7328af-c5fd-4459-aca2-162b46b44464 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.505437 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7328af-c5fd-4459-aca2-162b46b44464 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.505706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7328af-c5fd-4459-aca2-162b46b44464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.507510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-df7328af-c5fd-4459-aca2-162b46b44464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:19.562123 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1323/2683] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:19.569799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6a5c0-967d-4a13-9568-a8893641d747 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.570111 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6a5c0-967d-4a13-9568-a8893641d747 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.570362 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6a5c0-967d-4a13-9568-a8893641d747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.591636 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7328af-c5fd-4459-aca2-162b46b44464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:19.595560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7328af-c5fd-4459-aca2-162b46b44464 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:19.595717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b5c6a5c0-967d-4a13-9568-a8893641d747 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:19.595717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b5c6a5c0-967d-4a13-9568-a8893641d747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:19.604043 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1324/2684] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:58:19.604784 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1361/2685] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:58:19.608145 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6a5c0-967d-4a13-9568-a8893641d747 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:19.618595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6a5c0-967d-4a13-9568-a8893641d747 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:19.624091 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c5cf4-3acb-4ad6-b036-675ad6b7c47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:19.624816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5cf4-3acb-4ad6-b036-675ad6b7c47e admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.625155 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5cf4-3acb-4ad6-b036-675ad6b7c47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.625369 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5cf4-3acb-4ad6-b036-675ad6b7c47e admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.626103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c5cf4-3acb-4ad6-b036-675ad6b7c47e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:19.626409 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c5cf4-3acb-4ad6-b036-675ad6b7c47e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:19.627991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c5cf4-3acb-4ad6-b036-675ad6b7c47e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:19.640830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1325/2686] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:19.645430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7328af-c5fd-4459-aca2-162b46b44464 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:19.655351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7328af-c5fd-4459-aca2-162b46b44464 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:19.661377 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c066c-f2d6-4e1f-9e29-05230836bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:19.662018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c066c-f2d6-4e1f-9e29-05230836bda1 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.662292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c066c-f2d6-4e1f-9e29-05230836bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.662560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c066c-f2d6-4e1f-9e29-05230836bda1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.663247 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c066c-f2d6-4e1f-9e29-05230836bda1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:19.665164 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c066c-f2d6-4e1f-9e29-05230836bda1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:19.748315 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1362/2687] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:58:19 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:58:19.753107 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c5cf4-3acb-4ad6-b036-675ad6b7c47e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:19.763714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c5cf4-3acb-4ad6-b036-675ad6b7c47e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:19.831958 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e76eb2-4dca-498c-9819-eff0575014fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:19.832144 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e76eb2-4dca-498c-9819-eff0575014fc admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.832583 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e76eb2-4dca-498c-9819-eff0575014fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.832966 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e76eb2-4dca-498c-9819-eff0575014fc admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.833954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e76eb2-4dca-498c-9819-eff0575014fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:19.836287 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e76eb2-4dca-498c-9819-eff0575014fc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:19.940263 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c066c-f2d6-4e1f-9e29-05230836bda1 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:19.940617 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1326/2688] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:58:19 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:19.977224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c066c-f2d6-4e1f-9e29-05230836bda1 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:19.977224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f50043-16db-428f-8680-1bab49495dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:19.977224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f50043-16db-428f-8680-1bab49495dac admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:19.977224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f50043-16db-428f-8680-1bab49495dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:19.977849 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f50043-16db-428f-8680-1bab49495dac admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:19.977849 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f50043-16db-428f-8680-1bab49495dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:19.977849 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f50043-16db-428f-8680-1bab49495dac admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:19.989912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1363/2689] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:19.994585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e76eb2-4dca-498c-9819-eff0575014fc admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:20.004970 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e76eb2-4dca-498c-9819-eff0575014fc admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:20.010498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95056b0-c1dd-484f-b85e-bdd6d19ac341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:20.011159 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95056b0-c1dd-484f-b85e-bdd6d19ac341 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:20.011441 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95056b0-c1dd-484f-b85e-bdd6d19ac341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:20.011713 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95056b0-c1dd-484f-b85e-bdd6d19ac341 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:20.012470 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95056b0-c1dd-484f-b85e-bdd6d19ac341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:20.014071 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95056b0-c1dd-484f-b85e-bdd6d19ac341 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:20.027958 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1327/2690] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:20.030182 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f50043-16db-428f-8680-1bab49495dac admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:20.041995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f50043-16db-428f-8680-1bab49495dac admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:20.047208 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396239f0-29f4-4386-8dc5-2d0c69e917ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:20.047872 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396239f0-29f4-4386-8dc5-2d0c69e917ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:20.048155 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396239f0-29f4-4386-8dc5-2d0c69e917ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:20.048838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396239f0-29f4-4386-8dc5-2d0c69e917ac admin admin] PATH_INFO: `/v3/projects/69ebbfac1e654481804361c4f83aaee1/users/c4793cde6719401ea845309f9a0383ab/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:20.066696 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396239f0-29f4-4386-8dc5-2d0c69e917ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ebbfac1e654481804361c4f83aaee1, user_id=c4793cde6719401ea845309f9a0383ab, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:20.072703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396239f0-29f4-4386-8dc5-2d0c69e917ac admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:20.174556 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1364/2691] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:20 2022] PUT /identity/v3/projects/69ebbfac1e654481804361c4f83aaee1/users/c4793cde6719401ea845309f9a0383ab/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:20.182555 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ffb8d-11e2-442a-b1a5-8e1fef33119f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:20.182859 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ffb8d-11e2-442a-b1a5-8e1fef33119f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:20.183121 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ffb8d-11e2-442a-b1a5-8e1fef33119f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:20.215856 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-162ffb8d-11e2-442a-b1a5-8e1fef33119f None None] MFA Rules not processed for user `c4793cde6719401ea845309f9a0383ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:20.217330 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-162ffb8d-11e2-442a-b1a5-8e1fef33119f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:20.291134 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1328/2692] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:20.303586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396239f0-29f4-4386-8dc5-2d0c69e917ac admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:20.305754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-396239f0-29f4-4386-8dc5-2d0c69e917ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:20.433763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396239f0-29f4-4386-8dc5-2d0c69e917ac admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:20.439789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd7ec4-3a3a-403e-9e85-7611c25c667f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:20.440465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd7ec4-3a3a-403e-9e85-7611c25c667f service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:20.440755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd7ec4-3a3a-403e-9e85-7611c25c667f service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:20.441029 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd7ec4-3a3a-403e-9e85-7611c25c667f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:20.452787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd7ec4-3a3a-403e-9e85-7611c25c667f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:20.452787 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd7ec4-3a3a-403e-9e85-7611c25c667f service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:20.460187 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1365/2693] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:25.767916 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd685c4-9fd6-47e8-918e-2469bd5eb231 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:25.768494 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd685c4-9fd6-47e8-918e-2469bd5eb231 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:25.768614 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd685c4-9fd6-47e8-918e-2469bd5eb231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:25.799590 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-afd685c4-9fd6-47e8-918e-2469bd5eb231 None None] MFA Rules not processed for user `b15bcfb68e8048979f45a8c6ac4b6d13`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:25.800868 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-afd685c4-9fd6-47e8-918e-2469bd5eb231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:25.886925 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1329/2694] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:25.891586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd7ec4-3a3a-403e-9e85-7611c25c667f service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:25.893634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-86cd7ec4-3a3a-403e-9e85-7611c25c667f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:25.967897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd7ec4-3a3a-403e-9e85-7611c25c667f service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:25.972625 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d95b9-21e7-4c1b-a6f6-a3b2195bb8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:25.973283 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d95b9-21e7-4c1b-a6f6-a3b2195bb8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:25.973564 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d95b9-21e7-4c1b-a6f6-a3b2195bb8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:25.973834 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d95b9-21e7-4c1b-a6f6-a3b2195bb8a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:25.974533 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d95b9-21e7-4c1b-a6f6-a3b2195bb8a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:25.976535 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d95b9-21e7-4c1b-a6f6-a3b2195bb8a2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:26.061272 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1366/2695] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:58:25 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:26.066434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd685c4-9fd6-47e8-918e-2469bd5eb231 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:26.081487 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd685c4-9fd6-47e8-918e-2469bd5eb231 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:26.143443 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fd6c6-20ee-498e-a88b-97cc98a8d229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:26.144154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fd6c6-20ee-498e-a88b-97cc98a8d229 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:26.144469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fd6c6-20ee-498e-a88b-97cc98a8d229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:26.144852 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fd6c6-20ee-498e-a88b-97cc98a8d229 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:26.145551 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fd6c6-20ee-498e-a88b-97cc98a8d229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:26.147454 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fd6c6-20ee-498e-a88b-97cc98a8d229 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:26.188769 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d95b9-21e7-4c1b-a6f6-a3b2195bb8a2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:26.199592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d95b9-21e7-4c1b-a6f6-a3b2195bb8a2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:26.204484 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda2d36-264a-46a5-a009-32d30390f7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:26.205358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda2d36-264a-46a5-a009-32d30390f7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:26.205639 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda2d36-264a-46a5-a009-32d30390f7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:26.205928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda2d36-264a-46a5-a009-32d30390f7d5 admin admin] PATH_INFO: `/v3/users/c4793cde6719401ea845309f9a0383ab` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:26.207143 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda2d36-264a-46a5-a009-32d30390f7d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4793cde6719401ea845309f9a0383ab)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:26.209099 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda2d36-264a-46a5-a009-32d30390f7d5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:26.252879 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1330/2696] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:58:26 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:26.254193 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fd6c6-20ee-498e-a88b-97cc98a8d229 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:26.264717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fd6c6-20ee-498e-a88b-97cc98a8d229 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:26.269356 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48802636-defc-485f-ba97-1ed7aa48ac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:26.270003 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48802636-defc-485f-ba97-1ed7aa48ac4b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:26.270283 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48802636-defc-485f-ba97-1ed7aa48ac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:26.270555 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48802636-defc-485f-ba97-1ed7aa48ac4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:26.271279 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48802636-defc-485f-ba97-1ed7aa48ac4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:26.272922 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48802636-defc-485f-ba97-1ed7aa48ac4b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:26.283255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1331/2697] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:58:26.287291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48802636-defc-485f-ba97-1ed7aa48ac4b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:26.297069 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48802636-defc-485f-ba97-1ed7aa48ac4b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:26.301699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5a132-1f37-4026-b723-2b8166d1f53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:26.302551 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5a132-1f37-4026-b723-2b8166d1f53e admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:26.302840 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5a132-1f37-4026-b723-2b8166d1f53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:26.303116 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5a132-1f37-4026-b723-2b8166d1f53e admin admin] PATH_INFO: `/v3/projects/eca6b33fac794c98abe00913972e493e/users/4266ac3d7e8b4715997207cc1bc93a15/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:26.318111 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5a132-1f37-4026-b723-2b8166d1f53e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca6b33fac794c98abe00913972e493e, user_id=4266ac3d7e8b4715997207cc1bc93a15, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:26.320775 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5a132-1f37-4026-b723-2b8166d1f53e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:26.419398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ffda2d36-264a-46a5-a009-32d30390f7d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4793cde6719401ea845309f9a0383ab'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:26.428866 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1332/2698] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:26 2022] PUT /identity/v3/projects/eca6b33fac794c98abe00913972e493e/users/4266ac3d7e8b4715997207cc1bc93a15/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:26.433793 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5a132-1f37-4026-b723-2b8166d1f53e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:26.496403 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ffda2d36-264a-46a5-a009-32d30390f7d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4793cde6719401ea845309f9a0383ab'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:26.497171 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ffda2d36-264a-46a5-a009-32d30390f7d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4793cde6719401ea845309f9a0383ab'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:26.499502 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5a132-1f37-4026-b723-2b8166d1f53e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:26.504322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a6618-c115-4d73-979c-6b96bf3d8801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:26.504569 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ffda2d36-264a-46a5-a009-32d30390f7d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4793cde6719401ea845309f9a0383ab'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:26.506627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a6618-c115-4d73-979c-6b96bf3d8801 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:26.506627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a6618-c115-4d73-979c-6b96bf3d8801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:26.506627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a6618-c115-4d73-979c-6b96bf3d8801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:26.506627 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a6618-c115-4d73-979c-6b96bf3d8801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:26.508326 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a6618-c115-4d73-979c-6b96bf3d8801 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:26.516500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ffda2d36-264a-46a5-a009-32d30390f7d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4793cde6719401ea845309f9a0383ab'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:26.518773 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1333/2699] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:58:26.522746 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a6618-c115-4d73-979c-6b96bf3d8801 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:26.523033 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1367/2700] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:26 2022] DELETE /identity/v3/users/c4793cde6719401ea845309f9a0383ab => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:26.526070 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-396a6618-c115-4d73-979c-6b96bf3d8801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:26.532673 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f800ec-9f30-419a-b17c-c8e540ee367e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:26.532975 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f800ec-9f30-419a-b17c-c8e540ee367e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:26.533261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f800ec-9f30-419a-b17c-c8e540ee367e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:26.538859 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a6618-c115-4d73-979c-6b96bf3d8801 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:26.552970 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-60f800ec-9f30-419a-b17c-c8e540ee367e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:26.554181 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-60f800ec-9f30-419a-b17c-c8e540ee367e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:26.597070 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b4a2c-a43c-4277-8aee-d229d587546b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:26.597964 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b4a2c-a43c-4277-8aee-d229d587546b admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:26.598247 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b4a2c-a43c-4277-8aee-d229d587546b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:26.598514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b4a2c-a43c-4277-8aee-d229d587546b admin admin] PATH_INFO: `/v3/projects/eca6b33fac794c98abe00913972e493e/users/4266ac3d7e8b4715997207cc1bc93a15/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:26.600605 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b4a2c-a43c-4277-8aee-d229d587546b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca6b33fac794c98abe00913972e493e, user_id=4266ac3d7e8b4715997207cc1bc93a15, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:26.603775 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b4a2c-a43c-4277-8aee-d229d587546b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:26.614486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1334/2701] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:26 2022] PUT /identity/v3/projects/eca6b33fac794c98abe00913972e493e/users/4266ac3d7e8b4715997207cc1bc93a15/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:26.622938 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1368/2702] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:58:26.632445 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b4a2c-a43c-4277-8aee-d229d587546b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:26.634214 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1a7b4a2c-a43c-4277-8aee-d229d587546b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:26.698684 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b4a2c-a43c-4277-8aee-d229d587546b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:26.702636 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b17663-98f0-4f63-9d35-9d44a3f56c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:26.703283 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b17663-98f0-4f63-9d35-9d44a3f56c61 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:26.703565 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b17663-98f0-4f63-9d35-9d44a3f56c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:26.703841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b17663-98f0-4f63-9d35-9d44a3f56c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:26.767977 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b17663-98f0-4f63-9d35-9d44a3f56c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:26.769515 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b17663-98f0-4f63-9d35-9d44a3f56c61 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:26.781950 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1335/2703] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:27.312925 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f800ec-9f30-419a-b17c-c8e540ee367e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:27.314482 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-60f800ec-9f30-419a-b17c-c8e540ee367e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:27.331392 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f800ec-9f30-419a-b17c-c8e540ee367e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:27.336473 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6e095-9319-49f6-9107-0b981781da69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:27.348928 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6e095-9319-49f6-9107-0b981781da69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:27.349430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6e095-9319-49f6-9107-0b981781da69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:27.349918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6e095-9319-49f6-9107-0b981781da69 admin admin] PATH_INFO: `/v3/projects/69ebbfac1e654481804361c4f83aaee1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:27.356510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6e095-9319-49f6-9107-0b981781da69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69ebbfac1e654481804361c4f83aaee1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:27.360235 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6e095-9319-49f6-9107-0b981781da69 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:27.497586 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bbe6e095-9319-49f6-9107-0b981781da69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69ebbfac1e654481804361c4f83aaee1', 'request_id': 'req-bbe6e095-9319-49f6-9107-0b981781da69'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:27.503781 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bbe6e095-9319-49f6-9107-0b981781da69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69ebbfac1e654481804361c4f83aaee1', 'request_id': 'req-bbe6e095-9319-49f6-9107-0b981781da69'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:27.511803 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bbe6e095-9319-49f6-9107-0b981781da69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69ebbfac1e654481804361c4f83aaee1', 'request_id': 'req-bbe6e095-9319-49f6-9107-0b981781da69'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:27.610411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bbe6e095-9319-49f6-9107-0b981781da69 admin admin] The token cache is being invalidate because project 69ebbfac1e654481804361c4f83aaee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:27.610721 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bbe6e095-9319-49f6-9107-0b981781da69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:27.611432 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bbe6e095-9319-49f6-9107-0b981781da69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:27.613452 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1369/2704] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:27 2022] DELETE /identity/v3/projects/69ebbfac1e654481804361c4f83aaee1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:27.618530 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593f52d-ed42-4ae2-a39a-e7370ab6ccc7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:27.618920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593f52d-ed42-4ae2-a39a-e7370ab6ccc7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:27.619273 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593f52d-ed42-4ae2-a39a-e7370ab6ccc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:27.637428 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8593f52d-ed42-4ae2-a39a-e7370ab6ccc7 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:27.638667 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8593f52d-ed42-4ae2-a39a-e7370ab6ccc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:27.707099 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1336/2705] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:27.719405 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85016513-d1ca-4a12-bfcc-70e029634ecc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:27.719554 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85016513-d1ca-4a12-bfcc-70e029634ecc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:27.719730 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85016513-d1ca-4a12-bfcc-70e029634ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:27.752520 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-85016513-d1ca-4a12-bfcc-70e029634ecc None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:27.753706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-85016513-d1ca-4a12-bfcc-70e029634ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:27.768607 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1370/2706] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:27.777089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593f52d-ed42-4ae2-a39a-e7370ab6ccc7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:27.800975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593f52d-ed42-4ae2-a39a-e7370ab6ccc7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:27.808514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9029b3-bdb1-4882-a798-2369f9ba006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:27.809467 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9029b3-bdb1-4882-a798-2369f9ba006e admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:27.809837 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9029b3-bdb1-4882-a798-2369f9ba006e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:27.810201 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9029b3-bdb1-4882-a798-2369f9ba006e admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:27.811192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9029b3-bdb1-4882-a798-2369f9ba006e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:27.811595 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9029b3-bdb1-4882-a798-2369f9ba006e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:27.813484 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9029b3-bdb1-4882-a798-2369f9ba006e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:27.841833 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1337/2707] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:27.843413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85016513-d1ca-4a12-bfcc-70e029634ecc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:27.857378 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85016513-d1ca-4a12-bfcc-70e029634ecc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:27.882101 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a039bc-0cd8-4297-98e8-9219bc87638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:27.882902 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a039bc-0cd8-4297-98e8-9219bc87638f admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:27.888553 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a039bc-0cd8-4297-98e8-9219bc87638f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:27.888553 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a039bc-0cd8-4297-98e8-9219bc87638f admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:27.889303 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a039bc-0cd8-4297-98e8-9219bc87638f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:27.891380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a039bc-0cd8-4297-98e8-9219bc87638f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:28.031461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1371/2708] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:58:27 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:28.034272 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9029b3-bdb1-4882-a798-2369f9ba006e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:28.056093 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9029b3-bdb1-4882-a798-2369f9ba006e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:28.201796 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226f424-58f1-4552-8b36-0f828fad964a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:28.202549 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f424-58f1-4552-8b36-0f828fad964a admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:28.202906 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f424-58f1-4552-8b36-0f828fad964a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:28.203241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f424-58f1-4552-8b36-0f828fad964a admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:28.204004 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226f424-58f1-4552-8b36-0f828fad964a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:28.206751 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226f424-58f1-4552-8b36-0f828fad964a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:28.335492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1338/2709] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:58:28 2022] POST /identity/v3/users => generated 283 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:58:28.339473 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a039bc-0cd8-4297-98e8-9219bc87638f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:28.353523 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a039bc-0cd8-4297-98e8-9219bc87638f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:28.358541 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b3fc5-df3d-40f8-8b84-d0adf6fa229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:28.359292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b3fc5-df3d-40f8-8b84-d0adf6fa229f admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:28.359646 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b3fc5-df3d-40f8-8b84-d0adf6fa229f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:28.359993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b3fc5-df3d-40f8-8b84-d0adf6fa229f admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:28.360849 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b3fc5-df3d-40f8-8b84-d0adf6fa229f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:28.362789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b3fc5-df3d-40f8-8b84-d0adf6fa229f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:28.380035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1372/2710] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:28.384951 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226f424-58f1-4552-8b36-0f828fad964a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:28.395846 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226f424-58f1-4552-8b36-0f828fad964a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:28.402510 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7b75e-eeb5-42f0-97ec-cc88666aefcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:28.403637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7b75e-eeb5-42f0-97ec-cc88666aefcc admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:28.404141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7b75e-eeb5-42f0-97ec-cc88666aefcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:28.404666 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7b75e-eeb5-42f0-97ec-cc88666aefcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:28.405648 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7b75e-eeb5-42f0-97ec-cc88666aefcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:28.407473 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7b75e-eeb5-42f0-97ec-cc88666aefcc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:28.419238 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1339/2711] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:58:28.423583 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b3fc5-df3d-40f8-8b84-d0adf6fa229f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:28.437068 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b3fc5-df3d-40f8-8b84-d0adf6fa229f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:28.444399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d4979-c5d6-4295-bf55-cbf72d1493c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:28.446633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d4979-c5d6-4295-bf55-cbf72d1493c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:28.447193 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d4979-c5d6-4295-bf55-cbf72d1493c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:28.447682 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d4979-c5d6-4295-bf55-cbf72d1493c0 admin admin] PATH_INFO: `/v3/projects/8a16e2c24aa54375864596a4f176a281/users/d2dc71b920374114b8653b0223201213/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:28.466028 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d4979-c5d6-4295-bf55-cbf72d1493c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a16e2c24aa54375864596a4f176a281, user_id=d2dc71b920374114b8653b0223201213, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:28.469127 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d4979-c5d6-4295-bf55-cbf72d1493c0 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:28.610498 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1373/2712] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:28 2022] PUT /identity/v3/projects/8a16e2c24aa54375864596a4f176a281/users/d2dc71b920374114b8653b0223201213/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:28.622770 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109dbd9-c0ea-482c-b0cb-b2fceb9b999d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:28.623173 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109dbd9-c0ea-482c-b0cb-b2fceb9b999d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:28.623723 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109dbd9-c0ea-482c-b0cb-b2fceb9b999d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:28.663860 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6109dbd9-c0ea-482c-b0cb-b2fceb9b999d None None] MFA Rules not processed for user `d2dc71b920374114b8653b0223201213`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:28.666253 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6109dbd9-c0ea-482c-b0cb-b2fceb9b999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:28.776208 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1340/2713] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:28.789172 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d4979-c5d6-4295-bf55-cbf72d1493c0 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:28.791596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-248d4979-c5d6-4295-bf55-cbf72d1493c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:28.878590 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d4979-c5d6-4295-bf55-cbf72d1493c0 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:28.882890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d714d-ffcb-427b-8700-dec20b40ff06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:28.884919 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d714d-ffcb-427b-8700-dec20b40ff06 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:28.885195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d714d-ffcb-427b-8700-dec20b40ff06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:28.885469 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d714d-ffcb-427b-8700-dec20b40ff06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:28.895773 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d714d-ffcb-427b-8700-dec20b40ff06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:28.897723 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d714d-ffcb-427b-8700-dec20b40ff06 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:28.913145 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1374/2714] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:32.989497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ed7d3-55ca-4453-aca2-e94cbdd5fac6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:32.990042 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ed7d3-55ca-4453-aca2-e94cbdd5fac6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:32.990042 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ed7d3-55ca-4453-aca2-e94cbdd5fac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:33.022509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-dc9ed7d3-55ca-4453-aca2-e94cbdd5fac6 None None] MFA Rules not processed for user `4266ac3d7e8b4715997207cc1bc93a15`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:33.022509 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dc9ed7d3-55ca-4453-aca2-e94cbdd5fac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:33.098522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1341/2715] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:33.112026 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d714d-ffcb-427b-8700-dec20b40ff06 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:33.113524 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6f3d714d-ffcb-427b-8700-dec20b40ff06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:33.184473 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d714d-ffcb-427b-8700-dec20b40ff06 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:33.188499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99785722-a9b4-4b53-9e54-ddbe57845716 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec8e2eb70a5d4dd1b3a9bec2bd0a78a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:33.189185 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99785722-a9b4-4b53-9e54-ddbe57845716 service glance] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:33.189466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99785722-a9b4-4b53-9e54-ddbe57845716 service glance] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:33.189736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99785722-a9b4-4b53-9e54-ddbe57845716 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:33.191580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-99785722-a9b4-4b53-9e54-ddbe57845716 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:33.254113 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99785722-a9b4-4b53-9e54-ddbe57845716 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:33.255548 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99785722-a9b4-4b53-9e54-ddbe57845716 service glance] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:33.265962 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1375/2716] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:33.569632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6d96b-4874-426e-b7b0-38fdf84d91bc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:33.569925 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6d96b-4874-426e-b7b0-38fdf84d91bc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:33.570310 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6d96b-4874-426e-b7b0-38fdf84d91bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:33.589637 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2fb6d96b-4874-426e-b7b0-38fdf84d91bc None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:33.590833 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2fb6d96b-4874-426e-b7b0-38fdf84d91bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:33.645349 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1342/2717] 10.222.0.81 () {58 vars in 1009 bytes} [Wed May 4 17:58:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:33.839242 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99785722-a9b4-4b53-9e54-ddbe57845716 service glance] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:33.843416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-99785722-a9b4-4b53-9e54-ddbe57845716 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:33.937337 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99785722-a9b4-4b53-9e54-ddbe57845716 service glance] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:33.942637 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480ea6b-4ed9-4a12-876d-59936642db7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:33.943323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480ea6b-4ed9-4a12-876d-59936642db7b service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:33.943582 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480ea6b-4ed9-4a12-876d-59936642db7b service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:33.943847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480ea6b-4ed9-4a12-876d-59936642db7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:33.957202 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480ea6b-4ed9-4a12-876d-59936642db7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:33.958883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480ea6b-4ed9-4a12-876d-59936642db7b service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:33.969278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1376/2718] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 17:58:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 17:58:37.224674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6d96b-4874-426e-b7b0-38fdf84d91bc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:37.227031 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2fb6d96b-4874-426e-b7b0-38fdf84d91bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:37.311103 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6d96b-4874-426e-b7b0-38fdf84d91bc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:37.314810 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e763bd2-2154-499f-91f9-7abc5f09ad78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:37.315738 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e763bd2-2154-499f-91f9-7abc5f09ad78 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:37.316047 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e763bd2-2154-499f-91f9-7abc5f09ad78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:37.316332 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e763bd2-2154-499f-91f9-7abc5f09ad78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:37.318196 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7e763bd2-2154-499f-91f9-7abc5f09ad78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:37.393421 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e763bd2-2154-499f-91f9-7abc5f09ad78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:37.394903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e763bd2-2154-499f-91f9-7abc5f09ad78 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:37.405578 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1343/2719] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:40.839396 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480ea6b-4ed9-4a12-876d-59936642db7b service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:40.961489 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480ea6b-4ed9-4a12-876d-59936642db7b service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:40.967291 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cff69-938f-4cf4-80e0-0e5a8b05cece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:40.973268 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cff69-938f-4cf4-80e0-0e5a8b05cece admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:40.973592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cff69-938f-4cf4-80e0-0e5a8b05cece admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:40.973875 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cff69-938f-4cf4-80e0-0e5a8b05cece admin admin] PATH_INFO: `/v3/users/d2dc71b920374114b8653b0223201213` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:40.975320 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cff69-938f-4cf4-80e0-0e5a8b05cece admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2dc71b920374114b8653b0223201213)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:40.978059 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cff69-938f-4cf4-80e0-0e5a8b05cece admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:41.160170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-002cff69-938f-4cf4-80e0-0e5a8b05cece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2dc71b920374114b8653b0223201213'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:41.230438 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-002cff69-938f-4cf4-80e0-0e5a8b05cece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2dc71b920374114b8653b0223201213'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:41.232763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-002cff69-938f-4cf4-80e0-0e5a8b05cece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2dc71b920374114b8653b0223201213'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:41.242238 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-002cff69-938f-4cf4-80e0-0e5a8b05cece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2dc71b920374114b8653b0223201213'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:41.256599 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-002cff69-938f-4cf4-80e0-0e5a8b05cece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2dc71b920374114b8653b0223201213'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:41.264413 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1377/2720] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:40 2022] DELETE /identity/v3/users/d2dc71b920374114b8653b0223201213 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:41.269686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76c99a-228f-4133-b3c5-3665ffc4365a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:41.270310 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76c99a-228f-4133-b3c5-3665ffc4365a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:41.270462 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76c99a-228f-4133-b3c5-3665ffc4365a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:41.290936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5f76c99a-228f-4133-b3c5-3665ffc4365a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:41.292316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5f76c99a-228f-4133-b3c5-3665ffc4365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:41.357287 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1344/2721] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:41.367129 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cff69-938f-4cf4-80e0-0e5a8b05cece admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:41.369129 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-002cff69-938f-4cf4-80e0-0e5a8b05cece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:41.428521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cff69-938f-4cf4-80e0-0e5a8b05cece admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:41.432674 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f3607-7d25-4396-8696-41f76e82b5c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:41.433323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f3607-7d25-4396-8696-41f76e82b5c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:41.433608 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f3607-7d25-4396-8696-41f76e82b5c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:41.433881 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f3607-7d25-4396-8696-41f76e82b5c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:41.443904 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f3607-7d25-4396-8696-41f76e82b5c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:41.474548 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f3607-7d25-4396-8696-41f76e82b5c8 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:41.474548 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1378/2722] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:42.214564 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76c99a-228f-4133-b3c5-3665ffc4365a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:42.216094 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5f76c99a-228f-4133-b3c5-3665ffc4365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:42.266140 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76c99a-228f-4133-b3c5-3665ffc4365a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:42.271590 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26638487-0d29-4843-8d63-b8607640c84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:42.273632 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26638487-0d29-4843-8d63-b8607640c84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:42.278179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26638487-0d29-4843-8d63-b8607640c84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:42.278179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26638487-0d29-4843-8d63-b8607640c84d admin admin] PATH_INFO: `/v3/projects/8a16e2c24aa54375864596a4f176a281` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:42.278179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26638487-0d29-4843-8d63-b8607640c84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a16e2c24aa54375864596a4f176a281)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:42.278179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26638487-0d29-4843-8d63-b8607640c84d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:42.464339 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-26638487-0d29-4843-8d63-b8607640c84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a16e2c24aa54375864596a4f176a281', 'request_id': 'req-26638487-0d29-4843-8d63-b8607640c84d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:42.470614 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-26638487-0d29-4843-8d63-b8607640c84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a16e2c24aa54375864596a4f176a281', 'request_id': 'req-26638487-0d29-4843-8d63-b8607640c84d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:42.578806 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-26638487-0d29-4843-8d63-b8607640c84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a16e2c24aa54375864596a4f176a281', 'request_id': 'req-26638487-0d29-4843-8d63-b8607640c84d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:42.623948 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-26638487-0d29-4843-8d63-b8607640c84d admin admin] The token cache is being invalidate because project 8a16e2c24aa54375864596a4f176a281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:42.624538 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-26638487-0d29-4843-8d63-b8607640c84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:42.625496 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-26638487-0d29-4843-8d63-b8607640c84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:42.631139 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1345/2723] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:42 2022] DELETE /identity/v3/projects/8a16e2c24aa54375864596a4f176a281 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:42.637703 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df79560-da29-4f7a-8be5-56e4a9135b29 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:42.638243 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df79560-da29-4f7a-8be5-56e4a9135b29 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:42.638410 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df79560-da29-4f7a-8be5-56e4a9135b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:42.668907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9df79560-da29-4f7a-8be5-56e4a9135b29 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:42.670437 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9df79560-da29-4f7a-8be5-56e4a9135b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:42.750955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1379/2724] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:42.754498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7e963-00e1-4cd1-b728-a1223a711ec3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:42.754498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7e963-00e1-4cd1-b728-a1223a711ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:42.754498 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7e963-00e1-4cd1-b728-a1223a711ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:42.776207 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-03d7e963-00e1-4cd1-b728-a1223a711ec3 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:42.777475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-03d7e963-00e1-4cd1-b728-a1223a711ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:42.787077 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1346/2725] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:42.791081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df79560-da29-4f7a-8be5-56e4a9135b29 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:42.811461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df79560-da29-4f7a-8be5-56e4a9135b29 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:42.818833 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23665c00-ee41-4579-8075-b06bd9159f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:42.819675 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23665c00-ee41-4579-8075-b06bd9159f64 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:42.819951 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23665c00-ee41-4579-8075-b06bd9159f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:42.820232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23665c00-ee41-4579-8075-b06bd9159f64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:42.821011 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23665c00-ee41-4579-8075-b06bd9159f64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:42.821310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23665c00-ee41-4579-8075-b06bd9159f64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:42.822927 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23665c00-ee41-4579-8075-b06bd9159f64 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:42.841972 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1380/2726] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:42.845812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7e963-00e1-4cd1-b728-a1223a711ec3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:42.857230 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7e963-00e1-4cd1-b728-a1223a711ec3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:42.862898 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563af4d-dff9-4190-8690-9e20f56ed17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:42.863565 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563af4d-dff9-4190-8690-9e20f56ed17b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:42.865704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563af4d-dff9-4190-8690-9e20f56ed17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:42.865704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563af4d-dff9-4190-8690-9e20f56ed17b admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:42.865704 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563af4d-dff9-4190-8690-9e20f56ed17b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:42.867557 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563af4d-dff9-4190-8690-9e20f56ed17b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:42.969552 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1347/2727] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:58:42 2022] POST /identity/v3/projects => generated 363 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:58:42.976549 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23665c00-ee41-4579-8075-b06bd9159f64 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:42.991862 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23665c00-ee41-4579-8075-b06bd9159f64 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:43.083173 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67beedd-6864-4b67-b602-ec20a5cbbd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:43.084005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67beedd-6864-4b67-b602-ec20a5cbbd0e admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:43.084385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67beedd-6864-4b67-b602-ec20a5cbbd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:43.084901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67beedd-6864-4b67-b602-ec20a5cbbd0e admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:43.088347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67beedd-6864-4b67-b602-ec20a5cbbd0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:43.090500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67beedd-6864-4b67-b602-ec20a5cbbd0e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:43.198169 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1381/2728] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:58:42 2022] POST /identity/v3/users => generated 282 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:43.202165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563af4d-dff9-4190-8690-9e20f56ed17b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:43.222472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563af4d-dff9-4190-8690-9e20f56ed17b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:43.240725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632183-c7e3-4d76-a77f-be7e6ff6477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:43.241758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632183-c7e3-4d76-a77f-be7e6ff6477a admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:43.242304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632183-c7e3-4d76-a77f-be7e6ff6477a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:43.242519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632183-c7e3-4d76-a77f-be7e6ff6477a admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:43.243492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31632183-c7e3-4d76-a77f-be7e6ff6477a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:43.245464 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31632183-c7e3-4d76-a77f-be7e6ff6477a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:43.291718 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1348/2729] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:43.295813 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67beedd-6864-4b67-b602-ec20a5cbbd0e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:43.320561 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67beedd-6864-4b67-b602-ec20a5cbbd0e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:43.335216 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de14759-9e89-4da2-8525-24a18105ed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:43.336088 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de14759-9e89-4da2-8525-24a18105ed71 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:43.338342 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de14759-9e89-4da2-8525-24a18105ed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:43.340510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de14759-9e89-4da2-8525-24a18105ed71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:43.342004 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de14759-9e89-4da2-8525-24a18105ed71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:43.344023 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de14759-9e89-4da2-8525-24a18105ed71 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:43.365391 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1382/2730] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:58:43.371836 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632183-c7e3-4d76-a77f-be7e6ff6477a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:43.387593 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632183-c7e3-4d76-a77f-be7e6ff6477a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:43.405040 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e1f4f-a558-456f-a67a-30cffb49814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:43.405929 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e1f4f-a558-456f-a67a-30cffb49814f admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:43.406216 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e1f4f-a558-456f-a67a-30cffb49814f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:43.406492 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e1f4f-a558-456f-a67a-30cffb49814f admin admin] PATH_INFO: `/v3/projects/4b61ba45caed4093aea087a320bf36e8/users/3b850e6cc9a34975801e5721e9b646df/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:43.452087 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e1f4f-a558-456f-a67a-30cffb49814f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b61ba45caed4093aea087a320bf36e8, user_id=3b850e6cc9a34975801e5721e9b646df, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:43.452394 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e1f4f-a558-456f-a67a-30cffb49814f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:43.562809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1349/2731] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:43 2022] PUT /identity/v3/projects/4b61ba45caed4093aea087a320bf36e8/users/3b850e6cc9a34975801e5721e9b646df/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:43.573654 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b94aa-0d2e-4361-bac3-fc923685734b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:43.573939 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b94aa-0d2e-4361-bac3-fc923685734b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:43.574213 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b94aa-0d2e-4361-bac3-fc923685734b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:43.605047 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6c5b94aa-0d2e-4361-bac3-fc923685734b None None] MFA Rules not processed for user `3b850e6cc9a34975801e5721e9b646df`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:43.606592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6c5b94aa-0d2e-4361-bac3-fc923685734b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:43.644353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e1f4f-a558-456f-a67a-30cffb49814f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:43.646698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ae4e1f4f-a558-456f-a67a-30cffb49814f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:43.693175 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1383/2732] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:43 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:58:43.701388 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b94aa-0d2e-4361-bac3-fc923685734b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:43.725783 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e1f4f-a558-456f-a67a-30cffb49814f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:43.734232 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f9335-c194-426d-bae0-a1731e3c969c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:43.736175 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f9335-c194-426d-bae0-a1731e3c969c service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:43.736811 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f9335-c194-426d-bae0-a1731e3c969c service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:43.737551 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f9335-c194-426d-bae0-a1731e3c969c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:43.739799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a23f9335-c194-426d-bae0-a1731e3c969c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:43.826899 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b94aa-0d2e-4361-bac3-fc923685734b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:43.835862 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f9335-c194-426d-bae0-a1731e3c969c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:43.836247 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ef4f7-1df0-4d2e-9906-869084099367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:43.837195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ef4f7-1df0-4d2e-9906-869084099367 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:43.837745 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ef4f7-1df0-4d2e-9906-869084099367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:43.837972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f9335-c194-426d-bae0-a1731e3c969c service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:43.838434 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ef4f7-1df0-4d2e-9906-869084099367 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:43.839393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ef4f7-1df0-4d2e-9906-869084099367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:43.841670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ef4f7-1df0-4d2e-9906-869084099367 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:43.858160 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1350/2733] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:58:44.036841 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1384/2734] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:58:43 2022] POST /identity/v3/projects => generated 363 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:58:44.041304 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f9335-c194-426d-bae0-a1731e3c969c service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:44.059278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f9335-c194-426d-bae0-a1731e3c969c service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:44.175620 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258206e-2e84-4915-99da-3ac3560880b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:44.176405 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258206e-2e84-4915-99da-3ac3560880b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:44.176881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258206e-2e84-4915-99da-3ac3560880b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:44.177220 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258206e-2e84-4915-99da-3ac3560880b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:44.178076 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258206e-2e84-4915-99da-3ac3560880b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:44.180870 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258206e-2e84-4915-99da-3ac3560880b6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:44.261902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1351/2735] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:58:44 2022] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:44.263797 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ef4f7-1df0-4d2e-9906-869084099367 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:44.278897 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ef4f7-1df0-4d2e-9906-869084099367 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:44.288797 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d8f94-4551-40e9-8f91-1d9534164fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:44.290681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d8f94-4551-40e9-8f91-1d9534164fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:44.290681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d8f94-4551-40e9-8f91-1d9534164fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:44.290681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d8f94-4551-40e9-8f91-1d9534164fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:44.290958 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d8f94-4551-40e9-8f91-1d9534164fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:44.292374 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d8f94-4551-40e9-8f91-1d9534164fb2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:44.309444 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1385/2736] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:44.310834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258206e-2e84-4915-99da-3ac3560880b6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:44.323324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258206e-2e84-4915-99da-3ac3560880b6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:44.337215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adfc47-2ca5-42ec-aff4-22fdf43ba5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:44.338519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adfc47-2ca5-42ec-aff4-22fdf43ba5bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:44.339250 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adfc47-2ca5-42ec-aff4-22fdf43ba5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:44.339869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adfc47-2ca5-42ec-aff4-22fdf43ba5bc admin admin] PATH_INFO: `/v3/projects/aed3c29349cb4a56931673c0ec729f19/users/763d184e8319436e92a8ba9eb1512344/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:44.365171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adfc47-2ca5-42ec-aff4-22fdf43ba5bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed3c29349cb4a56931673c0ec729f19, user_id=763d184e8319436e92a8ba9eb1512344, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:44.369697 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adfc47-2ca5-42ec-aff4-22fdf43ba5bc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:44.509482 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1352/2737] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:44 2022] PUT /identity/v3/projects/aed3c29349cb4a56931673c0ec729f19/users/763d184e8319436e92a8ba9eb1512344/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:44.511136 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d8f94-4551-40e9-8f91-1d9534164fb2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:44.540898 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d8f94-4551-40e9-8f91-1d9534164fb2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:44.578671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adfc47-2ca5-42ec-aff4-22fdf43ba5bc admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:44.582036 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e5adfc47-2ca5-42ec-aff4-22fdf43ba5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:44.678786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6164f-8127-47b9-89d2-38de7f55a525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:44.680017 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6164f-8127-47b9-89d2-38de7f55a525 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:44.680560 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6164f-8127-47b9-89d2-38de7f55a525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:44.681251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6164f-8127-47b9-89d2-38de7f55a525 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:44.682866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6164f-8127-47b9-89d2-38de7f55a525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:44.689230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6164f-8127-47b9-89d2-38de7f55a525 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:44.713321 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1386/2738] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:58:44.717072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6164f-8127-47b9-89d2-38de7f55a525 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:44.735628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adfc47-2ca5-42ec-aff4-22fdf43ba5bc admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:44.744162 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab5772-b0c7-455c-8fa8-4a1761276020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:44.744367 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab5772-b0c7-455c-8fa8-4a1761276020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:44.744522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab5772-b0c7-455c-8fa8-4a1761276020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:44.744808 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab5772-b0c7-455c-8fa8-4a1761276020 admin admin] PATH_INFO: `/v3/users/86f65bba12b84802bad645437212f1be` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:44.745229 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6164f-8127-47b9-89d2-38de7f55a525 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:44.746051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab5772-b0c7-455c-8fa8-4a1761276020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86f65bba12b84802bad645437212f1be)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:44.748296 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab5772-b0c7-455c-8fa8-4a1761276020 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:44.754678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c633ee-7321-4153-88c8-c828ab3a7559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:44.758697 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c633ee-7321-4153-88c8-c828ab3a7559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:44.759307 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c633ee-7321-4153-88c8-c828ab3a7559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:44.759950 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c633ee-7321-4153-88c8-c828ab3a7559 admin admin] PATH_INFO: `/v3/projects/aed3c29349cb4a56931673c0ec729f19/users/763d184e8319436e92a8ba9eb1512344/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:44.764141 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c633ee-7321-4153-88c8-c828ab3a7559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed3c29349cb4a56931673c0ec729f19, user_id=763d184e8319436e92a8ba9eb1512344, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:44.774422 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c633ee-7321-4153-88c8-c828ab3a7559 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:44.797901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1387/2739] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:44 2022] PUT /identity/v3/projects/aed3c29349cb4a56931673c0ec729f19/users/763d184e8319436e92a8ba9eb1512344/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:44.812901 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea443b3f-6e88-460a-88e0-c11dea2e595d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:44.813349 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea443b3f-6e88-460a-88e0-c11dea2e595d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:44.813692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea443b3f-6e88-460a-88e0-c11dea2e595d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:44.874538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ea443b3f-6e88-460a-88e0-c11dea2e595d None None] MFA Rules not processed for user `763d184e8319436e92a8ba9eb1512344`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:44.877072 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ea443b3f-6e88-460a-88e0-c11dea2e595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:44.977208 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1388/2740] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:44 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:44.978651 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea443b3f-6e88-460a-88e0-c11dea2e595d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:44.991997 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ea443b3f-6e88-460a-88e0-c11dea2e595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:44.993638 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-39ab5772-b0c7-455c-8fa8-4a1761276020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86f65bba12b84802bad645437212f1be'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:45.018460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-39ab5772-b0c7-455c-8fa8-4a1761276020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86f65bba12b84802bad645437212f1be'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:45.084351 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea443b3f-6e88-460a-88e0-c11dea2e595d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:45.088850 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bd8f0-3a85-4a44-8672-38a6894b5753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:45.089746 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bd8f0-3a85-4a44-8672-38a6894b5753 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:45.090094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bd8f0-3a85-4a44-8672-38a6894b5753 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:45.090457 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bd8f0-3a85-4a44-8672-38a6894b5753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:45.092577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-218bd8f0-3a85-4a44-8672-38a6894b5753 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:45.112154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-39ab5772-b0c7-455c-8fa8-4a1761276020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86f65bba12b84802bad645437212f1be'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:45.122419 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-39ab5772-b0c7-455c-8fa8-4a1761276020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86f65bba12b84802bad645437212f1be'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:45.123724 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-39ab5772-b0c7-455c-8fa8-4a1761276020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86f65bba12b84802bad645437212f1be'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:45.134717 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1353/2741] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:44 2022] DELETE /identity/v3/users/86f65bba12b84802bad645437212f1be => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:45.136088 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab5772-b0c7-455c-8fa8-4a1761276020 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:45.139059 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-39ab5772-b0c7-455c-8fa8-4a1761276020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:45.216454 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab5772-b0c7-455c-8fa8-4a1761276020 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:45.226075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c39c0-a778-4c2c-b4c3-b85aebfe3ff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:45.227098 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c39c0-a778-4c2c-b4c3-b85aebfe3ff6 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:45.227377 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c39c0-a778-4c2c-b4c3-b85aebfe3ff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:45.227650 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c39c0-a778-4c2c-b4c3-b85aebfe3ff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:45.237230 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cd0c39c0-a778-4c2c-b4c3-b85aebfe3ff6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:45.256294 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bd8f0-3a85-4a44-8672-38a6894b5753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:45.258467 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bd8f0-3a85-4a44-8672-38a6894b5753 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:45.290858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1389/2742] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:45.292050 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e2a94-5bdd-4ed7-89f6-29dc98eb2365 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:45.292338 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e2a94-5bdd-4ed7-89f6-29dc98eb2365 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:45.292643 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e2a94-5bdd-4ed7-89f6-29dc98eb2365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:45.348093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-635e2a94-5bdd-4ed7-89f6-29dc98eb2365 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:45.349368 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-635e2a94-5bdd-4ed7-89f6-29dc98eb2365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:45.363641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c39c0-a778-4c2c-b4c3-b85aebfe3ff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:45.366866 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c39c0-a778-4c2c-b4c3-b85aebfe3ff6 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:45.404849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1354/2743] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:45 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:45.461564 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1390/2744] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:45.471642 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c39c0-a778-4c2c-b4c3-b85aebfe3ff6 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:45.476228 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cd0c39c0-a778-4c2c-b4c3-b85aebfe3ff6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:45.538743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c39c0-a778-4c2c-b4c3-b85aebfe3ff6 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:45.542741 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a46b61-6aae-4331-8e0e-df4e3473908e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:45.543416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a46b61-6aae-4331-8e0e-df4e3473908e service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:45.543730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a46b61-6aae-4331-8e0e-df4e3473908e service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:45.544000 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a46b61-6aae-4331-8e0e-df4e3473908e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:45.554420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a46b61-6aae-4331-8e0e-df4e3473908e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:45.555842 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a46b61-6aae-4331-8e0e-df4e3473908e service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:45.566093 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1355/2745] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:46.550690 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e2a94-5bdd-4ed7-89f6-29dc98eb2365 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:46.554310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-635e2a94-5bdd-4ed7-89f6-29dc98eb2365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:46.576430 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e2a94-5bdd-4ed7-89f6-29dc98eb2365 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:46.588108 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f176bf-fed3-4002-a278-168c55f4c77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:46.588108 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f176bf-fed3-4002-a278-168c55f4c77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:46.588108 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f176bf-fed3-4002-a278-168c55f4c77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:46.588108 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f176bf-fed3-4002-a278-168c55f4c77d admin admin] PATH_INFO: `/v3/projects/d66074a63ebf47809b0ffd13a2164f85` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:46.588539 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f176bf-fed3-4002-a278-168c55f4c77d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66074a63ebf47809b0ffd13a2164f85)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:46.589302 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f176bf-fed3-4002-a278-168c55f4c77d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:46.751545 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d9f176bf-fed3-4002-a278-168c55f4c77d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66074a63ebf47809b0ffd13a2164f85', 'request_id': 'req-d9f176bf-fed3-4002-a278-168c55f4c77d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:46.761529 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d9f176bf-fed3-4002-a278-168c55f4c77d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66074a63ebf47809b0ffd13a2164f85', 'request_id': 'req-d9f176bf-fed3-4002-a278-168c55f4c77d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:46.771022 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d9f176bf-fed3-4002-a278-168c55f4c77d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66074a63ebf47809b0ffd13a2164f85', 'request_id': 'req-d9f176bf-fed3-4002-a278-168c55f4c77d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:46.977763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d9f176bf-fed3-4002-a278-168c55f4c77d admin admin] The token cache is being invalidate because project d66074a63ebf47809b0ffd13a2164f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:47.110890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d9f176bf-fed3-4002-a278-168c55f4c77d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:47.110890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d9f176bf-fed3-4002-a278-168c55f4c77d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:47.110890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1391/2746] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:46 2022] DELETE /identity/v3/projects/d66074a63ebf47809b0ffd13a2164f85 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:47.111434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648f2fa-8f97-40d7-93f9-5a35af0e1aa5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:47.111434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648f2fa-8f97-40d7-93f9-5a35af0e1aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:47.111434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648f2fa-8f97-40d7-93f9-5a35af0e1aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:47.144165 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8648f2fa-8f97-40d7-93f9-5a35af0e1aa5 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:47.145871 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8648f2fa-8f97-40d7-93f9-5a35af0e1aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:47.264192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1356/2747] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:47.266792 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2cac3-ad4d-4f1f-9b35-9c3d0f2ab385 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:47.267150 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2cac3-ad4d-4f1f-9b35-9c3d0f2ab385 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:47.267502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2cac3-ad4d-4f1f-9b35-9c3d0f2ab385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:47.290810 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e5f2cac3-ad4d-4f1f-9b35-9c3d0f2ab385 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:47.294535 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e5f2cac3-ad4d-4f1f-9b35-9c3d0f2ab385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:47.300706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1392/2748] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:47.306594 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648f2fa-8f97-40d7-93f9-5a35af0e1aa5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:47.316153 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648f2fa-8f97-40d7-93f9-5a35af0e1aa5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:47.326891 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abc2aa-3eab-4b54-8fa6-0f1dde97b365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:47.327671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abc2aa-3eab-4b54-8fa6-0f1dde97b365 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:47.328028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abc2aa-3eab-4b54-8fa6-0f1dde97b365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:47.328376 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abc2aa-3eab-4b54-8fa6-0f1dde97b365 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:47.329241 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abc2aa-3eab-4b54-8fa6-0f1dde97b365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:47.329623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abc2aa-3eab-4b54-8fa6-0f1dde97b365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:47.331309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abc2aa-3eab-4b54-8fa6-0f1dde97b365 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:47.350294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1357/2749] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:58:47.354874 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2cac3-ad4d-4f1f-9b35-9c3d0f2ab385 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:47.367876 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abc2aa-3eab-4b54-8fa6-0f1dde97b365 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:47.370183 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f6abc2aa-3eab-4b54-8fa6-0f1dde97b365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:47.371435 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2cac3-ad4d-4f1f-9b35-9c3d0f2ab385 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:47.378065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d2915-bc60-4120-8e46-a1dfc0d788fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:47.378876 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d2915-bc60-4120-8e46-a1dfc0d788fb admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:47.379261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d2915-bc60-4120-8e46-a1dfc0d788fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:47.379791 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d2915-bc60-4120-8e46-a1dfc0d788fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:47.380726 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d2915-bc60-4120-8e46-a1dfc0d788fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:47.384424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d2915-bc60-4120-8e46-a1dfc0d788fb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:47.390830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abc2aa-3eab-4b54-8fa6-0f1dde97b365 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:47.407616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e17fdf-d8a2-4d3c-b351-f4ba7bd674bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:47.409689 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e17fdf-d8a2-4d3c-b351-f4ba7bd674bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:47.409984 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e17fdf-d8a2-4d3c-b351-f4ba7bd674bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:47.410266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e17fdf-d8a2-4d3c-b351-f4ba7bd674bc admin admin] PATH_INFO: `/v3/users/3b850e6cc9a34975801e5721e9b646df` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:47.415792 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e17fdf-d8a2-4d3c-b351-f4ba7bd674bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b850e6cc9a34975801e5721e9b646df)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:47.419180 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e17fdf-d8a2-4d3c-b351-f4ba7bd674bc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:47.500398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1393/2750] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:58:47 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:58:47.501575 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d2915-bc60-4120-8e46-a1dfc0d788fb admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:47.648029 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c1e17fdf-d8a2-4d3c-b351-f4ba7bd674bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b850e6cc9a34975801e5721e9b646df'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:47.675562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c1e17fdf-d8a2-4d3c-b351-f4ba7bd674bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b850e6cc9a34975801e5721e9b646df'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:47.691906 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d2915-bc60-4120-8e46-a1dfc0d788fb admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:47.705421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5421cd3-44e6-4a17-a2cb-d88a146cf81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:47.706202 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421cd3-44e6-4a17-a2cb-d88a146cf81d admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:47.706583 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421cd3-44e6-4a17-a2cb-d88a146cf81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:47.706947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421cd3-44e6-4a17-a2cb-d88a146cf81d admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:47.707716 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5421cd3-44e6-4a17-a2cb-d88a146cf81d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:47.710465 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5421cd3-44e6-4a17-a2cb-d88a146cf81d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:47.757929 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c1e17fdf-d8a2-4d3c-b351-f4ba7bd674bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b850e6cc9a34975801e5721e9b646df'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:47.768801 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c1e17fdf-d8a2-4d3c-b351-f4ba7bd674bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b850e6cc9a34975801e5721e9b646df'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:47.769655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c1e17fdf-d8a2-4d3c-b351-f4ba7bd674bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b850e6cc9a34975801e5721e9b646df'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:47.782511 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1358/2751] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:47 2022] DELETE /identity/v3/users/3b850e6cc9a34975801e5721e9b646df => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:47.787541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32aa05-e7da-4e78-89f8-05f46be5fbf3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:47.787844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32aa05-e7da-4e78-89f8-05f46be5fbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:47.788122 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32aa05-e7da-4e78-89f8-05f46be5fbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:47.820737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7e32aa05-e7da-4e78-89f8-05f46be5fbf3 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:47.822163 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7e32aa05-e7da-4e78-89f8-05f46be5fbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:47.904475 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1394/2752] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:58:47 2022] POST /identity/v3/users => generated 291 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:47.904475 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5421cd3-44e6-4a17-a2cb-d88a146cf81d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:47.909832 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b5421cd3-44e6-4a17-a2cb-d88a146cf81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:47.919832 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1359/2753] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:47.927100 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32aa05-e7da-4e78-89f8-05f46be5fbf3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:47.942812 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7e32aa05-e7da-4e78-89f8-05f46be5fbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:47.944984 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5421cd3-44e6-4a17-a2cb-d88a146cf81d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:47.957526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5c819-4975-4a15-bc20-ad30133f5b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:47.958368 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5c819-4975-4a15-bc20-ad30133f5b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:47.958712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5c819-4975-4a15-bc20-ad30133f5b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:47.959052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5c819-4975-4a15-bc20-ad30133f5b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:47.960409 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5c819-4975-4a15-bc20-ad30133f5b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:47.968978 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5c819-4975-4a15-bc20-ad30133f5b25 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:47.992820 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1395/2754] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:47.997276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5c819-4975-4a15-bc20-ad30133f5b25 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:48.018456 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5c819-4975-4a15-bc20-ad30133f5b25 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:48.032764 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c99dec-92a2-4d26-a4ae-8326d0652b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:48.033441 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c99dec-92a2-4d26-a4ae-8326d0652b34 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:48.033886 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c99dec-92a2-4d26-a4ae-8326d0652b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:48.034174 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c99dec-92a2-4d26-a4ae-8326d0652b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:48.034911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c99dec-92a2-4d26-a4ae-8326d0652b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:48.036551 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c99dec-92a2-4d26-a4ae-8326d0652b34 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:48.060476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1396/2755] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:58:48.064794 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c7cba-529e-43ed-9580-edaf15949973 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:48.065085 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c7cba-529e-43ed-9580-edaf15949973 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:48.065364 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c7cba-529e-43ed-9580-edaf15949973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:48.076785 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32aa05-e7da-4e78-89f8-05f46be5fbf3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:48.081683 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792cb8e-ad70-4e79-9364-df494f5d77e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:48.082397 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792cb8e-ad70-4e79-9364-df494f5d77e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:48.083317 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792cb8e-ad70-4e79-9364-df494f5d77e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:48.083612 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792cb8e-ad70-4e79-9364-df494f5d77e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:48.099167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792cb8e-ad70-4e79-9364-df494f5d77e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:48.101944 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792cb8e-ad70-4e79-9364-df494f5d77e3 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:48.108728 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0e0c7cba-529e-43ed-9580-edaf15949973 None None] MFA Rules not processed for user `b15bcfb68e8048979f45a8c6ac4b6d13`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:48.109596 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0e0c7cba-529e-43ed-9580-edaf15949973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:48.114655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1360/2756] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:48.116102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792cb8e-ad70-4e79-9364-df494f5d77e3 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:48.127906 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792cb8e-ad70-4e79-9364-df494f5d77e3 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:48.135568 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb42fa-4844-4df4-ae37-7b109a51684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:48.140296 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb42fa-4844-4df4-ae37-7b109a51684c admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:48.140296 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb42fa-4844-4df4-ae37-7b109a51684c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:48.140296 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb42fa-4844-4df4-ae37-7b109a51684c admin admin] PATH_INFO: `/v3/projects/44abe4738e4d43d68e68b5d4928ea3e4/users/09a4a1284a82420698040821c4d4c108/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:48.160519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb42fa-4844-4df4-ae37-7b109a51684c admin admin] RBAC: Authorizing `identity:create_grant(project_id=44abe4738e4d43d68e68b5d4928ea3e4, user_id=09a4a1284a82420698040821c4d4c108, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:48.163516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb42fa-4844-4df4-ae37-7b109a51684c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:48.201714 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1397/2757] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:48.280577 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1361/2758] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:48 2022] PUT /identity/v3/projects/44abe4738e4d43d68e68b5d4928ea3e4/users/09a4a1284a82420698040821c4d4c108/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:48.286253 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3090834-3943-4b2f-ab3b-dedf3d6b6d3d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:48.286594 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3090834-3943-4b2f-ab3b-dedf3d6b6d3d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:48.286805 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3090834-3943-4b2f-ab3b-dedf3d6b6d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:48.309759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b3090834-3943-4b2f-ab3b-dedf3d6b6d3d None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:48.311027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b3090834-3943-4b2f-ab3b-dedf3d6b6d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:48.463081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1398/2759] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:48.483574 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb42fa-4844-4df4-ae37-7b109a51684c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:48.595674 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb42fa-4844-4df4-ae37-7b109a51684c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:48.604459 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660962a-cf4e-4e70-ba3e-41d87f57d919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:48.605127 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660962a-cf4e-4e70-ba3e-41d87f57d919 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:48.605410 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660962a-cf4e-4e70-ba3e-41d87f57d919 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:48.605686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660962a-cf4e-4e70-ba3e-41d87f57d919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:48.617622 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3090834-3943-4b2f-ab3b-dedf3d6b6d3d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:48.624733 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660962a-cf4e-4e70-ba3e-41d87f57d919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:48.626768 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660962a-cf4e-4e70-ba3e-41d87f57d919 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:48.630623 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3090834-3943-4b2f-ab3b-dedf3d6b6d3d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:48.637221 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1362/2760] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:48.637907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f2517-8f6e-4ba4-bf71-6c97a3b98c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:48.638830 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f2517-8f6e-4ba4-bf71-6c97a3b98c25 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:48.639341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f2517-8f6e-4ba4-bf71-6c97a3b98c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:48.639825 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f2517-8f6e-4ba4-bf71-6c97a3b98c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:48.641967 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7e1f2517-8f6e-4ba4-bf71-6c97a3b98c25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:48.662143 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f2517-8f6e-4ba4-bf71-6c97a3b98c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:48.665839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f2517-8f6e-4ba4-bf71-6c97a3b98c25 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:48.678204 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1399/2761] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:58:49.082028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660962a-cf4e-4e70-ba3e-41d87f57d919 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:49.083714 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a660962a-cf4e-4e70-ba3e-41d87f57d919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:49.107400 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660962a-cf4e-4e70-ba3e-41d87f57d919 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:49.113993 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd4a91-ecd9-4f29-9249-360711c62f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:49.115147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd4a91-ecd9-4f29-9249-360711c62f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:49.116382 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd4a91-ecd9-4f29-9249-360711c62f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:49.116631 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd4a91-ecd9-4f29-9249-360711c62f98 admin admin] PATH_INFO: `/v3/projects/4b61ba45caed4093aea087a320bf36e8` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:49.118659 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd4a91-ecd9-4f29-9249-360711c62f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b61ba45caed4093aea087a320bf36e8)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:49.120664 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd4a91-ecd9-4f29-9249-360711c62f98 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:49.252467 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-21fd4a91-ecd9-4f29-9249-360711c62f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b61ba45caed4093aea087a320bf36e8', 'request_id': 'req-21fd4a91-ecd9-4f29-9249-360711c62f98'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:49.258691 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-21fd4a91-ecd9-4f29-9249-360711c62f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b61ba45caed4093aea087a320bf36e8', 'request_id': 'req-21fd4a91-ecd9-4f29-9249-360711c62f98'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:49.351631 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-21fd4a91-ecd9-4f29-9249-360711c62f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b61ba45caed4093aea087a320bf36e8', 'request_id': 'req-21fd4a91-ecd9-4f29-9249-360711c62f98'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:49.389062 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-21fd4a91-ecd9-4f29-9249-360711c62f98 admin admin] The token cache is being invalidate because project 4b61ba45caed4093aea087a320bf36e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:49.389638 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-21fd4a91-ecd9-4f29-9249-360711c62f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:49.390318 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-21fd4a91-ecd9-4f29-9249-360711c62f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:49.397734 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1363/2762] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:49 2022] DELETE /identity/v3/projects/4b61ba45caed4093aea087a320bf36e8 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:49.398637 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f2517-8f6e-4ba4-bf71-6c97a3b98c25 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:49.423861 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f2517-8f6e-4ba4-bf71-6c97a3b98c25 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:49.527691 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00344a-98df-4809-9a03-0693ff76bf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:49.527691 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00344a-98df-4809-9a03-0693ff76bf1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:49.528065 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00344a-98df-4809-9a03-0693ff76bf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:49.528350 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00344a-98df-4809-9a03-0693ff76bf1b admin admin] PATH_INFO: `/v3/users/763d184e8319436e92a8ba9eb1512344` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:49.529601 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00344a-98df-4809-9a03-0693ff76bf1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=763d184e8319436e92a8ba9eb1512344)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:49.531521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00344a-98df-4809-9a03-0693ff76bf1b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:49.736253 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8d00344a-98df-4809-9a03-0693ff76bf1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763d184e8319436e92a8ba9eb1512344'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:49.791779 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8d00344a-98df-4809-9a03-0693ff76bf1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763d184e8319436e92a8ba9eb1512344'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:49.792851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8d00344a-98df-4809-9a03-0693ff76bf1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763d184e8319436e92a8ba9eb1512344'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:49.805652 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8d00344a-98df-4809-9a03-0693ff76bf1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763d184e8319436e92a8ba9eb1512344'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:49.851754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8d00344a-98df-4809-9a03-0693ff76bf1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763d184e8319436e92a8ba9eb1512344'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:49.866505 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1400/2763] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:49 2022] DELETE /identity/v3/users/763d184e8319436e92a8ba9eb1512344 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:50.477892 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca93c80-afc5-4fdb-b56b-c35e5b3b9180 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:50.479989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca93c80-afc5-4fdb-b56b-c35e5b3b9180 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:50.479989 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca93c80-afc5-4fdb-b56b-c35e5b3b9180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:50.503175 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00344a-98df-4809-9a03-0693ff76bf1b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:50.505259 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8d00344a-98df-4809-9a03-0693ff76bf1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:50.540927 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9ca93c80-afc5-4fdb-b56b-c35e5b3b9180 None None] MFA Rules not processed for user `09a4a1284a82420698040821c4d4c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:50.550984 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9ca93c80-afc5-4fdb-b56b-c35e5b3b9180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:50.644817 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1364/2764] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:50.657976 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00344a-98df-4809-9a03-0693ff76bf1b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:50.659728 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca93c80-afc5-4fdb-b56b-c35e5b3b9180 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:50.661642 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9ca93c80-afc5-4fdb-b56b-c35e5b3b9180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:50.666428 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74902a-22c4-473a-8886-f101c9ce3b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:50.674269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74902a-22c4-473a-8886-f101c9ce3b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:50.674269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74902a-22c4-473a-8886-f101c9ce3b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:50.674269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74902a-22c4-473a-8886-f101c9ce3b3d admin admin] PATH_INFO: `/v3/projects/aed3c29349cb4a56931673c0ec729f19` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:50.674269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74902a-22c4-473a-8886-f101c9ce3b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed3c29349cb4a56931673c0ec729f19)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:50.674269 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74902a-22c4-473a-8886-f101c9ce3b3d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:50.720653 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca93c80-afc5-4fdb-b56b-c35e5b3b9180 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:50.724398 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26ebe1-c1f4-4428-9d15-3781b5b60766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:50.725841 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26ebe1-c1f4-4428-9d15-3781b5b60766 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:50.726125 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26ebe1-c1f4-4428-9d15-3781b5b60766 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:50.726460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26ebe1-c1f4-4428-9d15-3781b5b60766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:50.735183 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26ebe1-c1f4-4428-9d15-3781b5b60766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:50.736655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26ebe1-c1f4-4428-9d15-3781b5b60766 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:50.745695 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1365/2765] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:50.801052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9c74902a-22c4-473a-8886-f101c9ce3b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed3c29349cb4a56931673c0ec729f19', 'request_id': 'req-9c74902a-22c4-473a-8886-f101c9ce3b3d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:50.808061 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9c74902a-22c4-473a-8886-f101c9ce3b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed3c29349cb4a56931673c0ec729f19', 'request_id': 'req-9c74902a-22c4-473a-8886-f101c9ce3b3d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:50.814871 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9c74902a-22c4-473a-8886-f101c9ce3b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed3c29349cb4a56931673c0ec729f19', 'request_id': 'req-9c74902a-22c4-473a-8886-f101c9ce3b3d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:50.900198 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9c74902a-22c4-473a-8886-f101c9ce3b3d admin admin] The token cache is being invalidate because project aed3c29349cb4a56931673c0ec729f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:50.900812 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9c74902a-22c4-473a-8886-f101c9ce3b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:50.901640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9c74902a-22c4-473a-8886-f101c9ce3b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:50.903218 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1401/2766] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:50 2022] DELETE /identity/v3/projects/aed3c29349cb4a56931673c0ec729f19 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:50.908062 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484dea1-246b-4ed4-ab64-819111678088 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:50.908353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484dea1-246b-4ed4-ab64-819111678088 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:50.908655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484dea1-246b-4ed4-ab64-819111678088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:50.929294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2484dea1-246b-4ed4-ab64-819111678088 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:50.930544 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2484dea1-246b-4ed4-ab64-819111678088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:50.992591 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1366/2767] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:51.000706 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e5bf9-482f-455d-838f-94b111ede522 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:51.001224 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e5bf9-482f-455d-838f-94b111ede522 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:51.001567 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e5bf9-482f-455d-838f-94b111ede522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:51.021855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-784e5bf9-482f-455d-838f-94b111ede522 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:51.023539 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-784e5bf9-482f-455d-838f-94b111ede522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:51.033033 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1402/2768] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:51.038015 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484dea1-246b-4ed4-ab64-819111678088 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:51.048328 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484dea1-246b-4ed4-ab64-819111678088 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:51.053150 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c60b4-1ed0-4900-bb18-1a56292d00df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:51.053797 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c60b4-1ed0-4900-bb18-1a56292d00df admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:51.054085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c60b4-1ed0-4900-bb18-1a56292d00df admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:51.054914 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c60b4-1ed0-4900-bb18-1a56292d00df admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:51.055105 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c60b4-1ed0-4900-bb18-1a56292d00df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:51.055423 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c60b4-1ed0-4900-bb18-1a56292d00df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:51.057043 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c60b4-1ed0-4900-bb18-1a56292d00df admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:51.072872 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1367/2769] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:51.076281 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e5bf9-482f-455d-838f-94b111ede522 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:51.083819 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e5bf9-482f-455d-838f-94b111ede522 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:51.093581 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c100667-385e-4440-b7d6-a9e1a03f2551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:51.094332 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c100667-385e-4440-b7d6-a9e1a03f2551 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:51.094679 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c100667-385e-4440-b7d6-a9e1a03f2551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:51.095020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c100667-385e-4440-b7d6-a9e1a03f2551 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:51.095847 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c100667-385e-4440-b7d6-a9e1a03f2551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:51.097876 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c100667-385e-4440-b7d6-a9e1a03f2551 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:51.179818 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1403/2770] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:58:51 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:51.181309 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c60b4-1ed0-4900-bb18-1a56292d00df admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:51.191472 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c60b4-1ed0-4900-bb18-1a56292d00df admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:51.254330 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427374eb-5a8a-40ba-8ab4-a9c36a800d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:51.254923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427374eb-5a8a-40ba-8ab4-a9c36a800d9e admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:51.255211 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427374eb-5a8a-40ba-8ab4-a9c36a800d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:51.255491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427374eb-5a8a-40ba-8ab4-a9c36a800d9e admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:51.256907 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427374eb-5a8a-40ba-8ab4-a9c36a800d9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:51.258958 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427374eb-5a8a-40ba-8ab4-a9c36a800d9e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:51.347514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1368/2771] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:58:51 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:51.352056 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c100667-385e-4440-b7d6-a9e1a03f2551 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:51.362807 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c100667-385e-4440-b7d6-a9e1a03f2551 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:51.368141 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fae4aa-a247-43ff-a23e-bc1707a7cf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:51.368949 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fae4aa-a247-43ff-a23e-bc1707a7cf2e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:51.369296 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fae4aa-a247-43ff-a23e-bc1707a7cf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:51.369635 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fae4aa-a247-43ff-a23e-bc1707a7cf2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:51.370429 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fae4aa-a247-43ff-a23e-bc1707a7cf2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:51.372013 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fae4aa-a247-43ff-a23e-bc1707a7cf2e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:51.384319 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1404/2772] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:51.388262 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427374eb-5a8a-40ba-8ab4-a9c36a800d9e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:51.399795 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427374eb-5a8a-40ba-8ab4-a9c36a800d9e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:51.404688 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e0abc-4618-44e0-82d0-ea3522409cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:51.405448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e0abc-4618-44e0-82d0-ea3522409cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:51.406433 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e0abc-4618-44e0-82d0-ea3522409cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:51.406804 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e0abc-4618-44e0-82d0-ea3522409cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:51.407629 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e0abc-4618-44e0-82d0-ea3522409cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:51.409409 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e0abc-4618-44e0-82d0-ea3522409cb7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:51.424232 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1369/2773] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:51.429116 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fae4aa-a247-43ff-a23e-bc1707a7cf2e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:51.440121 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fae4aa-a247-43ff-a23e-bc1707a7cf2e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:51.445789 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95dd8ee-3347-4eff-adc1-f2d9fcc864dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:51.446759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dd8ee-3347-4eff-adc1-f2d9fcc864dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:51.447144 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dd8ee-3347-4eff-adc1-f2d9fcc864dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:51.447522 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dd8ee-3347-4eff-adc1-f2d9fcc864dd admin admin] PATH_INFO: `/v3/projects/6835b244a3a34e93b9c83928236bf930/users/969b52ffcbaa4c09827a437d09e80f95/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:51.463058 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95dd8ee-3347-4eff-adc1-f2d9fcc864dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6835b244a3a34e93b9c83928236bf930, user_id=969b52ffcbaa4c09827a437d09e80f95, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:51.465959 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95dd8ee-3347-4eff-adc1-f2d9fcc864dd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:51.573142 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1405/2774] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:51 2022] PUT /identity/v3/projects/6835b244a3a34e93b9c83928236bf930/users/969b52ffcbaa4c09827a437d09e80f95/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:51.583350 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c20c3-fa2c-470d-8dc2-bd9c630dbe27 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:51.583963 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c20c3-fa2c-470d-8dc2-bd9c630dbe27 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:51.584296 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c20c3-fa2c-470d-8dc2-bd9c630dbe27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:51.621075 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fd4c20c3-fa2c-470d-8dc2-bd9c630dbe27 None None] MFA Rules not processed for user `969b52ffcbaa4c09827a437d09e80f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:51.622596 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fd4c20c3-fa2c-470d-8dc2-bd9c630dbe27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:51.713416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95dd8ee-3347-4eff-adc1-f2d9fcc864dd admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:51.720080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1370/2775] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:58:51.799188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95dd8ee-3347-4eff-adc1-f2d9fcc864dd admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:51.801570 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71140b7f-9d14-4d75-bc90-eccfcf2448e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:51.802598 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71140b7f-9d14-4d75-bc90-eccfcf2448e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:51.803358 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71140b7f-9d14-4d75-bc90-eccfcf2448e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:51.803876 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71140b7f-9d14-4d75-bc90-eccfcf2448e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:51.805642 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71140b7f-9d14-4d75-bc90-eccfcf2448e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:51.808405 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71140b7f-9d14-4d75-bc90-eccfcf2448e9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:51.925807 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1406/2776] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:58:51 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:51.925974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c20c3-fa2c-470d-8dc2-bd9c630dbe27 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:51.938849 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c20c3-fa2c-470d-8dc2-bd9c630dbe27 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:52.005345 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d0bc4-2756-40b1-9543-55c44e2b4ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:52.006663 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d0bc4-2756-40b1-9543-55c44e2b4ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:52.007013 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d0bc4-2756-40b1-9543-55c44e2b4ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:52.007290 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d0bc4-2756-40b1-9543-55c44e2b4ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:52.007995 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d0bc4-2756-40b1-9543-55c44e2b4ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:52.009974 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d0bc4-2756-40b1-9543-55c44e2b4ae8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:52.109546 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1371/2777] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:58:51 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:52.113649 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71140b7f-9d14-4d75-bc90-eccfcf2448e9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:52.129424 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71140b7f-9d14-4d75-bc90-eccfcf2448e9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:52.129984 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df30d17-c932-415c-9bd4-19c23b549424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:52.131196 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df30d17-c932-415c-9bd4-19c23b549424 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:52.131606 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df30d17-c932-415c-9bd4-19c23b549424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:52.131885 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df30d17-c932-415c-9bd4-19c23b549424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:52.132694 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df30d17-c932-415c-9bd4-19c23b549424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:52.134406 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df30d17-c932-415c-9bd4-19c23b549424 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:52.152342 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1407/2778] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:52.155563 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d0bc4-2756-40b1-9543-55c44e2b4ae8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:52.167570 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d0bc4-2756-40b1-9543-55c44e2b4ae8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:52.181331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d238f-c899-4538-9299-f24440954d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:52.183657 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d238f-c899-4538-9299-f24440954d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:52.184688 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d238f-c899-4538-9299-f24440954d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:52.186392 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d238f-c899-4538-9299-f24440954d48 admin admin] PATH_INFO: `/v3/projects/42248911d2084970a3d8a345f51b4403/users/a7ee3781662b4b92a063b64b014f0f3e/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:52.301096 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ff791-01bf-4ca0-9c0e-b7dd957b711f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:52.301384 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ff791-01bf-4ca0-9c0e-b7dd957b711f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:52.301852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ff791-01bf-4ca0-9c0e-b7dd957b711f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:52.319943 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7c0ff791-01bf-4ca0-9c0e-b7dd957b711f None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:52.321470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7c0ff791-01bf-4ca0-9c0e-b7dd957b711f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:52.355541 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d238f-c899-4538-9299-f24440954d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42248911d2084970a3d8a345f51b4403, user_id=a7ee3781662b4b92a063b64b014f0f3e, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:52.359863 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d238f-c899-4538-9299-f24440954d48 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:52.440914 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1408/2779] 10.222.0.81 () {58 vars in 1009 bytes} [Wed May 4 17:58:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:52.447123 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd49dc3-ca2f-400c-87a4-8d1a8dc6deae None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:52.449658 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd49dc3-ca2f-400c-87a4-8d1a8dc6deae None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:52.451947 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd49dc3-ca2f-400c-87a4-8d1a8dc6deae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:52.467605 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1372/2780] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:52 2022] PUT /identity/v3/projects/42248911d2084970a3d8a345f51b4403/users/a7ee3781662b4b92a063b64b014f0f3e/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:52.468494 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d238f-c899-4538-9299-f24440954d48 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:52.474517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6dd49dc3-ca2f-400c-87a4-8d1a8dc6deae None None] MFA Rules not processed for user `09a4a1284a82420698040821c4d4c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:52.475985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bd1d238f-c899-4538-9299-f24440954d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:52.484361 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6dd49dc3-ca2f-400c-87a4-8d1a8dc6deae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:52.577758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d238f-c899-4538-9299-f24440954d48 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:52.587739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1409/2781] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:52.588756 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd49dc3-ca2f-400c-87a4-8d1a8dc6deae None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:52.621443 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6f090-2291-4bc4-8570-e4d5a7c9bbe8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:52.622199 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6f090-2291-4bc4-8570-e4d5a7c9bbe8 service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:52.622585 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6f090-2291-4bc4-8570-e4d5a7c9bbe8 service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:52.622967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6f090-2291-4bc4-8570-e4d5a7c9bbe8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:52.748650 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6f090-2291-4bc4-8570-e4d5a7c9bbe8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:52.751321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6f090-2291-4bc4-8570-e4d5a7c9bbe8 service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:52.755328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd49dc3-ca2f-400c-87a4-8d1a8dc6deae None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:52.761093 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99490859-c988-4ea2-bf15-7989f1be78fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:52.761293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1373/2782] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 17:58:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 17:58:52.762121 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99490859-c988-4ea2-bf15-7989f1be78fa admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:52.762392 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99490859-c988-4ea2-bf15-7989f1be78fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:52.762763 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99490859-c988-4ea2-bf15-7989f1be78fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:52.763415 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99490859-c988-4ea2-bf15-7989f1be78fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:52.764988 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99490859-c988-4ea2-bf15-7989f1be78fa admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:52.783870 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1410/2783] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:52.788115 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6f090-2291-4bc4-8570-e4d5a7c9bbe8 service swift] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:52.800114 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6f090-2291-4bc4-8570-e4d5a7c9bbe8 service swift] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:52.815266 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504341e-122c-40b2-a4d6-893d247cc73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:52.816414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504341e-122c-40b2-a4d6-893d247cc73c admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:52.817606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504341e-122c-40b2-a4d6-893d247cc73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:52.817606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504341e-122c-40b2-a4d6-893d247cc73c admin admin] PATH_INFO: `/v3/projects/42248911d2084970a3d8a345f51b4403/users/a7ee3781662b4b92a063b64b014f0f3e/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:52.822298 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504341e-122c-40b2-a4d6-893d247cc73c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42248911d2084970a3d8a345f51b4403, user_id=a7ee3781662b4b92a063b64b014f0f3e, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:52.829057 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504341e-122c-40b2-a4d6-893d247cc73c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:52.854673 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1374/2784] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:52 2022] PUT /identity/v3/projects/42248911d2084970a3d8a345f51b4403/users/a7ee3781662b4b92a063b64b014f0f3e/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:52.857461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710db6d3-c55c-4f3c-9ad8-776db71926ca None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:52.857961 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710db6d3-c55c-4f3c-9ad8-776db71926ca None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:52.858398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710db6d3-c55c-4f3c-9ad8-776db71926ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:52.892580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-710db6d3-c55c-4f3c-9ad8-776db71926ca None None] MFA Rules not processed for user `a7ee3781662b4b92a063b64b014f0f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:52.893802 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-710db6d3-c55c-4f3c-9ad8-776db71926ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:53.011529 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1411/2785] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:53.023851 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504341e-122c-40b2-a4d6-893d247cc73c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:53.027340 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8504341e-122c-40b2-a4d6-893d247cc73c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:53.233440 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504341e-122c-40b2-a4d6-893d247cc73c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:53.257816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df87baa-abb8-45d4-948e-8a61b709f6e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:53.260818 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df87baa-abb8-45d4-948e-8a61b709f6e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:53.261175 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df87baa-abb8-45d4-948e-8a61b709f6e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:53.261526 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df87baa-abb8-45d4-948e-8a61b709f6e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:53.298324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df87baa-abb8-45d4-948e-8a61b709f6e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:53.301287 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df87baa-abb8-45d4-948e-8a61b709f6e7 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:53.381976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1375/2786] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:58:53.467105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710db6d3-c55c-4f3c-9ad8-776db71926ca None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:53.625001 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710db6d3-c55c-4f3c-9ad8-776db71926ca None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:53.637907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5058abd-49c4-4345-9595-5bf38def21b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:53.639610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5058abd-49c4-4345-9595-5bf38def21b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:53.640733 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5058abd-49c4-4345-9595-5bf38def21b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:53.641418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5058abd-49c4-4345-9595-5bf38def21b9 admin admin] PATH_INFO: `/v3/users/969b52ffcbaa4c09827a437d09e80f95` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:53.643500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5058abd-49c4-4345-9595-5bf38def21b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=969b52ffcbaa4c09827a437d09e80f95)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:53.645746 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5058abd-49c4-4345-9595-5bf38def21b9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:53.937737 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e5058abd-49c4-4345-9595-5bf38def21b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '969b52ffcbaa4c09827a437d09e80f95'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:54.054100 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e5058abd-49c4-4345-9595-5bf38def21b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '969b52ffcbaa4c09827a437d09e80f95'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:54.054736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e5058abd-49c4-4345-9595-5bf38def21b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '969b52ffcbaa4c09827a437d09e80f95'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:54.066035 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e5058abd-49c4-4345-9595-5bf38def21b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '969b52ffcbaa4c09827a437d09e80f95'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:54.102888 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e5058abd-49c4-4345-9595-5bf38def21b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '969b52ffcbaa4c09827a437d09e80f95'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:54.121812 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1412/2787] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:53 2022] DELETE /identity/v3/users/969b52ffcbaa4c09827a437d09e80f95 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:54.126693 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf88f8-875e-4ce4-847f-f2b1d21cb1d4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:54.127268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf88f8-875e-4ce4-847f-f2b1d21cb1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:54.127268 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf88f8-875e-4ce4-847f-f2b1d21cb1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:54.200388 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bbaf88f8-875e-4ce4-847f-f2b1d21cb1d4 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:54.200388 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bbaf88f8-875e-4ce4-847f-f2b1d21cb1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:54.366108 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1376/2788] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:54.386109 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5058abd-49c4-4345-9595-5bf38def21b9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:54.387655 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e5058abd-49c4-4345-9595-5bf38def21b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:54.499399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5058abd-49c4-4345-9595-5bf38def21b9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:54.508641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7626e-2be2-4c0b-8eb4-a3dfa3148dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:54.509942 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7626e-2be2-4c0b-8eb4-a3dfa3148dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:54.510507 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7626e-2be2-4c0b-8eb4-a3dfa3148dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:54.511300 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7626e-2be2-4c0b-8eb4-a3dfa3148dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:54.529477 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7626e-2be2-4c0b-8eb4-a3dfa3148dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:54.533179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7626e-2be2-4c0b-8eb4-a3dfa3148dc3 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:54.563521 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1413/2789] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:58:55.518486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf88f8-875e-4ce4-847f-f2b1d21cb1d4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:55.519920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bbaf88f8-875e-4ce4-847f-f2b1d21cb1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:55.558246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf88f8-875e-4ce4-847f-f2b1d21cb1d4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:55.571079 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410ad1f-8754-414a-96f1-fac6f3528b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:55.571079 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410ad1f-8754-414a-96f1-fac6f3528b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:55.571079 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410ad1f-8754-414a-96f1-fac6f3528b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:55.571079 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410ad1f-8754-414a-96f1-fac6f3528b1b admin admin] PATH_INFO: `/v3/projects/6835b244a3a34e93b9c83928236bf930` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:55.572777 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410ad1f-8754-414a-96f1-fac6f3528b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6835b244a3a34e93b9c83928236bf930)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:55.575317 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410ad1f-8754-414a-96f1-fac6f3528b1b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:55.741324 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7410ad1f-8754-414a-96f1-fac6f3528b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6835b244a3a34e93b9c83928236bf930', 'request_id': 'req-7410ad1f-8754-414a-96f1-fac6f3528b1b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:55.748003 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7410ad1f-8754-414a-96f1-fac6f3528b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6835b244a3a34e93b9c83928236bf930', 'request_id': 'req-7410ad1f-8754-414a-96f1-fac6f3528b1b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:55.847248 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7410ad1f-8754-414a-96f1-fac6f3528b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6835b244a3a34e93b9c83928236bf930', 'request_id': 'req-7410ad1f-8754-414a-96f1-fac6f3528b1b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:55.870373 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7410ad1f-8754-414a-96f1-fac6f3528b1b admin admin] The token cache is being invalidate because project 6835b244a3a34e93b9c83928236bf930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:55.871976 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7410ad1f-8754-414a-96f1-fac6f3528b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:55.873133 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7410ad1f-8754-414a-96f1-fac6f3528b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:55.876481 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1377/2790] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:55 2022] DELETE /identity/v3/projects/6835b244a3a34e93b9c83928236bf930 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:55.881377 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7626e-2be2-4c0b-8eb4-a3dfa3148dc3 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:55.894080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7626e-2be2-4c0b-8eb4-a3dfa3148dc3 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:56.034630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466b488-3373-4ab9-a1d6-6c979c95faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:56.035953 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b488-3373-4ab9-a1d6-6c979c95faa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:56.036389 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b488-3373-4ab9-a1d6-6c979c95faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:56.037617 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b488-3373-4ab9-a1d6-6c979c95faa6 admin admin] PATH_INFO: `/v3/users/a7ee3781662b4b92a063b64b014f0f3e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:56.039063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466b488-3373-4ab9-a1d6-6c979c95faa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ee3781662b4b92a063b64b014f0f3e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:56.041431 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466b488-3373-4ab9-a1d6-6c979c95faa6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:56.287688 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c466b488-3373-4ab9-a1d6-6c979c95faa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ee3781662b4b92a063b64b014f0f3e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:56.402423 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c466b488-3373-4ab9-a1d6-6c979c95faa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ee3781662b4b92a063b64b014f0f3e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:56.403030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c466b488-3373-4ab9-a1d6-6c979c95faa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ee3781662b4b92a063b64b014f0f3e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:56.415177 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c466b488-3373-4ab9-a1d6-6c979c95faa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ee3781662b4b92a063b64b014f0f3e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:56.442536 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c466b488-3373-4ab9-a1d6-6c979c95faa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ee3781662b4b92a063b64b014f0f3e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:56.450199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1414/2791] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:55 2022] DELETE /identity/v3/users/a7ee3781662b4b92a063b64b014f0f3e => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:56.952921 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410ad1f-8754-414a-96f1-fac6f3528b1b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:56.954685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7410ad1f-8754-414a-96f1-fac6f3528b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:56.978669 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410ad1f-8754-414a-96f1-fac6f3528b1b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:57.055982 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f49475-9cfd-4fa3-bcb3-c7aa6c17b65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:57.056990 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f49475-9cfd-4fa3-bcb3-c7aa6c17b65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:57.057334 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f49475-9cfd-4fa3-bcb3-c7aa6c17b65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:57.057669 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f49475-9cfd-4fa3-bcb3-c7aa6c17b65f admin admin] PATH_INFO: `/v3/users/28c93905a28d452097c9b45bcbe3cfd2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:57.059028 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f49475-9cfd-4fa3-bcb3-c7aa6c17b65f admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c93905a28d452097c9b45bcbe3cfd2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:57.061097 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f49475-9cfd-4fa3-bcb3-c7aa6c17b65f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:57.157256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466b488-3373-4ab9-a1d6-6c979c95faa6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:57.157256 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c466b488-3373-4ab9-a1d6-6c979c95faa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:57.170736 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466b488-3373-4ab9-a1d6-6c979c95faa6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:57.180024 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c9b2c-6dbe-4f84-9a8f-814077d7c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:57.182031 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c9b2c-6dbe-4f84-9a8f-814077d7c58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:57.183493 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c9b2c-6dbe-4f84-9a8f-814077d7c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:57.183493 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c9b2c-6dbe-4f84-9a8f-814077d7c58f admin admin] PATH_INFO: `/v3/projects/42248911d2084970a3d8a345f51b4403` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:57.184347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c9b2c-6dbe-4f84-9a8f-814077d7c58f admin admin] RBAC: Authorizing `identity:delete_project(project_id=42248911d2084970a3d8a345f51b4403)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:57.186322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c9b2c-6dbe-4f84-9a8f-814077d7c58f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:57.263755 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-68f49475-9cfd-4fa3-bcb3-c7aa6c17b65f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c93905a28d452097c9b45bcbe3cfd2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:57.277023 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-68f49475-9cfd-4fa3-bcb3-c7aa6c17b65f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c93905a28d452097c9b45bcbe3cfd2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:57.302422 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-026c9b2c-6dbe-4f84-9a8f-814077d7c58f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42248911d2084970a3d8a345f51b4403', 'request_id': 'req-026c9b2c-6dbe-4f84-9a8f-814077d7c58f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:57.307881 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-026c9b2c-6dbe-4f84-9a8f-814077d7c58f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42248911d2084970a3d8a345f51b4403', 'request_id': 'req-026c9b2c-6dbe-4f84-9a8f-814077d7c58f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:57.314273 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-026c9b2c-6dbe-4f84-9a8f-814077d7c58f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42248911d2084970a3d8a345f51b4403', 'request_id': 'req-026c9b2c-6dbe-4f84-9a8f-814077d7c58f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:57.368229 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-68f49475-9cfd-4fa3-bcb3-c7aa6c17b65f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c93905a28d452097c9b45bcbe3cfd2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:57.375707 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-68f49475-9cfd-4fa3-bcb3-c7aa6c17b65f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c93905a28d452097c9b45bcbe3cfd2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:57.376358 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-68f49475-9cfd-4fa3-bcb3-c7aa6c17b65f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c93905a28d452097c9b45bcbe3cfd2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:57.382565 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1378/2792] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:56 2022] DELETE /identity/v3/users/28c93905a28d452097c9b45bcbe3cfd2 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:57.435838 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-026c9b2c-6dbe-4f84-9a8f-814077d7c58f admin admin] The token cache is being invalidate because project 42248911d2084970a3d8a345f51b4403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:57.436356 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-026c9b2c-6dbe-4f84-9a8f-814077d7c58f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:57.437302 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-026c9b2c-6dbe-4f84-9a8f-814077d7c58f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:57.439139 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1415/2793] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:57 2022] DELETE /identity/v3/projects/42248911d2084970a3d8a345f51b4403 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:57.448364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38401bc2-4d07-4963-8bae-30919d61b8f1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:57.448690 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38401bc2-4d07-4963-8bae-30919d61b8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:57.448968 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38401bc2-4d07-4963-8bae-30919d61b8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:57.505194 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-38401bc2-4d07-4963-8bae-30919d61b8f1 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:57.506546 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-38401bc2-4d07-4963-8bae-30919d61b8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:57.616489 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1379/2794] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:57.623786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f4d5-9961-4457-bc95-fe3464d5604a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:57.623786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f4d5-9961-4457-bc95-fe3464d5604a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:57.623786 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f4d5-9961-4457-bc95-fe3464d5604a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:57.663945 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4ee5f4d5-9961-4457-bc95-fe3464d5604a None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:57.665250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4ee5f4d5-9961-4457-bc95-fe3464d5604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:57.690042 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1416/2795] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:57.697995 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38401bc2-4d07-4963-8bae-30919d61b8f1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:57.725240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38401bc2-4d07-4963-8bae-30919d61b8f1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:57.725240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f0e8-b58b-40ff-959f-34c6963d506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:57.725240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f0e8-b58b-40ff-959f-34c6963d506e admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:57.725240 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f0e8-b58b-40ff-959f-34c6963d506e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:57.725867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f0e8-b58b-40ff-959f-34c6963d506e admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:57.725867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1f0e8-b58b-40ff-959f-34c6963d506e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:58:57.725867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1f0e8-b58b-40ff-959f-34c6963d506e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:57.725867 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1f0e8-b58b-40ff-959f-34c6963d506e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:57.753685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1380/2796] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:58:57.758985 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5f4d5-9961-4457-bc95-fe3464d5604a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:57.769379 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5f4d5-9961-4457-bc95-fe3464d5604a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:57.774759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7db85-4a2e-4dd6-91b4-27863e7ec1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:57.782385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7db85-4a2e-4dd6-91b4-27863e7ec1aa admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:57.789883 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7db85-4a2e-4dd6-91b4-27863e7ec1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:57.790450 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7db85-4a2e-4dd6-91b4-27863e7ec1aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:57.790973 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7db85-4a2e-4dd6-91b4-27863e7ec1aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:57.793146 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7db85-4a2e-4dd6-91b4-27863e7ec1aa admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:58.009855 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f0e8-b58b-40ff-959f-34c6963d506e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:58.011802 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-85b1f0e8-b58b-40ff-959f-34c6963d506e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:58.041477 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1417/2797] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:58:57 2022] POST /identity/v3/projects => generated 379 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:58.044544 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f0e8-b58b-40ff-959f-34c6963d506e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:58.045865 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7db85-4a2e-4dd6-91b4-27863e7ec1aa admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:58.138615 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7db85-4a2e-4dd6-91b4-27863e7ec1aa admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:58.139581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381ffb5-7384-412d-b747-0a0e14aa37e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:58.140991 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381ffb5-7384-412d-b747-0a0e14aa37e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:58.141397 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381ffb5-7384-412d-b747-0a0e14aa37e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:58.141913 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381ffb5-7384-412d-b747-0a0e14aa37e9 admin admin] PATH_INFO: `/v3/projects/7bf503d4d93642a196265e5250c73455` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:58.143538 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381ffb5-7384-412d-b747-0a0e14aa37e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf503d4d93642a196265e5250c73455)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:58.144556 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3038d-2181-44f6-9d3c-a6a5a3f4e8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:58.148839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3038d-2181-44f6-9d3c-a6a5a3f4e8af admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:58.148839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3038d-2181-44f6-9d3c-a6a5a3f4e8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:58.148839 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3038d-2181-44f6-9d3c-a6a5a3f4e8af admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:58.149143 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381ffb5-7384-412d-b747-0a0e14aa37e9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:58.149258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3038d-2181-44f6-9d3c-a6a5a3f4e8af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:58.150972 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3038d-2181-44f6-9d3c-a6a5a3f4e8af admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:58.260152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1418/2798] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:58:58 2022] POST /identity/v3/users => generated 290 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:58.264481 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3038d-2181-44f6-9d3c-a6a5a3f4e8af admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:58.275712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3038d-2181-44f6-9d3c-a6a5a3f4e8af admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:58.293347 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3381ffb5-7384-412d-b747-0a0e14aa37e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf503d4d93642a196265e5250c73455', 'request_id': 'req-3381ffb5-7384-412d-b747-0a0e14aa37e9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:58.301281 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3381ffb5-7384-412d-b747-0a0e14aa37e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf503d4d93642a196265e5250c73455', 'request_id': 'req-3381ffb5-7384-412d-b747-0a0e14aa37e9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:58.346744 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa9119-4fb8-46a0-ba39-79169a879f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:58.347426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa9119-4fb8-46a0-ba39-79169a879f5c admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:58.347709 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa9119-4fb8-46a0-ba39-79169a879f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:58.347980 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa9119-4fb8-46a0-ba39-79169a879f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:58.348803 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa9119-4fb8-46a0-ba39-79169a879f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:58.351005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa9119-4fb8-46a0-ba39-79169a879f5c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:58.365494 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1419/2799] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:58:58.370739 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa9119-4fb8-46a0-ba39-79169a879f5c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:58.385046 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3381ffb5-7384-412d-b747-0a0e14aa37e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf503d4d93642a196265e5250c73455', 'request_id': 'req-3381ffb5-7384-412d-b747-0a0e14aa37e9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:58.385492 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa9119-4fb8-46a0-ba39-79169a879f5c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:58.390536 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18e2ad-7b2e-493b-b369-54a602e358f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:58.401855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18e2ad-7b2e-493b-b369-54a602e358f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:58.401855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18e2ad-7b2e-493b-b369-54a602e358f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:58.401855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18e2ad-7b2e-493b-b369-54a602e358f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:58.401855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18e2ad-7b2e-493b-b369-54a602e358f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:58.401855 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18e2ad-7b2e-493b-b369-54a602e358f6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:58.402373 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3381ffb5-7384-412d-b747-0a0e14aa37e9 admin admin] The token cache is being invalidate because project 7bf503d4d93642a196265e5250c73455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:58.402373 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3381ffb5-7384-412d-b747-0a0e14aa37e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:58.402373 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3381ffb5-7384-412d-b747-0a0e14aa37e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:58.402373 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1381/2800] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:58 2022] DELETE /identity/v3/projects/7bf503d4d93642a196265e5250c73455 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:58.405275 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381ffb5-7384-412d-b747-0a0e14aa37e9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:58.410894 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1420/2801] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:58:58.411089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3381ffb5-7384-412d-b747-0a0e14aa37e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:58.412644 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18e2ad-7b2e-493b-b369-54a602e358f6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:58.414459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1d18e2ad-7b2e-493b-b369-54a602e358f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:58.426497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381ffb5-7384-412d-b747-0a0e14aa37e9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:58.429144 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18e2ad-7b2e-493b-b369-54a602e358f6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:58.432296 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1d2d2-2fe5-4946-b49a-597442851505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:58.433291 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1d2d2-2fe5-4946-b49a-597442851505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:58.433646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1d2d2-2fe5-4946-b49a-597442851505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:58.434008 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1d2d2-2fe5-4946-b49a-597442851505 admin admin] PATH_INFO: `/v3/users/f15e3675374149ddbe1fb46eb1fed3a0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:58.434676 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36394e28-60e1-4b77-929c-4abcd4971512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:58.435388 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1d2d2-2fe5-4946-b49a-597442851505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15e3675374149ddbe1fb46eb1fed3a0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:58.435708 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36394e28-60e1-4b77-929c-4abcd4971512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:58.436061 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36394e28-60e1-4b77-929c-4abcd4971512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:58.436454 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36394e28-60e1-4b77-929c-4abcd4971512 admin admin] PATH_INFO: `/v3/projects/1837e0bacc7d4caab433d3437bc560d9/users/4995eabeaf694073965c1e9cea46b07a/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:58.437703 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1d2d2-2fe5-4946-b49a-597442851505 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:58.453725 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36394e28-60e1-4b77-929c-4abcd4971512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1837e0bacc7d4caab433d3437bc560d9, user_id=4995eabeaf694073965c1e9cea46b07a, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:58.456727 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36394e28-60e1-4b77-929c-4abcd4971512 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:58.568831 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1421/2802] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:58 2022] PUT /identity/v3/projects/1837e0bacc7d4caab433d3437bc560d9/users/4995eabeaf694073965c1e9cea46b07a/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:58.580799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0996023-4dcc-4a74-a5f8-8b65d5d0e713 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:58.585177 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0996023-4dcc-4a74-a5f8-8b65d5d0e713 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:58.585177 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0996023-4dcc-4a74-a5f8-8b65d5d0e713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:58.617577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b0996023-4dcc-4a74-a5f8-8b65d5d0e713 None None] MFA Rules not processed for user `4995eabeaf694073965c1e9cea46b07a`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:58.619534 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b0996023-4dcc-4a74-a5f8-8b65d5d0e713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:58.694574 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1422/2803] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:58.698909 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0996023-4dcc-4a74-a5f8-8b65d5d0e713 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:58.699245 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-76e1d2d2-2fe5-4946-b49a-597442851505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15e3675374149ddbe1fb46eb1fed3a0'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:58.727301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-76e1d2d2-2fe5-4946-b49a-597442851505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15e3675374149ddbe1fb46eb1fed3a0'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:58.795188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0996023-4dcc-4a74-a5f8-8b65d5d0e713 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:58.807922 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b074c80-e24f-4d73-995c-8be3b87ff437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:58.810914 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b074c80-e24f-4d73-995c-8be3b87ff437 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:58.810914 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b074c80-e24f-4d73-995c-8be3b87ff437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:58.810914 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b074c80-e24f-4d73-995c-8be3b87ff437 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:58.810914 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b074c80-e24f-4d73-995c-8be3b87ff437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:58.812206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b074c80-e24f-4d73-995c-8be3b87ff437 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:58.845284 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-76e1d2d2-2fe5-4946-b49a-597442851505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15e3675374149ddbe1fb46eb1fed3a0'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:58.852928 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-76e1d2d2-2fe5-4946-b49a-597442851505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15e3675374149ddbe1fb46eb1fed3a0'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:58.853683 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-76e1d2d2-2fe5-4946-b49a-597442851505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15e3675374149ddbe1fb46eb1fed3a0'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:58.870284 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1382/2804] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:58:58 2022] DELETE /identity/v3/users/f15e3675374149ddbe1fb46eb1fed3a0 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:58.919692 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1423/2805] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:58:58 2022] POST /identity/v3/projects => generated 379 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:58.921816 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1d2d2-2fe5-4946-b49a-597442851505 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:58.922823 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-76e1d2d2-2fe5-4946-b49a-597442851505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:59.048851 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1d2d2-2fe5-4946-b49a-597442851505 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:59.111883 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b8253-bf7b-49c1-89e4-5538c7f35563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:59.112604 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b8253-bf7b-49c1-89e4-5538c7f35563 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:59.112891 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b8253-bf7b-49c1-89e4-5538c7f35563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:59.113167 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b8253-bf7b-49c1-89e4-5538c7f35563 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:59.113868 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b8253-bf7b-49c1-89e4-5538c7f35563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:59.116179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b8253-bf7b-49c1-89e4-5538c7f35563 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:59.237020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1383/2806] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:58:58 2022] POST /identity/v3/users => generated 296 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:58:59.241300 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b074c80-e24f-4d73-995c-8be3b87ff437 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:59.252432 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b074c80-e24f-4d73-995c-8be3b87ff437 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:59.258132 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea747ded-382e-4b5d-85ef-a17f2524b1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:59.258994 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea747ded-382e-4b5d-85ef-a17f2524b1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:59.259097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea747ded-382e-4b5d-85ef-a17f2524b1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:59.259371 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea747ded-382e-4b5d-85ef-a17f2524b1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:59.260292 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea747ded-382e-4b5d-85ef-a17f2524b1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:59.261973 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea747ded-382e-4b5d-85ef-a17f2524b1a3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:59.266325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b8253-bf7b-49c1-89e4-5538c7f35563 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:59.268766 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ff0b8253-bf7b-49c1-89e4-5538c7f35563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:59.282397 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b8253-bf7b-49c1-89e4-5538c7f35563 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:59.285330 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1424/2807] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:58:59.288548 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1457708-6290-441a-becf-f0bf7621b78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:59.289641 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1457708-6290-441a-becf-f0bf7621b78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:59.290088 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1457708-6290-441a-becf-f0bf7621b78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:59.290507 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1457708-6290-441a-becf-f0bf7621b78c admin admin] PATH_INFO: `/v3/projects/675947c2f62242d599bb193dc73d6fd1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:59.291934 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1457708-6290-441a-becf-f0bf7621b78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=675947c2f62242d599bb193dc73d6fd1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:59.293228 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea747ded-382e-4b5d-85ef-a17f2524b1a3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:59.297572 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1457708-6290-441a-becf-f0bf7621b78c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:59.320896 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea747ded-382e-4b5d-85ef-a17f2524b1a3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:59.327348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b025fd-8432-4397-96ae-f2bf3f2fbc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:59.328397 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b025fd-8432-4397-96ae-f2bf3f2fbc68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:59.328806 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b025fd-8432-4397-96ae-f2bf3f2fbc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:59.329189 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b025fd-8432-4397-96ae-f2bf3f2fbc68 admin admin] PATH_INFO: `/v3/projects/bbff3de719934b028847076631e30bc8/users/137457c5f24c47b59de8707d86ac09b6/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:59.352771 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b025fd-8432-4397-96ae-f2bf3f2fbc68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbff3de719934b028847076631e30bc8, user_id=137457c5f24c47b59de8707d86ac09b6, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:59.355625 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b025fd-8432-4397-96ae-f2bf3f2fbc68 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:59.471000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1425/2808] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:59 2022] PUT /identity/v3/projects/bbff3de719934b028847076631e30bc8/users/137457c5f24c47b59de8707d86ac09b6/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:59.475429 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b025fd-8432-4397-96ae-f2bf3f2fbc68 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:59.500783 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c1457708-6290-441a-becf-f0bf7621b78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '675947c2f62242d599bb193dc73d6fd1', 'request_id': 'req-c1457708-6290-441a-becf-f0bf7621b78c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:59.507089 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c1457708-6290-441a-becf-f0bf7621b78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '675947c2f62242d599bb193dc73d6fd1', 'request_id': 'req-c1457708-6290-441a-becf-f0bf7621b78c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:59.556927 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b025fd-8432-4397-96ae-f2bf3f2fbc68 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:59.600749 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c1457708-6290-441a-becf-f0bf7621b78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '675947c2f62242d599bb193dc73d6fd1', 'request_id': 'req-c1457708-6290-441a-becf-f0bf7621b78c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:59.628881 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c1457708-6290-441a-becf-f0bf7621b78c admin admin] The token cache is being invalidate because project 675947c2f62242d599bb193dc73d6fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:58:59.629171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c1457708-6290-441a-becf-f0bf7621b78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:59.630910 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c1457708-6290-441a-becf-f0bf7621b78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:58:59.638398 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1384/2809] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:58:59 2022] DELETE /identity/v3/projects/675947c2f62242d599bb193dc73d6fd1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:58:59.656213 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2b730-0c77-4119-ae4c-84a38eba2870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:59.657149 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2b730-0c77-4119-ae4c-84a38eba2870 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:59.657681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2b730-0c77-4119-ae4c-84a38eba2870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:59.658052 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2b730-0c77-4119-ae4c-84a38eba2870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:59.658851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2b730-0c77-4119-ae4c-84a38eba2870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:59.661399 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2b730-0c77-4119-ae4c-84a38eba2870 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:59.678909 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1426/2810] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 17:58:59.683039 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1457708-6290-441a-becf-f0bf7621b78c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:59.684783 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c1457708-6290-441a-becf-f0bf7621b78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:59.702301 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1457708-6290-441a-becf-f0bf7621b78c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:58:59.713737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1279955-7026-4f30-b03d-b674480b93d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:58:59.715320 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1279955-7026-4f30-b03d-b674480b93d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:59.715822 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1279955-7026-4f30-b03d-b674480b93d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:59.716484 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1279955-7026-4f30-b03d-b674480b93d0 admin admin] PATH_INFO: `/v3/projects/bbff3de719934b028847076631e30bc8/users/137457c5f24c47b59de8707d86ac09b6/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:59.727602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1279955-7026-4f30-b03d-b674480b93d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbff3de719934b028847076631e30bc8, user_id=137457c5f24c47b59de8707d86ac09b6, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:58:59.727602 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1279955-7026-4f30-b03d-b674480b93d0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:58:59.750200 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1385/2811] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:58:59 2022] PUT /identity/v3/projects/bbff3de719934b028847076631e30bc8/users/137457c5f24c47b59de8707d86ac09b6/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:58:59.757678 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6f2ac-712f-4809-b6b8-7531fb2465be None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:58:59.758152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6f2ac-712f-4809-b6b8-7531fb2465be None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:58:59.758732 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6f2ac-712f-4809-b6b8-7531fb2465be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:58:59.814122 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-70c6f2ac-712f-4809-b6b8-7531fb2465be None None] MFA Rules not processed for user `137457c5f24c47b59de8707d86ac09b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:58:59.815663 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-70c6f2ac-712f-4809-b6b8-7531fb2465be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:58:59.913300 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1427/2812] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:58:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:58:59.927561 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1279955-7026-4f30-b03d-b674480b93d0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:58:59.929574 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a1279955-7026-4f30-b03d-b674480b93d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:00.020243 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1279955-7026-4f30-b03d-b674480b93d0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:00.025414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935d0ce-eb69-475b-a6b5-8356593055a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:00.026193 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935d0ce-eb69-475b-a6b5-8356593055a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:00.026540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935d0ce-eb69-475b-a6b5-8356593055a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:00.027168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935d0ce-eb69-475b-a6b5-8356593055a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:00.039243 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935d0ce-eb69-475b-a6b5-8356593055a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:00.046360 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935d0ce-eb69-475b-a6b5-8356593055a1 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:00.057231 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1386/2813] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:58:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:59:01.013496 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6f2ac-712f-4809-b6b8-7531fb2465be None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:01.025289 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6f2ac-712f-4809-b6b8-7531fb2465be None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:01.031313 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928574c4-43d0-4d0c-9472-7465bef3bb5c tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137457c5f24c47b59de8707d86ac09b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbff3de719934b028847076631e30bc8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:01.032261 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928574c4-43d0-4d0c-9472-7465bef3bb5c tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:01.032544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928574c4-43d0-4d0c-9472-7465bef3bb5c tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:01.032830 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928574c4-43d0-4d0c-9472-7465bef3bb5c tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:01.033580 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928574c4-43d0-4d0c-9472-7465bef3bb5c tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:59:01.033955 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928574c4-43d0-4d0c-9472-7465bef3bb5c tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:01.035510 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928574c4-43d0-4d0c-9472-7465bef3bb5c tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:01.047759 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1428/2814] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:59:01.054902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935d0ce-eb69-475b-a6b5-8356593055a1 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:01.066844 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935d0ce-eb69-475b-a6b5-8356593055a1 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:01.072597 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16b2be-c5a8-4057-b754-f8c7898b59c1 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137457c5f24c47b59de8707d86ac09b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbff3de719934b028847076631e30bc8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:01.073402 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16b2be-c5a8-4057-b754-f8c7898b59c1 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:01.073784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16b2be-c5a8-4057-b754-f8c7898b59c1 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:01.074284 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16b2be-c5a8-4057-b754-f8c7898b59c1 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:01.074946 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16b2be-c5a8-4057-b754-f8c7898b59c1 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:01.076860 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16b2be-c5a8-4057-b754-f8c7898b59c1 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:01.188959 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1387/2815] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:59:01 2022] POST /identity/v3/projects => generated 354 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:59:01.194503 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928574c4-43d0-4d0c-9472-7465bef3bb5c tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:01.204566 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928574c4-43d0-4d0c-9472-7465bef3bb5c tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:01.314891 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e69de-d6d5-4cc2-b5bd-883274f1d8df tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137457c5f24c47b59de8707d86ac09b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbff3de719934b028847076631e30bc8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:01.315564 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e69de-d6d5-4cc2-b5bd-883274f1d8df tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:01.315843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e69de-d6d5-4cc2-b5bd-883274f1d8df tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:01.316130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e69de-d6d5-4cc2-b5bd-883274f1d8df tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:01.316882 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e69de-d6d5-4cc2-b5bd-883274f1d8df tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:59:01.317186 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e69de-d6d5-4cc2-b5bd-883274f1d8df tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:01.320383 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e69de-d6d5-4cc2-b5bd-883274f1d8df tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:01.350857 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1429/2816] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 17:59:01.399365 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16b2be-c5a8-4057-b754-f8c7898b59c1 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:01.411484 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16b2be-c5a8-4057-b754-f8c7898b59c1 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:01.417092 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c146a4-5276-43f8-8abe-e686345fe323 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137457c5f24c47b59de8707d86ac09b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbff3de719934b028847076631e30bc8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:01.418048 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c146a4-5276-43f8-8abe-e686345fe323 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:01.418390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c146a4-5276-43f8-8abe-e686345fe323 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:01.418739 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c146a4-5276-43f8-8abe-e686345fe323 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] PATH_INFO: `/v3/projects/605fd8eda7774da6bf482b454b2113b1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:01.420173 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c146a4-5276-43f8-8abe-e686345fe323 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] RBAC: Authorizing `identity:delete_project(project_id=605fd8eda7774da6bf482b454b2113b1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:01.425389 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c146a4-5276-43f8-8abe-e686345fe323 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:01.745127 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-53c146a4-5276-43f8-8abe-e686345fe323 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '605fd8eda7774da6bf482b454b2113b1', 'request_id': 'req-53c146a4-5276-43f8-8abe-e686345fe323'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:01.750681 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-53c146a4-5276-43f8-8abe-e686345fe323 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '605fd8eda7774da6bf482b454b2113b1', 'request_id': 'req-53c146a4-5276-43f8-8abe-e686345fe323'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:01.824366 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-53c146a4-5276-43f8-8abe-e686345fe323 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '605fd8eda7774da6bf482b454b2113b1', 'request_id': 'req-53c146a4-5276-43f8-8abe-e686345fe323'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:01.837097 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-53c146a4-5276-43f8-8abe-e686345fe323 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] The token cache is being invalidate because project 605fd8eda7774da6bf482b454b2113b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:59:01.837390 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-53c146a4-5276-43f8-8abe-e686345fe323 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:01.838021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-53c146a4-5276-43f8-8abe-e686345fe323 tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:01.839562 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1388/2817] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:59:01 2022] DELETE /identity/v3/projects/605fd8eda7774da6bf482b454b2113b1 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:59:02.490063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e69de-d6d5-4cc2-b5bd-883274f1d8df tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:02.492120 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c73e69de-d6d5-4cc2-b5bd-883274f1d8df tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:02.561368 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e69de-d6d5-4cc2-b5bd-883274f1d8df tempest-VolumeQuotaClassesTest-361582647 tempest-VolumeQuotaClassesTest-361582647-project-admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:02.620386 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e5b46-5e85-459f-b34d-bab2435c7148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:02.621195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e5b46-5e85-459f-b34d-bab2435c7148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:02.621479 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e5b46-5e85-459f-b34d-bab2435c7148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:02.621798 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e5b46-5e85-459f-b34d-bab2435c7148 admin admin] PATH_INFO: `/v3/users/4995eabeaf694073965c1e9cea46b07a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:02.622994 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e5b46-5e85-459f-b34d-bab2435c7148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4995eabeaf694073965c1e9cea46b07a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:02.624972 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e5b46-5e85-459f-b34d-bab2435c7148 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:02.786616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c23e5b46-5e85-459f-b34d-bab2435c7148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4995eabeaf694073965c1e9cea46b07a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:02.875681 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c23e5b46-5e85-459f-b34d-bab2435c7148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4995eabeaf694073965c1e9cea46b07a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:02.876234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c23e5b46-5e85-459f-b34d-bab2435c7148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4995eabeaf694073965c1e9cea46b07a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:02.883272 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c23e5b46-5e85-459f-b34d-bab2435c7148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4995eabeaf694073965c1e9cea46b07a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:02.894549 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c23e5b46-5e85-459f-b34d-bab2435c7148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4995eabeaf694073965c1e9cea46b07a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:02.901391 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1430/2818] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:59:02 2022] DELETE /identity/v3/users/4995eabeaf694073965c1e9cea46b07a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:59:02.905821 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf10e1-f8c5-4d95-8af8-0f85473a05a0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:02.906332 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf10e1-f8c5-4d95-8af8-0f85473a05a0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:02.906446 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf10e1-f8c5-4d95-8af8-0f85473a05a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:02.923757 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-edaf10e1-f8c5-4d95-8af8-0f85473a05a0 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:59:02.926007 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-edaf10e1-f8c5-4d95-8af8-0f85473a05a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:02.981378 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1389/2819] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:59:02.991458 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e5b46-5e85-459f-b34d-bab2435c7148 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:02.992907 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c23e5b46-5e85-459f-b34d-bab2435c7148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:03.058616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e5b46-5e85-459f-b34d-bab2435c7148 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:03.062249 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b480b5d-5b5a-4c72-ae89-c35ed7b17d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:03.062890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b480b5d-5b5a-4c72-ae89-c35ed7b17d8a service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:03.063166 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b480b5d-5b5a-4c72-ae89-c35ed7b17d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:03.063439 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b480b5d-5b5a-4c72-ae89-c35ed7b17d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:03.072871 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b480b5d-5b5a-4c72-ae89-c35ed7b17d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:03.074466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b480b5d-5b5a-4c72-ae89-c35ed7b17d8a service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:03.084952 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1431/2820] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:59:03.613321 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf10e1-f8c5-4d95-8af8-0f85473a05a0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:03.615128 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-edaf10e1-f8c5-4d95-8af8-0f85473a05a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:03.648230 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf10e1-f8c5-4d95-8af8-0f85473a05a0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:03.655455 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:03.657183 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:03.657681 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:03.657965 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1 admin admin] PATH_INFO: `/v3/projects/1837e0bacc7d4caab433d3437bc560d9` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:03.659293 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1837e0bacc7d4caab433d3437bc560d9)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:03.661936 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:03.762686 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1837e0bacc7d4caab433d3437bc560d9', 'request_id': 'req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:03.769102 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1837e0bacc7d4caab433d3437bc560d9', 'request_id': 'req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:03.858908 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1837e0bacc7d4caab433d3437bc560d9', 'request_id': 'req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:03.870543 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1 admin admin] The token cache is being invalidate because project 1837e0bacc7d4caab433d3437bc560d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:59:03.870834 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:03.871476 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:03.873059 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1390/2821] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:59:03 2022] DELETE /identity/v3/projects/1837e0bacc7d4caab433d3437bc560d9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:59:03.877401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b480b5d-5b5a-4c72-ae89-c35ed7b17d8a service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:03.889964 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b480b5d-5b5a-4c72-ae89-c35ed7b17d8a service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:03.952712 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddb627-2255-4d20-995e-99ef4622dc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:03.953582 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddb627-2255-4d20-995e-99ef4622dc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:03.953856 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddb627-2255-4d20-995e-99ef4622dc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:03.954130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddb627-2255-4d20-995e-99ef4622dc3c admin admin] PATH_INFO: `/v3/users/137457c5f24c47b59de8707d86ac09b6` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:03.955309 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddb627-2255-4d20-995e-99ef4622dc3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=137457c5f24c47b59de8707d86ac09b6)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:03.957326 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddb627-2255-4d20-995e-99ef4622dc3c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:04.185486 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fbddb627-2255-4d20-995e-99ef4622dc3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '137457c5f24c47b59de8707d86ac09b6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:04.252800 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fbddb627-2255-4d20-995e-99ef4622dc3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '137457c5f24c47b59de8707d86ac09b6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:04.253352 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fbddb627-2255-4d20-995e-99ef4622dc3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '137457c5f24c47b59de8707d86ac09b6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:04.261456 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fbddb627-2255-4d20-995e-99ef4622dc3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '137457c5f24c47b59de8707d86ac09b6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:04.273147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fbddb627-2255-4d20-995e-99ef4622dc3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '137457c5f24c47b59de8707d86ac09b6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:04.278904 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1432/2822] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:59:03 2022] DELETE /identity/v3/users/137457c5f24c47b59de8707d86ac09b6 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:59:05.146923 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:05.148564 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:05.170599 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfabe0-1a1d-4160-aa83-ccd147ab56e1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:05.239443 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f58bb-2610-4217-9931-caf7afae7e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:05.239443 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f58bb-2610-4217-9931-caf7afae7e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:05.239443 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f58bb-2610-4217-9931-caf7afae7e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:05.239443 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f58bb-2610-4217-9931-caf7afae7e20 admin admin] PATH_INFO: `/v3/projects/bbff3de719934b028847076631e30bc8` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:05.240179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f58bb-2610-4217-9931-caf7afae7e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbff3de719934b028847076631e30bc8)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:05.242106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f58bb-2610-4217-9931-caf7afae7e20 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:05.328465 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-417f58bb-2610-4217-9931-caf7afae7e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbff3de719934b028847076631e30bc8', 'request_id': 'req-417f58bb-2610-4217-9931-caf7afae7e20'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:05.335680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-417f58bb-2610-4217-9931-caf7afae7e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbff3de719934b028847076631e30bc8', 'request_id': 'req-417f58bb-2610-4217-9931-caf7afae7e20'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:05.401584 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-417f58bb-2610-4217-9931-caf7afae7e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbff3de719934b028847076631e30bc8', 'request_id': 'req-417f58bb-2610-4217-9931-caf7afae7e20'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:05.413533 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-417f58bb-2610-4217-9931-caf7afae7e20 admin admin] The token cache is being invalidate because project bbff3de719934b028847076631e30bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:59:05.413814 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-417f58bb-2610-4217-9931-caf7afae7e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:05.414444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-417f58bb-2610-4217-9931-caf7afae7e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:05.416267 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1391/2823] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:59:05 2022] DELETE /identity/v3/projects/bbff3de719934b028847076631e30bc8 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:59:05.421136 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6cdb6-81c4-413a-a042-b97f1f4a20e8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:05.421663 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6cdb6-81c4-413a-a042-b97f1f4a20e8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:05.421663 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6cdb6-81c4-413a-a042-b97f1f4a20e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:05.440268 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-14a6cdb6-81c4-413a-a042-b97f1f4a20e8 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:59:05.441577 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-14a6cdb6-81c4-413a-a042-b97f1f4a20e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:05.500130 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1433/2824] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:59:05.508380 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda70b3d-addf-4e21-9812-06de82b7d0a9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:05.508699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda70b3d-addf-4e21-9812-06de82b7d0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:05.508975 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda70b3d-addf-4e21-9812-06de82b7d0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:05.527625 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-dda70b3d-addf-4e21-9812-06de82b7d0a9 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:59:05.528850 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dda70b3d-addf-4e21-9812-06de82b7d0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:05.538516 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1392/2825] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:59:05.543096 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6cdb6-81c4-413a-a042-b97f1f4a20e8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:05.553043 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6cdb6-81c4-413a-a042-b97f1f4a20e8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:05.557993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d62180-95f8-456e-a114-53e90c3561ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:05.558650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d62180-95f8-456e-a114-53e90c3561ee admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:05.558925 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d62180-95f8-456e-a114-53e90c3561ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:05.559194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d62180-95f8-456e-a114-53e90c3561ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:05.559957 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d62180-95f8-456e-a114-53e90c3561ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:59:05.560350 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d62180-95f8-456e-a114-53e90c3561ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:05.562094 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d62180-95f8-456e-a114-53e90c3561ee admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:05.575274 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1434/2826] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:59:05.579614 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda70b3d-addf-4e21-9812-06de82b7d0a9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:05.590300 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda70b3d-addf-4e21-9812-06de82b7d0a9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:05.594972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac93038-2545-4170-97f1-f73e9522052b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:05.595615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac93038-2545-4170-97f1-f73e9522052b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:05.595895 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac93038-2545-4170-97f1-f73e9522052b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:05.596166 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac93038-2545-4170-97f1-f73e9522052b admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:05.596971 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac93038-2545-4170-97f1-f73e9522052b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:05.598927 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac93038-2545-4170-97f1-f73e9522052b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:05.671649 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1393/2827] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:59:05 2022] POST /identity/v3/projects => generated 391 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:59:05.677206 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d62180-95f8-456e-a114-53e90c3561ee admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:05.688379 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d62180-95f8-456e-a114-53e90c3561ee admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:05.749106 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745efbc0-b641-40d9-bbf3-ac73126c2164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:05.749844 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745efbc0-b641-40d9-bbf3-ac73126c2164 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:05.750195 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745efbc0-b641-40d9-bbf3-ac73126c2164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:05.750539 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745efbc0-b641-40d9-bbf3-ac73126c2164 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:05.751303 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745efbc0-b641-40d9-bbf3-ac73126c2164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:05.753324 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745efbc0-b641-40d9-bbf3-ac73126c2164 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:05.859650 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1435/2828] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:59:05 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:59:05.864657 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac93038-2545-4170-97f1-f73e9522052b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:05.877154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac93038-2545-4170-97f1-f73e9522052b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:05.883623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa44d42-3d8b-4029-b77d-f19e0e5596a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:05.884322 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa44d42-3d8b-4029-b77d-f19e0e5596a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:05.884630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa44d42-3d8b-4029-b77d-f19e0e5596a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:05.884903 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa44d42-3d8b-4029-b77d-f19e0e5596a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:05.885699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa44d42-3d8b-4029-b77d-f19e0e5596a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:05.887264 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa44d42-3d8b-4029-b77d-f19e0e5596a5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:05.898660 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1394/2829] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:59:05.902791 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745efbc0-b641-40d9-bbf3-ac73126c2164 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:05.913523 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745efbc0-b641-40d9-bbf3-ac73126c2164 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:05.918462 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be110d0-f2cf-4515-8ed0-9c8c263ffd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:05.919248 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be110d0-f2cf-4515-8ed0-9c8c263ffd52 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:05.919696 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be110d0-f2cf-4515-8ed0-9c8c263ffd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:05.920070 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be110d0-f2cf-4515-8ed0-9c8c263ffd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:05.920953 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be110d0-f2cf-4515-8ed0-9c8c263ffd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:05.922646 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be110d0-f2cf-4515-8ed0-9c8c263ffd52 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:05.933134 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1436/2830] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:59:05.937369 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa44d42-3d8b-4029-b77d-f19e0e5596a5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:05.947246 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa44d42-3d8b-4029-b77d-f19e0e5596a5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:05.951791 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ae790-5909-40a8-a012-a88947d16232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:05.952687 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ae790-5909-40a8-a012-a88947d16232 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:05.952963 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ae790-5909-40a8-a012-a88947d16232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:05.953235 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ae790-5909-40a8-a012-a88947d16232 admin admin] PATH_INFO: `/v3/projects/226b47a3f10046f6835495ce2263c487/users/7cab09a6cd9d4315a828edb81df9e8c1/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:05.967972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ae790-5909-40a8-a012-a88947d16232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=226b47a3f10046f6835495ce2263c487, user_id=7cab09a6cd9d4315a828edb81df9e8c1, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:05.970596 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ae790-5909-40a8-a012-a88947d16232 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:06.029943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1395/2831] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:59:05 2022] PUT /identity/v3/projects/226b47a3f10046f6835495ce2263c487/users/7cab09a6cd9d4315a828edb81df9e8c1/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:59:06.041097 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa71e6-1132-4aef-b9cf-5ee14bd8a721 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:06.041979 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa71e6-1132-4aef-b9cf-5ee14bd8a721 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:06.041979 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa71e6-1132-4aef-b9cf-5ee14bd8a721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:06.067999 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-88aa71e6-1132-4aef-b9cf-5ee14bd8a721 None None] MFA Rules not processed for user `7cab09a6cd9d4315a828edb81df9e8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:59:06.069241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-88aa71e6-1132-4aef-b9cf-5ee14bd8a721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:06.138634 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1437/2832] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:59:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:59:06.139764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ae790-5909-40a8-a012-a88947d16232 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:06.206136 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ae790-5909-40a8-a012-a88947d16232 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:06.212536 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f7539-c37c-412d-9fbc-23bab35b5228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:06.213226 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f7539-c37c-412d-9fbc-23bab35b5228 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:06.214179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f7539-c37c-412d-9fbc-23bab35b5228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:06.214179 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f7539-c37c-412d-9fbc-23bab35b5228 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:06.214580 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f7539-c37c-412d-9fbc-23bab35b5228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:06.216727 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f7539-c37c-412d-9fbc-23bab35b5228 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:06.339251 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1396/2833] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:59:06 2022] POST /identity/v3/projects => generated 393 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:59:06.343194 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa71e6-1132-4aef-b9cf-5ee14bd8a721 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:06.355347 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa71e6-1132-4aef-b9cf-5ee14bd8a721 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:06.415126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca1d5e-4709-4e6f-b4a6-3250be93ba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:06.415799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca1d5e-4709-4e6f-b4a6-3250be93ba91 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:06.416080 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca1d5e-4709-4e6f-b4a6-3250be93ba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:06.416359 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca1d5e-4709-4e6f-b4a6-3250be93ba91 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:06.417091 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca1d5e-4709-4e6f-b4a6-3250be93ba91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:06.419039 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca1d5e-4709-4e6f-b4a6-3250be93ba91 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:06.538293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1438/2834] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:59:06 2022] POST /identity/v3/users => generated 303 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:59:06.542333 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f7539-c37c-412d-9fbc-23bab35b5228 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:06.552922 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f7539-c37c-412d-9fbc-23bab35b5228 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:06.557810 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe503783-de8a-4702-8779-c5afd1a1d9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:06.558618 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe503783-de8a-4702-8779-c5afd1a1d9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:06.558902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe503783-de8a-4702-8779-c5afd1a1d9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:06.559181 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe503783-de8a-4702-8779-c5afd1a1d9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:06.559918 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe503783-de8a-4702-8779-c5afd1a1d9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:06.561548 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe503783-de8a-4702-8779-c5afd1a1d9b2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:06.573255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1397/2835] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:59:06.593270 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca1d5e-4709-4e6f-b4a6-3250be93ba91 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:06.601360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca1d5e-4709-4e6f-b4a6-3250be93ba91 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:06.606722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecfc4b-fbc9-4bb2-b2ce-85c8c1d03059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:06.607628 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecfc4b-fbc9-4bb2-b2ce-85c8c1d03059 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:06.608534 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecfc4b-fbc9-4bb2-b2ce-85c8c1d03059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:06.608534 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecfc4b-fbc9-4bb2-b2ce-85c8c1d03059 admin admin] PATH_INFO: `/v3/projects/8158487856a34062bb1dae58f555ec0d/users/0c3992c00b9241f0941d81ce8600b16a/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:06.624284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecfc4b-fbc9-4bb2-b2ce-85c8c1d03059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8158487856a34062bb1dae58f555ec0d, user_id=0c3992c00b9241f0941d81ce8600b16a, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:06.626968 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecfc4b-fbc9-4bb2-b2ce-85c8c1d03059 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:07.435861 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1439/2836] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:59:06 2022] PUT /identity/v3/projects/8158487856a34062bb1dae58f555ec0d/users/0c3992c00b9241f0941d81ce8600b16a/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:59:07.439873 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe503783-de8a-4702-8779-c5afd1a1d9b2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:07.450468 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe503783-de8a-4702-8779-c5afd1a1d9b2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:07.510006 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092f0b9-0335-4aba-b050-d0881adbf4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:07.512917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092f0b9-0335-4aba-b050-d0881adbf4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:07.512917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092f0b9-0335-4aba-b050-d0881adbf4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:07.512917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092f0b9-0335-4aba-b050-d0881adbf4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:07.512917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092f0b9-0335-4aba-b050-d0881adbf4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:07.514214 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092f0b9-0335-4aba-b050-d0881adbf4b7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:07.527131 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1398/2837] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:59:07.531066 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecfc4b-fbc9-4bb2-b2ce-85c8c1d03059 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:07.544415 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecfc4b-fbc9-4bb2-b2ce-85c8c1d03059 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:07.552240 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec509e-a638-49d1-bae4-37f172a198bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:07.553180 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec509e-a638-49d1-bae4-37f172a198bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:07.553461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec509e-a638-49d1-bae4-37f172a198bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:07.553764 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec509e-a638-49d1-bae4-37f172a198bd admin admin] PATH_INFO: `/v3/projects/8158487856a34062bb1dae58f555ec0d/users/0c3992c00b9241f0941d81ce8600b16a/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:07.555799 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec509e-a638-49d1-bae4-37f172a198bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8158487856a34062bb1dae58f555ec0d, user_id=0c3992c00b9241f0941d81ce8600b16a, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:07.558512 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec509e-a638-49d1-bae4-37f172a198bd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:07.569293 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1440/2838] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:59:07 2022] PUT /identity/v3/projects/8158487856a34062bb1dae58f555ec0d/users/0c3992c00b9241f0941d81ce8600b16a/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:59:07.634203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89734d-1f9d-4d1f-8282-92fad1ad13e7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:07.634917 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89734d-1f9d-4d1f-8282-92fad1ad13e7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:07.635201 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89734d-1f9d-4d1f-8282-92fad1ad13e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:07.667182 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1c89734d-1f9d-4d1f-8282-92fad1ad13e7 None None] MFA Rules not processed for user `0c3992c00b9241f0941d81ce8600b16a`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:59:07.669283 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1c89734d-1f9d-4d1f-8282-92fad1ad13e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:07.757323 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1399/2839] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:59:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:59:07.766398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec509e-a638-49d1-bae4-37f172a198bd admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:07.770755 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0fec509e-a638-49d1-bae4-37f172a198bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:07.835493 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec509e-a638-49d1-bae4-37f172a198bd admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:07.842339 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557ebf5-c669-4367-b607-921fc17a02f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:07.842339 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557ebf5-c669-4367-b607-921fc17a02f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:07.842339 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557ebf5-c669-4367-b607-921fc17a02f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:07.842339 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557ebf5-c669-4367-b607-921fc17a02f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:07.852367 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557ebf5-c669-4367-b607-921fc17a02f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:07.853843 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557ebf5-c669-4367-b607-921fc17a02f0 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:07.864241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1441/2840] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:59:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:59:07.913429 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89734d-1f9d-4d1f-8282-92fad1ad13e7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:07.914830 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1c89734d-1f9d-4d1f-8282-92fad1ad13e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:07.927154 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89734d-1f9d-4d1f-8282-92fad1ad13e7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:07.931018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8e2de-4ef8-4ab3-9b69-67548b46c2ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:07.931700 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8e2de-4ef8-4ab3-9b69-67548b46c2ab service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:07.931981 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8e2de-4ef8-4ab3-9b69-67548b46c2ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:07.932255 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8e2de-4ef8-4ab3-9b69-67548b46c2ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:07.989211 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8e2de-4ef8-4ab3-9b69-67548b46c2ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:07.990796 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8e2de-4ef8-4ab3-9b69-67548b46c2ab service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:08.000956 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1400/2841] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:59:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:59:12.707138 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557ebf5-c669-4367-b607-921fc17a02f0 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:12.778106 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557ebf5-c669-4367-b607-921fc17a02f0 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:12.782781 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f6553-da65-410a-8fb4-9204718988c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:12.783653 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f6553-da65-410a-8fb4-9204718988c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:12.784680 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f6553-da65-410a-8fb4-9204718988c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:12.784973 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f6553-da65-410a-8fb4-9204718988c3 admin admin] PATH_INFO: `/v3/users/7cab09a6cd9d4315a828edb81df9e8c1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:12.786702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f6553-da65-410a-8fb4-9204718988c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cab09a6cd9d4315a828edb81df9e8c1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:12.788766 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f6553-da65-410a-8fb4-9204718988c3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:13.043876 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-418f6553-da65-410a-8fb4-9204718988c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cab09a6cd9d4315a828edb81df9e8c1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:13.166215 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-418f6553-da65-410a-8fb4-9204718988c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cab09a6cd9d4315a828edb81df9e8c1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:13.166866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-418f6553-da65-410a-8fb4-9204718988c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cab09a6cd9d4315a828edb81df9e8c1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:13.174451 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-418f6553-da65-410a-8fb4-9204718988c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cab09a6cd9d4315a828edb81df9e8c1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:13.186730 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-418f6553-da65-410a-8fb4-9204718988c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cab09a6cd9d4315a828edb81df9e8c1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:13.193549 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1442/2842] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:59:12 2022] DELETE /identity/v3/users/7cab09a6cd9d4315a828edb81df9e8c1 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:59:13.198018 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f562006-a8f1-4918-b101-db1b038d5f3e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:13.198505 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f562006-a8f1-4918-b101-db1b038d5f3e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:13.198623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f562006-a8f1-4918-b101-db1b038d5f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:13.216188 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3f562006-a8f1-4918-b101-db1b038d5f3e None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:59:13.217497 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3f562006-a8f1-4918-b101-db1b038d5f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:13.275148 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1401/2843] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:59:13.285118 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f6553-da65-410a-8fb4-9204718988c3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:13.286511 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-418f6553-da65-410a-8fb4-9204718988c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:13.343842 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f6553-da65-410a-8fb4-9204718988c3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:13.347405 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225580d-c0ad-4ba1-a84e-4c84b737019a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:13.348045 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225580d-c0ad-4ba1-a84e-4c84b737019a service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:13.348338 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225580d-c0ad-4ba1-a84e-4c84b737019a service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:13.348630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225580d-c0ad-4ba1-a84e-4c84b737019a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:13.357873 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225580d-c0ad-4ba1-a84e-4c84b737019a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:13.359344 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225580d-c0ad-4ba1-a84e-4c84b737019a service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:13.369421 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1443/2844] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:59:13.814196 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f562006-a8f1-4918-b101-db1b038d5f3e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:13.815586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3f562006-a8f1-4918-b101-db1b038d5f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:13.828054 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f562006-a8f1-4918-b101-db1b038d5f3e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:13.834129 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483ba96-f0eb-435f-a654-ab6d2c535bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:13.836171 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483ba96-f0eb-435f-a654-ab6d2c535bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:13.836645 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483ba96-f0eb-435f-a654-ab6d2c535bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:13.837017 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483ba96-f0eb-435f-a654-ab6d2c535bb6 admin admin] PATH_INFO: `/v3/projects/226b47a3f10046f6835495ce2263c487` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:13.838599 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483ba96-f0eb-435f-a654-ab6d2c535bb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=226b47a3f10046f6835495ce2263c487)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:13.840824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483ba96-f0eb-435f-a654-ab6d2c535bb6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:14.026982 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0483ba96-f0eb-435f-a654-ab6d2c535bb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226b47a3f10046f6835495ce2263c487', 'request_id': 'req-0483ba96-f0eb-435f-a654-ab6d2c535bb6'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:14.032787 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0483ba96-f0eb-435f-a654-ab6d2c535bb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226b47a3f10046f6835495ce2263c487', 'request_id': 'req-0483ba96-f0eb-435f-a654-ab6d2c535bb6'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:14.143809 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0483ba96-f0eb-435f-a654-ab6d2c535bb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226b47a3f10046f6835495ce2263c487', 'request_id': 'req-0483ba96-f0eb-435f-a654-ab6d2c535bb6'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:14.162716 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0483ba96-f0eb-435f-a654-ab6d2c535bb6 admin admin] The token cache is being invalidate because project 226b47a3f10046f6835495ce2263c487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:59:14.163021 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0483ba96-f0eb-435f-a654-ab6d2c535bb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:14.163799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0483ba96-f0eb-435f-a654-ab6d2c535bb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:14.165499 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1402/2845] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:59:13 2022] DELETE /identity/v3/projects/226b47a3f10046f6835495ce2263c487 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:59:14.169554 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225580d-c0ad-4ba1-a84e-4c84b737019a service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:14.181005 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225580d-c0ad-4ba1-a84e-4c84b737019a service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:14.235851 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae08db-62e3-4b43-8f29-8d9edf7517b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:14.236754 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae08db-62e3-4b43-8f29-8d9edf7517b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:14.237032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae08db-62e3-4b43-8f29-8d9edf7517b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:14.237304 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae08db-62e3-4b43-8f29-8d9edf7517b9 admin admin] PATH_INFO: `/v3/users/0c3992c00b9241f0941d81ce8600b16a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:14.238470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae08db-62e3-4b43-8f29-8d9edf7517b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3992c00b9241f0941d81ce8600b16a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:14.240948 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae08db-62e3-4b43-8f29-8d9edf7517b9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:14.431279 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-dcae08db-62e3-4b43-8f29-8d9edf7517b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3992c00b9241f0941d81ce8600b16a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:14.554704 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-dcae08db-62e3-4b43-8f29-8d9edf7517b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3992c00b9241f0941d81ce8600b16a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:14.555310 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-dcae08db-62e3-4b43-8f29-8d9edf7517b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3992c00b9241f0941d81ce8600b16a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:14.562592 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-dcae08db-62e3-4b43-8f29-8d9edf7517b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3992c00b9241f0941d81ce8600b16a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:14.574552 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-dcae08db-62e3-4b43-8f29-8d9edf7517b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3992c00b9241f0941d81ce8600b16a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:14.580460 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1444/2846] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:59:14 2022] DELETE /identity/v3/users/0c3992c00b9241f0941d81ce8600b16a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:59:15.062134 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483ba96-f0eb-435f-a654-ab6d2c535bb6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:15.062134 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0483ba96-f0eb-435f-a654-ab6d2c535bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:15.074888 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483ba96-f0eb-435f-a654-ab6d2c535bb6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:15.141685 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b30fbe-349f-452d-b39e-186a4bc527fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:15.142610 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b30fbe-349f-452d-b39e-186a4bc527fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:15.142937 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b30fbe-349f-452d-b39e-186a4bc527fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:15.143192 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b30fbe-349f-452d-b39e-186a4bc527fc admin admin] PATH_INFO: `/v3/projects/8158487856a34062bb1dae58f555ec0d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:15.144369 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b30fbe-349f-452d-b39e-186a4bc527fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8158487856a34062bb1dae58f555ec0d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:15.147450 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b30fbe-349f-452d-b39e-186a4bc527fc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:15.280427 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a8b30fbe-349f-452d-b39e-186a4bc527fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8158487856a34062bb1dae58f555ec0d', 'request_id': 'req-a8b30fbe-349f-452d-b39e-186a4bc527fc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:15.285680 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a8b30fbe-349f-452d-b39e-186a4bc527fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8158487856a34062bb1dae58f555ec0d', 'request_id': 'req-a8b30fbe-349f-452d-b39e-186a4bc527fc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:15.349426 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a8b30fbe-349f-452d-b39e-186a4bc527fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8158487856a34062bb1dae58f555ec0d', 'request_id': 'req-a8b30fbe-349f-452d-b39e-186a4bc527fc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:15.360743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a8b30fbe-349f-452d-b39e-186a4bc527fc admin admin] The token cache is being invalidate because project 8158487856a34062bb1dae58f555ec0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:59:15.360969 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a8b30fbe-349f-452d-b39e-186a4bc527fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:15.361589 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a8b30fbe-349f-452d-b39e-186a4bc527fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:15.363113 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1403/2847] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:59:15 2022] DELETE /identity/v3/projects/8158487856a34062bb1dae58f555ec0d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:59:15.368663 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76a849-f49f-419f-a5f2-dd8eb5b44d44 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:15.369170 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76a849-f49f-419f-a5f2-dd8eb5b44d44 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:15.369276 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76a849-f49f-419f-a5f2-dd8eb5b44d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:15.386828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3a76a849-f49f-419f-a5f2-dd8eb5b44d44 None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:59:15.388036 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3a76a849-f49f-419f-a5f2-dd8eb5b44d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:15.451126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1445/2848] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:59:15.459434 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77250dda-6460-412c-9a79-5332de7d3cca None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:15.459720 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77250dda-6460-412c-9a79-5332de7d3cca None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:15.460002 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77250dda-6460-412c-9a79-5332de7d3cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:15.478341 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-77250dda-6460-412c-9a79-5332de7d3cca None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:59:15.479528 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-77250dda-6460-412c-9a79-5332de7d3cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:15.487383 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1404/2849] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:59:15.491887 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76a849-f49f-419f-a5f2-dd8eb5b44d44 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:15.501575 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76a849-f49f-419f-a5f2-dd8eb5b44d44 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:15.506411 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e017aca-77a3-489e-acb2-bbfe9b6e2f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:15.507092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e017aca-77a3-489e-acb2-bbfe9b6e2f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:15.507373 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e017aca-77a3-489e-acb2-bbfe9b6e2f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:15.507646 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e017aca-77a3-489e-acb2-bbfe9b6e2f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:15.508416 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e017aca-77a3-489e-acb2-bbfe9b6e2f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 17:59:15.508749 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e017aca-77a3-489e-acb2-bbfe9b6e2f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:15.510380 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e017aca-77a3-489e-acb2-bbfe9b6e2f68 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:15.524179 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1446/2850] 10.222.0.81 () {58 vars in 1152 bytes} [Wed May 4 17:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 17:59:15.528606 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77250dda-6460-412c-9a79-5332de7d3cca None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:15.538274 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77250dda-6460-412c-9a79-5332de7d3cca None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:15.543096 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a976019-37e8-4e44-9f99-ee28d2617e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:15.543775 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a976019-37e8-4e44-9f99-ee28d2617e64 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:15.544061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a976019-37e8-4e44-9f99-ee28d2617e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:15.544340 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a976019-37e8-4e44-9f99-ee28d2617e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:15.545080 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a976019-37e8-4e44-9f99-ee28d2617e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:15.546967 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a976019-37e8-4e44-9f99-ee28d2617e64 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:15.639920 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1405/2851] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:59:15 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:59:15.641030 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e017aca-77a3-489e-acb2-bbfe9b6e2f68 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:15.651764 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e017aca-77a3-489e-acb2-bbfe9b6e2f68 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:15.709320 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0493c2d-3fc8-4b1d-bf8f-a5fb42e72fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:15.709974 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0493c2d-3fc8-4b1d-bf8f-a5fb42e72fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:15.710250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0493c2d-3fc8-4b1d-bf8f-a5fb42e72fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:15.710520 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0493c2d-3fc8-4b1d-bf8f-a5fb42e72fb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:15.711197 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0493c2d-3fc8-4b1d-bf8f-a5fb42e72fb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:15.713129 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0493c2d-3fc8-4b1d-bf8f-a5fb42e72fb8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:15.810641 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1447/2852] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:59:15 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 17:59:15.811683 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a976019-37e8-4e44-9f99-ee28d2617e64 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:15.822988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a976019-37e8-4e44-9f99-ee28d2617e64 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:15.831972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4d548-5a06-4e7e-b73f-8793d70d80a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:15.831972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4d548-5a06-4e7e-b73f-8793d70d80a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:15.831972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4d548-5a06-4e7e-b73f-8793d70d80a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:15.831972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4d548-5a06-4e7e-b73f-8793d70d80a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:15.833066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4d548-5a06-4e7e-b73f-8793d70d80a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:15.833066 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4d548-5a06-4e7e-b73f-8793d70d80a8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:15.843141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1406/2853] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:59:15.847334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0493c2d-3fc8-4b1d-bf8f-a5fb42e72fb8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:15.857627 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0493c2d-3fc8-4b1d-bf8f-a5fb42e72fb8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:15.862322 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899f037-5f65-4a49-9dd7-c1c5a4568835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:15.863024 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899f037-5f65-4a49-9dd7-c1c5a4568835 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:15.863278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899f037-5f65-4a49-9dd7-c1c5a4568835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:15.863564 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899f037-5f65-4a49-9dd7-c1c5a4568835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:15.864290 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899f037-5f65-4a49-9dd7-c1c5a4568835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:15.865977 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899f037-5f65-4a49-9dd7-c1c5a4568835 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:15.876780 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1448/2854] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:59:15.881295 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4d548-5a06-4e7e-b73f-8793d70d80a8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:15.891148 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4d548-5a06-4e7e-b73f-8793d70d80a8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:15.896998 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a693ad-1472-4697-b792-79d02559049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:15.897887 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a693ad-1472-4697-b792-79d02559049f admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:15.898172 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a693ad-1472-4697-b792-79d02559049f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:15.898454 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a693ad-1472-4697-b792-79d02559049f admin admin] PATH_INFO: `/v3/projects/ff5394b865f04033a2d9e7a824e7ae91/users/74f95ea179cf44d2af32533f06f073e4/roles/42b0adbc87e347e18bd4412dc9e421c1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:15.913148 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a693ad-1472-4697-b792-79d02559049f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5394b865f04033a2d9e7a824e7ae91, user_id=74f95ea179cf44d2af32533f06f073e4, role_id=42b0adbc87e347e18bd4412dc9e421c1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:15.915753 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a693ad-1472-4697-b792-79d02559049f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:16.001057 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1407/2855] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:59:15 2022] PUT /identity/v3/projects/ff5394b865f04033a2d9e7a824e7ae91/users/74f95ea179cf44d2af32533f06f073e4/roles/42b0adbc87e347e18bd4412dc9e421c1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:59:16.013102 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a922f5-6576-4d44-8af5-0b7f4f0057d0 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:16.013517 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a922f5-6576-4d44-8af5-0b7f4f0057d0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:16.013831 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a922f5-6576-4d44-8af5-0b7f4f0057d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:16.042502 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-66a922f5-6576-4d44-8af5-0b7f4f0057d0 None None] MFA Rules not processed for user `74f95ea179cf44d2af32533f06f073e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:59:16.043731 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-66a922f5-6576-4d44-8af5-0b7f4f0057d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:16.110828 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1449/2856] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:59:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:59:16.115847 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a693ad-1472-4697-b792-79d02559049f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:16.183737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a693ad-1472-4697-b792-79d02559049f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:16.189605 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14173afc-078b-4d57-9113-c2173ed19e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:16.190254 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14173afc-078b-4d57-9113-c2173ed19e80 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:16.190535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14173afc-078b-4d57-9113-c2173ed19e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:16.190807 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14173afc-078b-4d57-9113-c2173ed19e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:16.191540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14173afc-078b-4d57-9113-c2173ed19e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:16.194485 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14173afc-078b-4d57-9113-c2173ed19e80 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:16.317701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1408/2857] 10.222.0.81 () {60 vars in 1152 bytes} [Wed May 4 17:59:16 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:59:16.318994 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a922f5-6576-4d44-8af5-0b7f4f0057d0 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:16.330064 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a922f5-6576-4d44-8af5-0b7f4f0057d0 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:16.389342 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e6dcb-8afa-49eb-8979-c0f477ca364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:16.390720 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e6dcb-8afa-49eb-8979-c0f477ca364d admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:16.391000 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e6dcb-8afa-49eb-8979-c0f477ca364d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:16.391272 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e6dcb-8afa-49eb-8979-c0f477ca364d admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:16.391967 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e6dcb-8afa-49eb-8979-c0f477ca364d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:16.393923 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e6dcb-8afa-49eb-8979-c0f477ca364d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:16.483852 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1450/2858] 10.222.0.81 () {60 vars in 1143 bytes} [Wed May 4 17:59:16 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 17:59:16.485176 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14173afc-078b-4d57-9113-c2173ed19e80 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:16.496772 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14173afc-078b-4d57-9113-c2173ed19e80 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:16.501569 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13d427-515c-49d2-8f72-179438eea660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:16.502278 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13d427-515c-49d2-8f72-179438eea660 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:16.502571 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13d427-515c-49d2-8f72-179438eea660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:16.502846 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13d427-515c-49d2-8f72-179438eea660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:16.503615 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13d427-515c-49d2-8f72-179438eea660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:16.505792 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13d427-515c-49d2-8f72-179438eea660 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:16.516586 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1409/2859] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:59:16.521690 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e6dcb-8afa-49eb-8979-c0f477ca364d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:16.531626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e6dcb-8afa-49eb-8979-c0f477ca364d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:16.536400 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185aff96-57a7-449b-93ce-d071830585cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:16.537354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185aff96-57a7-449b-93ce-d071830585cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:16.537637 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185aff96-57a7-449b-93ce-d071830585cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:16.537915 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185aff96-57a7-449b-93ce-d071830585cd admin admin] PATH_INFO: `/v3/projects/b6e8d1486f2d4bf4af7ceff4d0f87f06/users/06b1c7d7b15c409c96eb56b69e4a3cdd/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:16.553376 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185aff96-57a7-449b-93ce-d071830585cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e8d1486f2d4bf4af7ceff4d0f87f06, user_id=06b1c7d7b15c409c96eb56b69e4a3cdd, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:16.556067 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185aff96-57a7-449b-93ce-d071830585cd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:16.635328 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1451/2860] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:59:16 2022] PUT /identity/v3/projects/b6e8d1486f2d4bf4af7ceff4d0f87f06/users/06b1c7d7b15c409c96eb56b69e4a3cdd/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:59:16.639311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13d427-515c-49d2-8f72-179438eea660 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:16.649972 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13d427-515c-49d2-8f72-179438eea660 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:16.711743 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da47ce8-00bb-49fd-a02a-53f0a8ea4fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:16.712420 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da47ce8-00bb-49fd-a02a-53f0a8ea4fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:16.712737 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da47ce8-00bb-49fd-a02a-53f0a8ea4fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:16.713020 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da47ce8-00bb-49fd-a02a-53f0a8ea4fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:16.713756 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da47ce8-00bb-49fd-a02a-53f0a8ea4fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:16.715869 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da47ce8-00bb-49fd-a02a-53f0a8ea4fa9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:16.726229 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1410/2861] 10.222.0.81 () {58 vars in 1121 bytes} [Wed May 4 17:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 17:59:16.730370 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185aff96-57a7-449b-93ce-d071830585cd admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:16.740598 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185aff96-57a7-449b-93ce-d071830585cd admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:16.745153 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188f450-90e0-41d3-b899-0ae6cf410163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:16.746020 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188f450-90e0-41d3-b899-0ae6cf410163 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:16.746298 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188f450-90e0-41d3-b899-0ae6cf410163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:16.746571 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188f450-90e0-41d3-b899-0ae6cf410163 admin admin] PATH_INFO: `/v3/projects/b6e8d1486f2d4bf4af7ceff4d0f87f06/users/06b1c7d7b15c409c96eb56b69e4a3cdd/roles/a2372b524c284d7882c3ca93ffbed9b0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:16.748616 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188f450-90e0-41d3-b899-0ae6cf410163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e8d1486f2d4bf4af7ceff4d0f87f06, user_id=06b1c7d7b15c409c96eb56b69e4a3cdd, role_id=a2372b524c284d7882c3ca93ffbed9b0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:16.751234 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188f450-90e0-41d3-b899-0ae6cf410163 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:16.761911 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1452/2862] 10.222.0.81 () {60 vars in 1482 bytes} [Wed May 4 17:59:16 2022] PUT /identity/v3/projects/b6e8d1486f2d4bf4af7ceff4d0f87f06/users/06b1c7d7b15c409c96eb56b69e4a3cdd/roles/a2372b524c284d7882c3ca93ffbed9b0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:59:16.773048 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea146d89-7372-4bad-b3b4-5d5a718f45bc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:16.773346 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea146d89-7372-4bad-b3b4-5d5a718f45bc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:16.773628 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea146d89-7372-4bad-b3b4-5d5a718f45bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:16.799859 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ea146d89-7372-4bad-b3b4-5d5a718f45bc None None] MFA Rules not processed for user `06b1c7d7b15c409c96eb56b69e4a3cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:59:16.801127 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ea146d89-7372-4bad-b3b4-5d5a718f45bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:16.877547 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1411/2863] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:59:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 17:59:16.888556 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188f450-90e0-41d3-b899-0ae6cf410163 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:16.890284 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7188f450-90e0-41d3-b899-0ae6cf410163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:16.949330 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188f450-90e0-41d3-b899-0ae6cf410163 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:16.953429 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce7bc0-5e06-4d35-946c-9dd9e6dc9f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:16.954241 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce7bc0-5e06-4d35-946c-9dd9e6dc9f69 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:16.954593 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce7bc0-5e06-4d35-946c-9dd9e6dc9f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:16.954967 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce7bc0-5e06-4d35-946c-9dd9e6dc9f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:17.019633 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce7bc0-5e06-4d35-946c-9dd9e6dc9f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:17.021464 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce7bc0-5e06-4d35-946c-9dd9e6dc9f69 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:17.032280 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1453/2864] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:59:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:59:22.334044 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea146d89-7372-4bad-b3b4-5d5a718f45bc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:22.344403 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea146d89-7372-4bad-b3b4-5d5a718f45bc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:22.352474 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c18558-3d51-4957-9228-afa4180b4e0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:22.353058 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c18558-3d51-4957-9228-afa4180b4e0d service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:22.353359 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c18558-3d51-4957-9228-afa4180b4e0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:22.353658 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c18558-3d51-4957-9228-afa4180b4e0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:22.363068 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c18558-3d51-4957-9228-afa4180b4e0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:22.365331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c18558-3d51-4957-9228-afa4180b4e0d service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:22.375056 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1412/2865] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:59:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 17:59:23.489499 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce7bc0-5e06-4d35-946c-9dd9e6dc9f69 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:23.490908 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ddce7bc0-5e06-4d35-946c-9dd9e6dc9f69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:23.548420 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce7bc0-5e06-4d35-946c-9dd9e6dc9f69 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:23.552702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23920cd-2c14-43d5-bbb1-8f35b477ed72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:23.553334 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23920cd-2c14-43d5-bbb1-8f35b477ed72 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:23.553609 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23920cd-2c14-43d5-bbb1-8f35b477ed72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:23.553886 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23920cd-2c14-43d5-bbb1-8f35b477ed72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:23.555632 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c23920cd-2c14-43d5-bbb1-8f35b477ed72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:23.621007 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23920cd-2c14-43d5-bbb1-8f35b477ed72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:23.622446 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23920cd-2c14-43d5-bbb1-8f35b477ed72 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:23.633046 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1454/2866] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:59:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:59:28.129282 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c18558-3d51-4957-9228-afa4180b4e0d service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:28.190561 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c18558-3d51-4957-9228-afa4180b4e0d service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:28.198682 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902c0df-050f-4468-90f0-2fd84a033cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:28.201486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902c0df-050f-4468-90f0-2fd84a033cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:28.201486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902c0df-050f-4468-90f0-2fd84a033cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:28.201486 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902c0df-050f-4468-90f0-2fd84a033cac admin admin] PATH_INFO: `/v3/users/74f95ea179cf44d2af32533f06f073e4` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:28.202292 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902c0df-050f-4468-90f0-2fd84a033cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f95ea179cf44d2af32533f06f073e4)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:28.204215 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902c0df-050f-4468-90f0-2fd84a033cac admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:28.373947 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0902c0df-050f-4468-90f0-2fd84a033cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f95ea179cf44d2af32533f06f073e4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:28.387642 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0902c0df-050f-4468-90f0-2fd84a033cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f95ea179cf44d2af32533f06f073e4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:28.462758 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0902c0df-050f-4468-90f0-2fd84a033cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f95ea179cf44d2af32533f06f073e4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:28.470444 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0902c0df-050f-4468-90f0-2fd84a033cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f95ea179cf44d2af32533f06f073e4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:28.477061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0902c0df-050f-4468-90f0-2fd84a033cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f95ea179cf44d2af32533f06f073e4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:28.477699 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1413/2867] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:59:28 2022] DELETE /identity/v3/users/74f95ea179cf44d2af32533f06f073e4 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 17:59:28.482589 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68047623-aca4-46c2-b83b-65c71c550d2f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:28.483063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68047623-aca4-46c2-b83b-65c71c550d2f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:28.483232 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68047623-aca4-46c2-b83b-65c71c550d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:28.501722 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-68047623-aca4-46c2-b83b-65c71c550d2f None None] MFA Rules not processed for user `1d4d0e6c1c9344a380489ecebdd59a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 17:59:28.503044 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-68047623-aca4-46c2-b83b-65c71c550d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:28.576159 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1455/2868] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 17:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 17:59:28.585999 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902c0df-050f-4468-90f0-2fd84a033cac admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:28.587469 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0902c0df-050f-4468-90f0-2fd84a033cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:28.646354 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902c0df-050f-4468-90f0-2fd84a033cac admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:28.650331 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69614d51-6369-4a66-ac03-dfc29ebd00b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:28.651377 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614d51-6369-4a66-ac03-dfc29ebd00b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:28.651789 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614d51-6369-4a66-ac03-dfc29ebd00b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:28.652168 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614d51-6369-4a66-ac03-dfc29ebd00b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:28.662727 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69614d51-6369-4a66-ac03-dfc29ebd00b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:28.664158 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69614d51-6369-4a66-ac03-dfc29ebd00b1 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:28.674147 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1414/2869] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 17:59:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 17:59:29.265385 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68047623-aca4-46c2-b83b-65c71c550d2f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:29.266840 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-68047623-aca4-46c2-b83b-65c71c550d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:29.282535 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68047623-aca4-46c2-b83b-65c71c550d2f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:29.288916 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef62886-bfab-48e8-b5db-5f64d660c149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:29.290055 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef62886-bfab-48e8-b5db-5f64d660c149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:29.290526 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef62886-bfab-48e8-b5db-5f64d660c149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:29.290993 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef62886-bfab-48e8-b5db-5f64d660c149 admin admin] PATH_INFO: `/v3/projects/ff5394b865f04033a2d9e7a824e7ae91` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:29.293021 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef62886-bfab-48e8-b5db-5f64d660c149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff5394b865f04033a2d9e7a824e7ae91)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:29.294940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef62886-bfab-48e8-b5db-5f64d660c149 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:29.404500 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3ef62886-bfab-48e8-b5db-5f64d660c149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff5394b865f04033a2d9e7a824e7ae91', 'request_id': 'req-3ef62886-bfab-48e8-b5db-5f64d660c149'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:29.410591 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3ef62886-bfab-48e8-b5db-5f64d660c149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff5394b865f04033a2d9e7a824e7ae91', 'request_id': 'req-3ef62886-bfab-48e8-b5db-5f64d660c149'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:29.417199 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3ef62886-bfab-48e8-b5db-5f64d660c149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff5394b865f04033a2d9e7a824e7ae91', 'request_id': 'req-3ef62886-bfab-48e8-b5db-5f64d660c149'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:29.479301 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3ef62886-bfab-48e8-b5db-5f64d660c149 admin admin] The token cache is being invalidate because project ff5394b865f04033a2d9e7a824e7ae91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:59:29.479640 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3ef62886-bfab-48e8-b5db-5f64d660c149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:29.480890 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3ef62886-bfab-48e8-b5db-5f64d660c149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:29.488092 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1456/2870] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:59:29 2022] DELETE /identity/v3/projects/ff5394b865f04033a2d9e7a824e7ae91 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:59:29.488741 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69614d51-6369-4a66-ac03-dfc29ebd00b1 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:29.498417 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69614d51-6369-4a66-ac03-dfc29ebd00b1 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:29.558540 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6c4a3-ceb4-488c-8255-7c8f47142b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:29.559698 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6c4a3-ceb4-488c-8255-7c8f47142b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:29.559985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6c4a3-ceb4-488c-8255-7c8f47142b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:29.560253 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6c4a3-ceb4-488c-8255-7c8f47142b0b admin admin] PATH_INFO: `/v3/users/06b1c7d7b15c409c96eb56b69e4a3cdd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:29.561738 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6c4a3-ceb4-488c-8255-7c8f47142b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b1c7d7b15c409c96eb56b69e4a3cdd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:29.563846 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6c4a3-ceb4-488c-8255-7c8f47142b0b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:29.797815 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-92f6c4a3-ceb4-488c-8255-7c8f47142b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b1c7d7b15c409c96eb56b69e4a3cdd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:29.810448 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-92f6c4a3-ceb4-488c-8255-7c8f47142b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b1c7d7b15c409c96eb56b69e4a3cdd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:29.878044 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-92f6c4a3-ceb4-488c-8255-7c8f47142b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b1c7d7b15c409c96eb56b69e4a3cdd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:29.885311 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-92f6c4a3-ceb4-488c-8255-7c8f47142b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b1c7d7b15c409c96eb56b69e4a3cdd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:29.885943 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-92f6c4a3-ceb4-488c-8255-7c8f47142b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b1c7d7b15c409c96eb56b69e4a3cdd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:29.891735 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1415/2871] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 17:59:29 2022] DELETE /identity/v3/users/06b1c7d7b15c409c96eb56b69e4a3cdd => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 17:59:30.309842 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef62886-bfab-48e8-b5db-5f64d660c149 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 17:59:30.311401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3ef62886-bfab-48e8-b5db-5f64d660c149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 17:59:30.328389 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef62886-bfab-48e8-b5db-5f64d660c149 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 17:59:30.391822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb6719-629b-4213-bb03-e69ba04f9a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 17:59:30.392705 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb6719-629b-4213-bb03-e69ba04f9a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 17:59:30.392982 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb6719-629b-4213-bb03-e69ba04f9a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 17:59:30.393251 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb6719-629b-4213-bb03-e69ba04f9a69 admin admin] PATH_INFO: `/v3/projects/b6e8d1486f2d4bf4af7ceff4d0f87f06` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 17:59:30.394466 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb6719-629b-4213-bb03-e69ba04f9a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e8d1486f2d4bf4af7ceff4d0f87f06)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 17:59:30.397393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb6719-629b-4213-bb03-e69ba04f9a69 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 17:59:30.508242 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5bfb6719-629b-4213-bb03-e69ba04f9a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e8d1486f2d4bf4af7ceff4d0f87f06', 'request_id': 'req-5bfb6719-629b-4213-bb03-e69ba04f9a69'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:30.513735 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5bfb6719-629b-4213-bb03-e69ba04f9a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e8d1486f2d4bf4af7ceff4d0f87f06', 'request_id': 'req-5bfb6719-629b-4213-bb03-e69ba04f9a69'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:30.520768 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5bfb6719-629b-4213-bb03-e69ba04f9a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e8d1486f2d4bf4af7ceff4d0f87f06', 'request_id': 'req-5bfb6719-629b-4213-bb03-e69ba04f9a69'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:30.603147 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5bfb6719-629b-4213-bb03-e69ba04f9a69 admin admin] The token cache is being invalidate because project b6e8d1486f2d4bf4af7ceff4d0f87f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 17:59:30.603360 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5bfb6719-629b-4213-bb03-e69ba04f9a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:30.603969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5bfb6719-629b-4213-bb03-e69ba04f9a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 17:59:30.605544 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1457/2872] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 17:59:30 2022] DELETE /identity/v3/projects/b6e8d1486f2d4bf4af7ceff4d0f87f06 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:00:00.509289 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6c4a3-ceb4-488c-8255-7c8f47142b0b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:00.510734 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-92f6c4a3-ceb4-488c-8255-7c8f47142b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:00.569779 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6c4a3-ceb4-488c-8255-7c8f47142b0b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:00.618226 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8ca17-4cbe-4e35-86fb-2bbcb74ba77f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f22b09c1ffc4006a4b47ba882c55f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:00.618824 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8ca17-4cbe-4e35-86fb-2bbcb74ba77f service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:00.619110 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8ca17-4cbe-4e35-86fb-2bbcb74ba77f service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:00.619393 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8ca17-4cbe-4e35-86fb-2bbcb74ba77f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:00.621353 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-00e8ca17-4cbe-4e35-86fb-2bbcb74ba77f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:00.692364 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8ca17-4cbe-4e35-86fb-2bbcb74ba77f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:00.693839 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8ca17-4cbe-4e35-86fb-2bbcb74ba77f service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:00.704514 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1416/2873] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 18:00:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:00:03.650572 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb6719-629b-4213-bb03-e69ba04f9a69 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:03.652063 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5bfb6719-629b-4213-bb03-e69ba04f9a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:03.708275 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb6719-629b-4213-bb03-e69ba04f9a69 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:03.712632 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3c87b-d0e7-414f-8462-b0ae3f839840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:03.713264 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3c87b-d0e7-414f-8462-b0ae3f839840 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:03.713538 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3c87b-d0e7-414f-8462-b0ae3f839840 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:03.713807 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3c87b-d0e7-414f-8462-b0ae3f839840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:03.715508 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dbf3c87b-d0e7-414f-8462-b0ae3f839840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:03.728885 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3c87b-d0e7-414f-8462-b0ae3f839840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:03.733826 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3c87b-d0e7-414f-8462-b0ae3f839840 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:03.741772 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1458/2874] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 18:00:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:00:16.295788 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1e3e0-f61b-4177-ab20-90b5bae2f76e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:16.301460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1e3e0-f61b-4177-ab20-90b5bae2f76e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:16.301460 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1e3e0-f61b-4177-ab20-90b5bae2f76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:16.314086 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e2f1e3e0-f61b-4177-ab20-90b5bae2f76e None None] MFA Rules not processed for user `09a4a1284a82420698040821c4d4c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:00:16.315275 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e2f1e3e0-f61b-4177-ab20-90b5bae2f76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:16.379316 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1417/2875] 10.222.0.81 () {58 vars in 957 bytes} [Wed May 4 18:00:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:00:17.069162 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3c87b-d0e7-414f-8462-b0ae3f839840 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:17.071622 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dbf3c87b-d0e7-414f-8462-b0ae3f839840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:17.143986 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3c87b-d0e7-414f-8462-b0ae3f839840 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:17.149167 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d2020-7898-4db5-8f83-8c5ebf29adc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ff8c001247c43ccbc4ccb26daa17201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:17.149803 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d2020-7898-4db5-8f83-8c5ebf29adc7 service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:17.150081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d2020-7898-4db5-8f83-8c5ebf29adc7 service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:17.150354 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d2020-7898-4db5-8f83-8c5ebf29adc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:17.152152 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-915d2020-7898-4db5-8f83-8c5ebf29adc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:17.164277 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d2020-7898-4db5-8f83-8c5ebf29adc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:17.165861 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d2020-7898-4db5-8f83-8c5ebf29adc7 service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:17.175680 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1459/2876] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 18:00:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:00:19.971671 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1e3e0-f61b-4177-ab20-90b5bae2f76e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:19.981786 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1e3e0-f61b-4177-ab20-90b5bae2f76e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:19.985453 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb5896-4fef-4a59-8a1a-68bee201ffc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:19.986085 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb5896-4fef-4a59-8a1a-68bee201ffc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:19.986363 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb5896-4fef-4a59-8a1a-68bee201ffc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:19.986655 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb5896-4fef-4a59-8a1a-68bee201ffc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:19.988425 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ddfb5896-4fef-4a59-8a1a-68bee201ffc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:20.001414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb5896-4fef-4a59-8a1a-68bee201ffc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:20.001414 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb5896-4fef-4a59-8a1a-68bee201ffc0 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:20.009938 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1418/2877] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 18:00:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:00:39.110426 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d2020-7898-4db5-8f83-8c5ebf29adc7 service placement] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:39.112630 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-915d2020-7898-4db5-8f83-8c5ebf29adc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:39.128230 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d2020-7898-4db5-8f83-8c5ebf29adc7 service placement] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:39.134724 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88767cc-386e-4f68-b25b-ca7ddd3c2c93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:39.135267 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88767cc-386e-4f68-b25b-ca7ddd3c2c93 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:39.135547 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88767cc-386e-4f68-b25b-ca7ddd3c2c93 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:39.135822 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88767cc-386e-4f68-b25b-ca7ddd3c2c93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:39.137677 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f88767cc-386e-4f68-b25b-ca7ddd3c2c93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:39.151200 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88767cc-386e-4f68-b25b-ca7ddd3c2c93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:39.152892 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88767cc-386e-4f68-b25b-ca7ddd3c2c93 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:39.164398 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1460/2878] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 18:00:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:00:45.667722 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb5896-4fef-4a59-8a1a-68bee201ffc0 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:45.681471 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb5896-4fef-4a59-8a1a-68bee201ffc0 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:45.687123 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03f37e-51cd-43d4-85d6-91c8c7983247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a073d8f47a485cbb22db01530f3b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:45.687763 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03f37e-51cd-43d4-85d6-91c8c7983247 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:45.688050 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03f37e-51cd-43d4-85d6-91c8c7983247 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:45.688327 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03f37e-51cd-43d4-85d6-91c8c7983247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:45.690149 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7d03f37e-51cd-43d4-85d6-91c8c7983247 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:45.702616 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03f37e-51cd-43d4-85d6-91c8c7983247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:45.704208 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03f37e-51cd-43d4-85d6-91c8c7983247 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:45.714988 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1419/2879] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 18:00:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:00:59.749348 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88767cc-386e-4f68-b25b-ca7ddd3c2c93 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:00:59.759418 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88767cc-386e-4f68-b25b-ca7ddd3c2c93 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:00:59.763027 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b53110-28a1-436a-a6a4-5c96be43afe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f0feac2b384b509bc9f75b92b4df95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:00:59.763649 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b53110-28a1-436a-a6a4-5c96be43afe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:00:59.763934 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b53110-28a1-436a-a6a4-5c96be43afe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:00:59.764250 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b53110-28a1-436a-a6a4-5c96be43afe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:00:59.766126 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f7b53110-28a1-436a-a6a4-5c96be43afe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:00:59.827958 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b53110-28a1-436a-a6a4-5c96be43afe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:00:59.829415 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b53110-28a1-436a-a6a4-5c96be43afe5 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:00:59.839183 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1461/2880] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 18:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:01:07.951532 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03f37e-51cd-43d4-85d6-91c8c7983247 service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:01:07.953072 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7d03f37e-51cd-43d4-85d6-91c8c7983247 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:01:07.968611 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03f37e-51cd-43d4-85d6-91c8c7983247 service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:01:07.973421 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580caba-a786-4ea0-8817-5a33d44ab1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:01:07.974522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580caba-a786-4ea0-8817-5a33d44ab1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:01:07.974801 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580caba-a786-4ea0-8817-5a33d44ab1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:01:07.975684 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580caba-a786-4ea0-8817-5a33d44ab1be admin admin] PATH_INFO: `/v3/users/d653275573ef4485ad38892d703f2159` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:01:07.976926 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580caba-a786-4ea0-8817-5a33d44ab1be admin admin] RBAC: Authorizing `identity:delete_user(user_id=d653275573ef4485ad38892d703f2159)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:01:07.978858 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580caba-a786-4ea0-8817-5a33d44ab1be admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:01:08.144146 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e580caba-a786-4ea0-8817-5a33d44ab1be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd653275573ef4485ad38892d703f2159'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:08.156724 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e580caba-a786-4ea0-8817-5a33d44ab1be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd653275573ef4485ad38892d703f2159'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:08.210416 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e580caba-a786-4ea0-8817-5a33d44ab1be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd653275573ef4485ad38892d703f2159'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:08.217526 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e580caba-a786-4ea0-8817-5a33d44ab1be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd653275573ef4485ad38892d703f2159'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:08.218191 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e580caba-a786-4ea0-8817-5a33d44ab1be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd653275573ef4485ad38892d703f2159'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:08.224203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1420/2881] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 18:01:07 2022] DELETE /identity/v3/users/d653275573ef4485ad38892d703f2159 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:01:08.522595 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b53110-28a1-436a-a6a4-5c96be43afe5 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:01:08.531461 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b53110-28a1-436a-a6a4-5c96be43afe5 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:01:08.590258 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba722d81-f755-41c5-b4c3-bbde1066a1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:01:08.591188 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba722d81-f755-41c5-b4c3-bbde1066a1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:01:08.591470 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba722d81-f755-41c5-b4c3-bbde1066a1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:01:08.591746 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba722d81-f755-41c5-b4c3-bbde1066a1cd admin admin] PATH_INFO: `/v3/projects/15a8c4e6884c42919a5828e77d5abd4f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:01:08.592969 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba722d81-f755-41c5-b4c3-bbde1066a1cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a8c4e6884c42919a5828e77d5abd4f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:01:08.594869 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba722d81-f755-41c5-b4c3-bbde1066a1cd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:01:08.743127 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ba722d81-f755-41c5-b4c3-bbde1066a1cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a8c4e6884c42919a5828e77d5abd4f', 'request_id': 'req-ba722d81-f755-41c5-b4c3-bbde1066a1cd'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:08.748486 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ba722d81-f755-41c5-b4c3-bbde1066a1cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a8c4e6884c42919a5828e77d5abd4f', 'request_id': 'req-ba722d81-f755-41c5-b4c3-bbde1066a1cd'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:08.754672 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ba722d81-f755-41c5-b4c3-bbde1066a1cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a8c4e6884c42919a5828e77d5abd4f', 'request_id': 'req-ba722d81-f755-41c5-b4c3-bbde1066a1cd'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:08.844626 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ba722d81-f755-41c5-b4c3-bbde1066a1cd admin admin] The token cache is being invalidate because project 15a8c4e6884c42919a5828e77d5abd4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:01:08.844832 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ba722d81-f755-41c5-b4c3-bbde1066a1cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:08.845404 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ba722d81-f755-41c5-b4c3-bbde1066a1cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:08.847018 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1462/2882] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 18:01:08 2022] DELETE /identity/v3/projects/15a8c4e6884c42919a5828e77d5abd4f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:01:08.851822 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580caba-a786-4ea0-8817-5a33d44ab1be admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:01:08.853344 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e580caba-a786-4ea0-8817-5a33d44ab1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:01:08.867338 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580caba-a786-4ea0-8817-5a33d44ab1be admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:01:08.921203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4171f2-cd4a-4361-b4d2-05baa75258f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:01:08.922059 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4171f2-cd4a-4361-b4d2-05baa75258f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:01:08.922348 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4171f2-cd4a-4361-b4d2-05baa75258f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:01:08.922623 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4171f2-cd4a-4361-b4d2-05baa75258f1 admin admin] PATH_INFO: `/v3/users/6b72f8d3a4e9422fb35b0c2d8d8d6fdc` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:01:08.923799 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4171f2-cd4a-4361-b4d2-05baa75258f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b72f8d3a4e9422fb35b0c2d8d8d6fdc)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:01:08.925725 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4171f2-cd4a-4361-b4d2-05baa75258f1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:01:09.127070 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-be4171f2-cd4a-4361-b4d2-05baa75258f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b72f8d3a4e9422fb35b0c2d8d8d6fdc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:09.138902 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-be4171f2-cd4a-4361-b4d2-05baa75258f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b72f8d3a4e9422fb35b0c2d8d8d6fdc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:09.210784 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-be4171f2-cd4a-4361-b4d2-05baa75258f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b72f8d3a4e9422fb35b0c2d8d8d6fdc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:09.217701 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-be4171f2-cd4a-4361-b4d2-05baa75258f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b72f8d3a4e9422fb35b0c2d8d8d6fdc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:09.218359 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-be4171f2-cd4a-4361-b4d2-05baa75258f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b72f8d3a4e9422fb35b0c2d8d8d6fdc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:09.224142 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1421/2883] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 18:01:08 2022] DELETE /identity/v3/users/6b72f8d3a4e9422fb35b0c2d8d8d6fdc => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:01:09.440979 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba722d81-f755-41c5-b4c3-bbde1066a1cd admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:01:09.446393 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ba722d81-f755-41c5-b4c3-bbde1066a1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:01:09.456635 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba722d81-f755-41c5-b4c3-bbde1066a1cd admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:01:09.513127 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7871f10-8469-437b-81e7-8055989bb2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:01:09.513979 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7871f10-8469-437b-81e7-8055989bb2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:01:09.514262 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7871f10-8469-437b-81e7-8055989bb2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:01:09.514537 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7871f10-8469-437b-81e7-8055989bb2f6 admin admin] PATH_INFO: `/v3/projects/eb6b4b0efdc44ba28313d7ab1bf5e36b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:01:09.515702 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7871f10-8469-437b-81e7-8055989bb2f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6b4b0efdc44ba28313d7ab1bf5e36b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:01:09.517918 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7871f10-8469-437b-81e7-8055989bb2f6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:01:09.633858 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a7871f10-8469-437b-81e7-8055989bb2f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6b4b0efdc44ba28313d7ab1bf5e36b', 'request_id': 'req-a7871f10-8469-437b-81e7-8055989bb2f6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:09.639303 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a7871f10-8469-437b-81e7-8055989bb2f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6b4b0efdc44ba28313d7ab1bf5e36b', 'request_id': 'req-a7871f10-8469-437b-81e7-8055989bb2f6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:09.649246 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a7871f10-8469-437b-81e7-8055989bb2f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6b4b0efdc44ba28313d7ab1bf5e36b', 'request_id': 'req-a7871f10-8469-437b-81e7-8055989bb2f6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:09.718775 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a7871f10-8469-437b-81e7-8055989bb2f6 admin admin] The token cache is being invalidate because project eb6b4b0efdc44ba28313d7ab1bf5e36b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:01:09.718985 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a7871f10-8469-437b-81e7-8055989bb2f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:09.719581 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a7871f10-8469-437b-81e7-8055989bb2f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:09.721171 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1463/2884] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 18:01:09 2022] DELETE /identity/v3/projects/eb6b4b0efdc44ba28313d7ab1bf5e36b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:01:23.988905 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4171f2-cd4a-4361-b4d2-05baa75258f1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:01:23.990375 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-be4171f2-cd4a-4361-b4d2-05baa75258f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:01:24.068433 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4171f2-cd4a-4361-b4d2-05baa75258f1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:01:24.121159 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404796d0-925f-45c3-8460-e81e0bc844bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:01:24.122025 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404796d0-925f-45c3-8460-e81e0bc844bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:01:24.122305 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404796d0-925f-45c3-8460-e81e0bc844bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:01:24.122581 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404796d0-925f-45c3-8460-e81e0bc844bf admin admin] PATH_INFO: `/v3/users/09a4a1284a82420698040821c4d4c108` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:01:24.123774 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404796d0-925f-45c3-8460-e81e0bc844bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=09a4a1284a82420698040821c4d4c108)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:01:24.125694 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404796d0-925f-45c3-8460-e81e0bc844bf admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:01:24.304130 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-404796d0-925f-45c3-8460-e81e0bc844bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09a4a1284a82420698040821c4d4c108'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:24.316104 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-404796d0-925f-45c3-8460-e81e0bc844bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09a4a1284a82420698040821c4d4c108'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:24.381648 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-404796d0-925f-45c3-8460-e81e0bc844bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09a4a1284a82420698040821c4d4c108'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:24.388764 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-404796d0-925f-45c3-8460-e81e0bc844bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09a4a1284a82420698040821c4d4c108'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:24.389384 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-404796d0-925f-45c3-8460-e81e0bc844bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09a4a1284a82420698040821c4d4c108'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:24.395535 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1422/2885] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 18:01:23 2022] DELETE /identity/v3/users/09a4a1284a82420698040821c4d4c108 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:01:24.622863 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7871f10-8469-437b-81e7-8055989bb2f6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:01:24.624323 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a7871f10-8469-437b-81e7-8055989bb2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:01:24.695533 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7871f10-8469-437b-81e7-8055989bb2f6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:01:24.750177 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:01:24.751068 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:01:24.751476 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:01:24.751829 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c admin admin] PATH_INFO: `/v3/projects/44abe4738e4d43d68e68b5d4928ea3e4` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:01:24.753032 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=44abe4738e4d43d68e68b5d4928ea3e4)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:01:24.754940 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:01:24.855102 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44abe4738e4d43d68e68b5d4928ea3e4', 'request_id': 'req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:24.861337 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44abe4738e4d43d68e68b5d4928ea3e4', 'request_id': 'req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:24.867742 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44abe4738e4d43d68e68b5d4928ea3e4', 'request_id': 'req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:24.969341 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c admin admin] The token cache is being invalidate because project 44abe4738e4d43d68e68b5d4928ea3e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:01:24.969625 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:24.970412 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:24.971946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1464/2886] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 18:01:24 2022] DELETE /identity/v3/projects/44abe4738e4d43d68e68b5d4928ea3e4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:01:46.140519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830213-c6d4-49ae-b724-9c35eff975ea None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:01:46.141031 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830213-c6d4-49ae-b724-9c35eff975ea None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:01:46.141140 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830213-c6d4-49ae-b724-9c35eff975ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:01:46.168826 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-05830213-c6d4-49ae-b724-9c35eff975ea None None] MFA Rules not processed for user `ef7da67b09104f4991befeb14cd0581b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:01:46.169954 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-05830213-c6d4-49ae-b724-9c35eff975ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:01:46.243475 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1423/2887] 10.222.0.81 () {58 vars in 967 bytes} [Wed May 4 18:01:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:01:46.285373 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:01:46.286867 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:01:46.355713 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0f04d-36f8-4364-be69-7e78e1f9fa4c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:01:46.360715 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2d635-fc7a-45d6-a37e-dad13e9b9a51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382e84e110754effa5ffec950f7c1598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:01:46.361362 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2d635-fc7a-45d6-a37e-dad13e9b9a51 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:01:46.362403 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2d635-fc7a-45d6-a37e-dad13e9b9a51 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:01:46.362685 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2d635-fc7a-45d6-a37e-dad13e9b9a51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:01:46.370670 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2d635-fc7a-45d6-a37e-dad13e9b9a51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:01:46.372262 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2d635-fc7a-45d6-a37e-dad13e9b9a51 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:01:46.380278 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1465/2888] 10.222.0.81 () {60 vars in 1384 bytes} [Wed May 4 18:01:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:01:55.060861 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05830213-c6d4-49ae-b724-9c35eff975ea None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:01:55.062313 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-05830213-c6d4-49ae-b724-9c35eff975ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:01:55.129985 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05830213-c6d4-49ae-b724-9c35eff975ea None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:01:55.134630 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf37c88-40d2-47b8-b5e9-e07fbf9864d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:01:55.135491 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf37c88-40d2-47b8-b5e9-e07fbf9864d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:01:55.135770 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf37c88-40d2-47b8-b5e9-e07fbf9864d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:01:55.136038 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf37c88-40d2-47b8-b5e9-e07fbf9864d5 admin admin] PATH_INFO: `/v3/users/b15bcfb68e8048979f45a8c6ac4b6d13` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:01:55.137270 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf37c88-40d2-47b8-b5e9-e07fbf9864d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b15bcfb68e8048979f45a8c6ac4b6d13)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:01:55.139195 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf37c88-40d2-47b8-b5e9-e07fbf9864d5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:01:55.325418 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8cf37c88-40d2-47b8-b5e9-e07fbf9864d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b15bcfb68e8048979f45a8c6ac4b6d13'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:55.338051 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8cf37c88-40d2-47b8-b5e9-e07fbf9864d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b15bcfb68e8048979f45a8c6ac4b6d13'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:55.386106 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8cf37c88-40d2-47b8-b5e9-e07fbf9864d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b15bcfb68e8048979f45a8c6ac4b6d13'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:55.393618 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8cf37c88-40d2-47b8-b5e9-e07fbf9864d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b15bcfb68e8048979f45a8c6ac4b6d13'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:55.394257 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8cf37c88-40d2-47b8-b5e9-e07fbf9864d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b15bcfb68e8048979f45a8c6ac4b6d13'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:55.400033 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1424/2889] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 18:01:55 2022] DELETE /identity/v3/users/b15bcfb68e8048979f45a8c6ac4b6d13 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:01:55.616895 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2d635-fc7a-45d6-a37e-dad13e9b9a51 service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:01:55.629866 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2d635-fc7a-45d6-a37e-dad13e9b9a51 service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:01:55.687912 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870b99b-b2a5-435b-bf09-d2a484153f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:01:55.688800 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870b99b-b2a5-435b-bf09-d2a484153f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:01:55.689611 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870b99b-b2a5-435b-bf09-d2a484153f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:01:55.689995 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870b99b-b2a5-435b-bf09-d2a484153f57 admin admin] PATH_INFO: `/v3/projects/3582f692d07d4a959f4033ced79df226` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:01:55.691168 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870b99b-b2a5-435b-bf09-d2a484153f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3582f692d07d4a959f4033ced79df226)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:01:55.693105 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870b99b-b2a5-435b-bf09-d2a484153f57 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:01:55.808900 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2870b99b-b2a5-435b-bf09-d2a484153f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3582f692d07d4a959f4033ced79df226', 'request_id': 'req-2870b99b-b2a5-435b-bf09-d2a484153f57'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:55.814762 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2870b99b-b2a5-435b-bf09-d2a484153f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3582f692d07d4a959f4033ced79df226', 'request_id': 'req-2870b99b-b2a5-435b-bf09-d2a484153f57'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:55.820821 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2870b99b-b2a5-435b-bf09-d2a484153f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3582f692d07d4a959f4033ced79df226', 'request_id': 'req-2870b99b-b2a5-435b-bf09-d2a484153f57'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:55.887724 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2870b99b-b2a5-435b-bf09-d2a484153f57 admin admin] The token cache is being invalidate because project 3582f692d07d4a959f4033ced79df226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:01:55.887963 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2870b99b-b2a5-435b-bf09-d2a484153f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:55.888610 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2870b99b-b2a5-435b-bf09-d2a484153f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:55.890312 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1466/2890] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 18:01:55 2022] DELETE /identity/v3/projects/3582f692d07d4a959f4033ced79df226 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:01:55.894653 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf37c88-40d2-47b8-b5e9-e07fbf9864d5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:01:55.896061 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8cf37c88-40d2-47b8-b5e9-e07fbf9864d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:01:55.909365 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf37c88-40d2-47b8-b5e9-e07fbf9864d5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:01:55.967745 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79f126-9972-486f-b333-609c455a3305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:01:55.968648 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79f126-9972-486f-b333-609c455a3305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:01:55.968931 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79f126-9972-486f-b333-609c455a3305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:01:55.969203 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79f126-9972-486f-b333-609c455a3305 admin admin] PATH_INFO: `/v3/users/4266ac3d7e8b4715997207cc1bc93a15` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:01:55.970545 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79f126-9972-486f-b333-609c455a3305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4266ac3d7e8b4715997207cc1bc93a15)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:01:55.972749 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79f126-9972-486f-b333-609c455a3305 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:01:56.170805 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ba79f126-9972-486f-b333-609c455a3305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4266ac3d7e8b4715997207cc1bc93a15'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:56.186188 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ba79f126-9972-486f-b333-609c455a3305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4266ac3d7e8b4715997207cc1bc93a15'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:56.254141 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ba79f126-9972-486f-b333-609c455a3305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4266ac3d7e8b4715997207cc1bc93a15'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:56.261026 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ba79f126-9972-486f-b333-609c455a3305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4266ac3d7e8b4715997207cc1bc93a15'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:56.261646 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ba79f126-9972-486f-b333-609c455a3305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4266ac3d7e8b4715997207cc1bc93a15'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:56.267742 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1425/2891] 10.222.0.81 () {58 vars in 1223 bytes} [Wed May 4 18:01:55 2022] DELETE /identity/v3/users/4266ac3d7e8b4715997207cc1bc93a15 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:01:56.513217 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870b99b-b2a5-435b-bf09-d2a484153f57 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:01:56.518459 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2870b99b-b2a5-435b-bf09-d2a484153f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:01:56.528886 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870b99b-b2a5-435b-bf09-d2a484153f57 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:01:56.585987 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035f1ad-f536-4643-93eb-3adb81180347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4d0e6c1c9344a380489ecebdd59a95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f269e9f1b44f73928e694fdc60f6bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:01:56.586846 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035f1ad-f536-4643-93eb-3adb81180347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:01:56.587127 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035f1ad-f536-4643-93eb-3adb81180347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:01:56.587401 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035f1ad-f536-4643-93eb-3adb81180347 admin admin] PATH_INFO: `/v3/projects/eca6b33fac794c98abe00913972e493e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:01:56.588602 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035f1ad-f536-4643-93eb-3adb81180347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eca6b33fac794c98abe00913972e493e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:01:56.590497 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035f1ad-f536-4643-93eb-3adb81180347 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:01:56.677667 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6035f1ad-f536-4643-93eb-3adb81180347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca6b33fac794c98abe00913972e493e', 'request_id': 'req-6035f1ad-f536-4643-93eb-3adb81180347'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:56.682946 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6035f1ad-f536-4643-93eb-3adb81180347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca6b33fac794c98abe00913972e493e', 'request_id': 'req-6035f1ad-f536-4643-93eb-3adb81180347'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:56.689025 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6035f1ad-f536-4643-93eb-3adb81180347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca6b33fac794c98abe00913972e493e', 'request_id': 'req-6035f1ad-f536-4643-93eb-3adb81180347'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:56.745153 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6035f1ad-f536-4643-93eb-3adb81180347 admin admin] The token cache is being invalidate because project eca6b33fac794c98abe00913972e493e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:01:56.745463 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6035f1ad-f536-4643-93eb-3adb81180347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:56.746081 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6035f1ad-f536-4643-93eb-3adb81180347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:01:56.747652 dv-cinder-840512-1-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1467/2892] 10.222.0.81 () {58 vars in 1232 bytes} [Wed May 4 18:01:56 2022] DELETE /identity/v3/projects/eca6b33fac794c98abe00913972e493e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:04:00.796522 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79f126-9972-486f-b333-609c455a3305 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:04:00.798289 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ba79f126-9972-486f-b333-609c455a3305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:04:00.887325 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79f126-9972-486f-b333-609c455a3305 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:04:00.943493 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6526c-1893-4a7e-abb0-318aecba002b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ff8c001247c43ccbc4ccb26daa17201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '544a56c4b97e43aea9fbb003d80af8dc', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:04:00.944136 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6526c-1893-4a7e-abb0-318aecba002b service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:04:00.944422 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6526c-1893-4a7e-abb0-318aecba002b service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:04:00.944730 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6526c-1893-4a7e-abb0-318aecba002b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:04:00.946519 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fdb6526c-1893-4a7e-abb0-318aecba002b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:04:00.957804 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6526c-1893-4a7e-abb0-318aecba002b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:04:00.959415 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6526c-1893-4a7e-abb0-318aecba002b service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:04:00.969294 dv-cinder-840512-1-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1426/2893] 10.222.0.81 () {60 vars in 1365 bytes} [Wed May 4 18:04:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)